-- Logs begin at Tue 2022-07-26 06:44:28 UTC, end at Tue 2022-07-26 08:14:51 UTC. -- Jul 26 07:16:31.184392 dv-cinder-850836-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 26 07:16:31.192858 dv-cinder-850836-1-iscsi devstack@n-api.service[103175]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 26 07:16:31.197688 dv-cinder-850836-1-iscsi devstack@n-api.service[103175]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 26 07:16:31 2022] *** Jul 26 07:16:31.197688 dv-cinder-850836-1-iscsi devstack@n-api.service[103175]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 26 07:16:31.197688 dv-cinder-850836-1-iscsi devstack@n-api.service[103175]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 26 07:16:31.197688 dv-cinder-850836-1-iscsi devstack@n-api.service[103175]: nodename: dv-cinder-850836-1-iscsi Jul 26 07:16:31.197688 dv-cinder-850836-1-iscsi devstack@n-api.service[103175]: machine: x86_64 Jul 26 07:16:31.197688 dv-cinder-850836-1-iscsi devstack@n-api.service[103175]: clock source: unix Jul 26 07:16:31.197688 dv-cinder-850836-1-iscsi devstack@n-api.service[103175]: pcre jit disabled Jul 26 07:16:31.197688 dv-cinder-850836-1-iscsi devstack@n-api.service[103175]: detected number of CPU cores: 4 Jul 26 07:16:31.197688 dv-cinder-850836-1-iscsi devstack@n-api.service[103175]: current working directory: / Jul 26 07:16:31.197688 dv-cinder-850836-1-iscsi devstack@n-api.service[103175]: detected binary path: /usr/bin/uwsgi-core Jul 26 07:16:31.197688 dv-cinder-850836-1-iscsi devstack@n-api.service[103175]: your processes number limit is 47680 Jul 26 07:16:31.197688 dv-cinder-850836-1-iscsi devstack@n-api.service[103175]: your memory page size is 4096 bytes Jul 26 07:16:31.197688 dv-cinder-850836-1-iscsi devstack@n-api.service[103175]: detected max file descriptor number: 2048 Jul 26 07:16:31.197688 dv-cinder-850836-1-iscsi devstack@n-api.service[103175]: lock engine: pthread robust mutexes Jul 26 07:16:31.197688 dv-cinder-850836-1-iscsi devstack@n-api.service[103175]: thunder lock: enabled Jul 26 07:16:31.197688 dv-cinder-850836-1-iscsi devstack@n-api.service[103175]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 26 07:16:31.197688 dv-cinder-850836-1-iscsi devstack@n-api.service[103175]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 26 07:16:31.235467 dv-cinder-850836-1-iscsi devstack@n-api.service[103175]: Python main interpreter initialized at 0x5564cf4c89c0 Jul 26 07:16:31.235467 dv-cinder-850836-1-iscsi devstack@n-api.service[103175]: python threads support enabled Jul 26 07:16:31.235467 dv-cinder-850836-1-iscsi devstack@n-api.service[103175]: your server socket listen backlog is limited to 100 connections Jul 26 07:16:31.235467 dv-cinder-850836-1-iscsi devstack@n-api.service[103175]: your mercy for graceful operations on workers is 90 seconds Jul 26 07:16:31.235909 dv-cinder-850836-1-iscsi devstack@n-api.service[103175]: mapped 403077 bytes (393 KB) for 2 cores Jul 26 07:16:31.235909 dv-cinder-850836-1-iscsi devstack@n-api.service[103175]: *** Operational MODE: preforking *** Jul 26 07:16:31.236541 dv-cinder-850836-1-iscsi devstack@n-api.service[103175]: *** uWSGI is running in multiple interpreter mode *** Jul 26 07:16:31.236541 dv-cinder-850836-1-iscsi devstack@n-api.service[103175]: spawned uWSGI master process (pid: 103175) Jul 26 07:16:31.236767 dv-cinder-850836-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 26 07:16:31.238274 dv-cinder-850836-1-iscsi devstack@n-api.service[103175]: spawned uWSGI worker 1 (pid: 103176, cores: 1) Jul 26 07:16:31.238274 dv-cinder-850836-1-iscsi devstack@n-api.service[103175]: spawned uWSGI worker 2 (pid: 103177, cores: 1) Jul 26 07:16:31.238274 dv-cinder-850836-1-iscsi devstack@n-api.service[103175]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 26 07:16:31.903207 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 07:16:31.919263 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 07:16:32.973731 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 07:16:32.973731 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: from cryptography.utils import int_from_bytes Jul 26 07:16:32.974543 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 07:16:32.974543 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: from cryptography.utils import int_from_bytes Jul 26 07:16:33.026316 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 07:16:33.026316 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: from cryptography.utils import int_from_bytes Jul 26 07:16:33.026968 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 07:16:33.026968 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: from cryptography.utils import int_from_bytes Jul 26 07:16:35.449728 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 07:16:35.450198 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 07:16:35.450301 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 07:16:35.450301 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 07:16:35.450724 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 07:16:35.450803 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 07:16:35.450885 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 07:16:35.451102 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 07:16:35.451218 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 07:16:35.451424 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 07:16:35.451553 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.451803 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.451934 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.452113 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.452203 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.452418 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.452560 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.452726 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.452879 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.453048 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.453177 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.453317 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.453412 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.453654 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.453838 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.453959 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.454110 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.454201 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.454279 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.454540 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.454670 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.454849 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.454980 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850836-1-iscsi {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.455164 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.455307 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850836-1-iscsi {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.455444 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.455540 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.455763 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.455892 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.456066 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.456196 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.456338 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.456427 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.456647 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.456806 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.456951 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.457061 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.457248 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.457449 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.457823 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.458847 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.458977 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.459064 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.459206 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.459319 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.459402 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.459486 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.459579 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.459657 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.459782 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.459877 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.459955 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.460073 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.460166 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.460251 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.460334 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.460416 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.460535 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.460670 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.460831 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.461062 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850836-1-iscsi {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.461201 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850836-1-iscsi {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.461372 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.461501 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.461680 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.461849 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.462017 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.462115 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.462426 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.462538 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.462729 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.462905 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.463028 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.463109 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.463347 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.463446 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.463662 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.463752 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.463964 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.464052 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.464287 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.464378 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.464598 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.464688 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.464908 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.464996 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.465216 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.465305 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.465512 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.465609 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.465833 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.465924 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.466137 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.466234 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.466447 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.466537 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.466744 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.466842 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.467026 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.467130 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.467270 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.467356 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.467570 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.467656 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.467889 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.468038 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.468203 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.468300 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.468517 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.468606 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.468763 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.468849 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.469006 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.469100 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.469318 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.469455 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.469629 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.469715 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.469965 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.470097 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.470251 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.470346 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.470551 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.470644 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.470849 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.470933 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.471148 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.471246 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.471445 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.471529 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.471744 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.471837 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.472041 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.472130 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.472353 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.472444 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.472659 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.472743 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.472973 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.473066 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.473272 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.473356 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.473582 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.473665 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.473998 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.474087 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.474276 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.474365 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.474577 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.474663 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.474910 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.474996 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.475220 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.475312 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.475522 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.475613 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.475832 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.475925 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.476145 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.476230 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.476443 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.476536 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.476745 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.476837 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.477042 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.477132 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.477352 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.477522 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.477678 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.477830 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.478011 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.478119 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.478256 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.478366 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.478548 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.478642 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.478845 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.478938 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.479154 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.479252 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.479452 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.479535 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.479749 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.479833 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.480049 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.480135 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.480341 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.480425 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.480639 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.480731 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.480937 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.481029 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.481239 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.481545 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.481861 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.482164 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.482467 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.482773 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.483072 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.483299 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.483384 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.483661 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.483757 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.483975 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.484058 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.484274 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.484406 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.484575 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.484676 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.484875 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.484969 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.485179 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.485274 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.485477 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.485570 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.485795 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.485885 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.486548 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.486775 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.487074 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.487349 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.487438 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.487662 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.487754 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.487964 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.488056 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.488270 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.488370 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.488563 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.488648 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.488866 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.488967 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.489174 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.489258 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.489476 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.489560 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.489829 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.490008 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.490149 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.490235 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.490447 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.490553 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.490746 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.491051 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.491344 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.491644 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.491940 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.492256 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.492574 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.492883 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.493190 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.493339 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.493480 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.493785 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.493975 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.494125 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.494250 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.494419 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.494507 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.494738 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.494834 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.495058 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.495142 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.495369 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.495452 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.495678 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.495774 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.495984 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.496069 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.496290 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.496375 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.496595 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.496689 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.496900 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.496992 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.497202 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.497340 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.497524 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.497620 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.497833 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.497922 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.498149 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.498462 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.498787 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.499099 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.499409 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.499722 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.500028 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.500339 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.500663 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.500946 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.501032 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.501274 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.501358 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.501610 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.501942 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.502033 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.502259 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.502344 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.502569 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.502667 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.502893 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.502986 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:16:35.503200 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.503368 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.503506 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.503592 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.503813 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.503899 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.504133 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.504219 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.504470 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.504596 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.504779 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.504865 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.505091 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.505178 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.505397 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.505545 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.505727 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.505887 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.506051 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.506137 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.506359 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.506454 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.506663 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.506749 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.506973 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.507066 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.507291 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.507420 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.507600 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.507693 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.507906 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.507997 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.508215 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.508300 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.508521 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.508608 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.508826 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.508920 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.509210 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.509313 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.509482 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.509560 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.509716 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.509898 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.510034 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.510202 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.510337 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.510511 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.510637 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.510854 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.510949 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.511193 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.511279 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.511504 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.511590 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.511824 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.511910 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.512142 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.512228 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.512444 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.512530 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.512747 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.512833 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.513047 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.513131 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.513347 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.513441 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.513654 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.513760 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.513981 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.514067 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.514281 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.514367 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.514585 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.514707 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.514891 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.514975 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.515189 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.515274 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.515493 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.515578 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.515844 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.515936 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.516095 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.516190 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.516390 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.516475 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.516696 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.516782 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.517003 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.517101 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.517310 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.517394 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.517613 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.517700 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.517943 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.518049 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.518249 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.518343 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.518550 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.518639 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.518851 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.518947 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.519532 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.519625 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.519704 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.519782 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.519872 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.519941 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.520028 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.520103 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.520572 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.520657 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.520733 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.520800 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.520963 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.521129 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.521340 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.521428 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.521643 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.521729 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.521970 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.522057 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.522276 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.522361 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.522575 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.522664 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.522878 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.522962 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.523175 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.523270 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.523473 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.523565 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.523821 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.523946 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.524108 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.524264 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.524355 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.524437 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.524696 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.524877 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.524994 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.525118 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.525250 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.525354 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.527738 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.527884 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.527987 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.528082 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.528173 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.528254 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.528332 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.528411 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.528499 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.528581 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.528657 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.528731 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.528811 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.528896 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.528986 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.529076 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.529163 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.529233 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.529307 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.529374 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.529447 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.529514 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.529579 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.529643 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.529707 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.529831 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.529911 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.529979 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.530050 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.530118 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.530183 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.530256 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.530330 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.530433 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.530627 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.530895 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.530993 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.531149 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.531220 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.531375 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.531509 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.531689 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.531826 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.532044 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.532145 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.532351 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.532471 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.532653 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.532786 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.532971 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.533120 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.535619 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.535772 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.535887 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.536013 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.536104 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.536186 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.536265 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.536344 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.536344 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.536507 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.536507 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.536665 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.536665 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.536810 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.536889 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.536977 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.537065 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.537145 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.537223 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.537301 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.537379 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.537471 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.537552 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.537631 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.537711 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.537811 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.537893 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.537985 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.538073 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.538152 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.538230 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.538310 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.538405 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.538485 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.538563 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.538642 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.538727 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.538802 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.538971 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.539068 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.539250 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.539387 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.539550 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.539637 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.539855 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.543088 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.543088 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.543237 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.543237 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.543381 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.543483 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.543566 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.543645 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.543722 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.543801 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.543892 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.543974 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.544052 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.544130 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.544215 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.544297 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.544390 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.544472 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.544560 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.544641 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.544718 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.544795 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.544882 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.544963 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.545029 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.545094 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.545159 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.545235 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.545321 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.545401 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.545478 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.545564 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.545643 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.545731 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.545828 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.545907 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.545984 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.546062 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.546140 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.546232 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.546312 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.546398 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.546478 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.546555 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.546644 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.546733 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.546813 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.546927 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.547024 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.547232 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.547320 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.547531 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.547619 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.547845 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.547933 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.548159 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.548255 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.548461 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.548547 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.548756 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.548842 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.549056 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.549152 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.549358 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.549460 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.549666 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.549788 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.549994 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.550097 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.550298 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.550385 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.550600 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.550686 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.550905 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.551001 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.551205 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.551293 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.551504 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.551600 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.551804 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.551893 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.552109 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.552195 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.552465 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.552554 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.552778 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.552866 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.553079 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.553167 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.553384 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.553473 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.553698 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.553805 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.554021 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.554304 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.554394 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.554628 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.554729 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.554926 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.555015 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.555225 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.555315 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.555523 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.555621 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.555839 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.555927 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.556152 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.556240 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.556449 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.556537 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.556758 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.556855 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.557071 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.557241 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.557373 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.557468 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.557674 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.557783 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.558003 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.558092 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.558304 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.558402 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.558602 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.558690 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.558900 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.559036 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.559199 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.559296 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.559500 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.559588 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.559798 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.559885 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.560097 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.560193 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.560396 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.560483 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.560694 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.560782 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.560997 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.561088 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.561295 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.561382 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.561595 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.561681 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.561915 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.562013 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.562217 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.562304 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.562521 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.562615 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.562824 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.563093 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.563183 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.563402 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.563489 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.563710 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.563806 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.564019 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.564107 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.564331 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.564418 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.564640 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.564729 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.564960 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.565049 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.565272 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.565359 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.565571 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.565659 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.565912 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.566012 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.566212 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.566300 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.566509 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.566605 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.566805 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.566892 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.567105 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.567193 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.567403 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.567499 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.567697 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.567783 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.568016 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.568103 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.568318 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.568420 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.568616 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.568749 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.568910 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.568998 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.569205 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.569309 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.569499 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.569586 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.569822 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.569941 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.570120 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.570253 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.570423 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.570544 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.570718 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.570805 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.571013 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.571103 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.571317 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.571406 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.571609 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.571694 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.571904 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.571993 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.572197 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.572284 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.572494 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.572583 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.572810 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.572906 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.573111 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.573207 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.573409 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.573515 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.573707 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.573854 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.574033 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.574133 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.574336 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.574435 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.574635 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.574722 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.574939 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.575025 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.575237 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.575334 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.575531 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.575619 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.575827 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.575912 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.576125 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.576213 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.576420 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.576515 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.576719 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.576807 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.577018 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.577106 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.577318 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.577406 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.577618 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.577714 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.577938 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.578028 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.578237 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.578323 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.578532 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.578619 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.578832 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.578928 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.579131 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.579264 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.579424 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.579522 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.579720 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.579817 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.580015 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.580101 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.580311 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.580408 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.580603 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.580690 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.580899 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.580996 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.581191 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.581287 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.581500 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.581588 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.581818 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.581911 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.582118 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.582297 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.582412 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.582508 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.582712 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.582810 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.583011 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.583100 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.583306 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.583393 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.583671 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.583767 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.583977 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.584067 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.584274 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.584362 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.584570 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.584660 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.584873 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.584963 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.585168 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.585257 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.585462 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.585551 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.585781 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.585883 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.586100 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.586188 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.586409 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.586495 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.586713 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.586800 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.587015 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.587103 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.587336 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.587433 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.587634 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.587729 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.587931 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.588019 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.588231 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.588329 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.588527 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.588624 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.588820 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.588961 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.589113 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.589212 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.589409 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.589500 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.589702 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.589810 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.590040 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.590138 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.590346 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.590435 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.590652 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.590785 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.590939 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.591028 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.591234 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.591322 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.591541 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.591627 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.591849 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.591937 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.592155 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.592242 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.592459 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.592547 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.592774 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.592861 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.593075 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.593161 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.593375 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.593462 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.593676 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.593784 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.594007 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.594108 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.594305 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.594405 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.594608 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.594694 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.594907 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.594996 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.595211 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.595317 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.595508 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.595595 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.595802 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.595945 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.596115 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.596258 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.596420 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.596569 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.596724 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.596871 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.597036 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.597177 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.597349 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.597484 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.597662 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.597816 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.597980 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.598118 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.598281 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.598410 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.598582 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.598820 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.598921 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.599135 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.599230 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.599471 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.599558 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.599775 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.599871 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.600074 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.600160 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.600376 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.600462 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.600679 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.600777 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.600983 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.601070 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.601282 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.601370 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.601582 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.601673 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.601905 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.601993 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.602204 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.602290 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.602511 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.602598 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.602815 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.602901 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.603115 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.603231 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.603417 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.603538 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.603714 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.603838 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.604018 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.604249 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.604346 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.604556 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.604733 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.604862 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.605039 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.605181 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.605344 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.605497 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.605642 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.605846 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.605972 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.606147 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.606275 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.606456 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.606585 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.606763 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.606894 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.607084 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.607195 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.607402 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.607606 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.607693 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.607911 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.608009 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.608218 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.608306 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.608521 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.608616 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.608818 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.608914 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.609117 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.609204 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.609420 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.609559 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.609751 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.609919 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.610059 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.610240 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.610356 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.610549 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.610762 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.610859 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.611446 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.611543 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.611744 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.611832 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.612059 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.612146 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.612408 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.612496 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.612715 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.612802 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.613018 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.613105 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.613337 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.613433 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.613640 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.613729 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.613972 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.614074 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.614279 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.614368 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.614586 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.614680 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.614935 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.615032 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.615237 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.615334 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.615556 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.615659 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.615858 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.615961 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.616175 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.616271 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.616486 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.616574 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.616787 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.616883 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.617094 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.617183 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.617393 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.617492 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.617709 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.617845 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.618035 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.618123 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.618335 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.618422 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.618635 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.618724 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.618933 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.619046 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.619270 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.619366 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.619568 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.619667 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.619882 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.619969 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.620208 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.620296 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.620532 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.620629 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.620837 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.620935 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.621150 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.621365 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.621461 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.621545 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.621730 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.621843 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.622066 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.622175 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.622367 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.622463 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.622674 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.622771 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.622972 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.623075 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.623271 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.623365 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.623569 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.623725 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.623866 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.624027 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.624165 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.624346 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.624468 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.624649 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.624770 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.624968 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.625055 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.625275 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.625364 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.625595 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.625701 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.625951 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.626052 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.626249 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.626356 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.626554 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.626650 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.626853 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.626940 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.627150 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.627238 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.627446 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.627547 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.627741 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.627829 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.628066 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.628153 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.628362 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.628451 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.628673 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.628760 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.628997 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.629093 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.629319 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.629421 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.629621 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.629818 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.629962 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.630050 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.630275 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.630365 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.630612 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.630701 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.630921 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.631015 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.631229 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.631325 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.631528 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.631629 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.631821 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.631919 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.632123 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.632212 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.632419 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.632514 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.632713 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.632815 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.633009 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.633097 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.633311 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.633408 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.633607 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.633927 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.634019 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.634224 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.634312 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.634537 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.634628 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.634832 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.634922 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.635144 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.635241 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.635444 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.635546 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.635740 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.635828 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.636036 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.636137 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.636329 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.636426 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.636645 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.636732 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.636943 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.637030 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.637265 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.637362 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.637575 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.637662 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.637914 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.638005 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.638237 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.638335 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.638543 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.638638 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.638849 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.638944 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.639155 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.639243 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.639462 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.639556 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.639768 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.639855 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.640079 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.640177 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.640388 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.640477 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.640695 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.640792 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.641002 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.641090 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.641300 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.641387 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.641603 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.641699 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.641930 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.642019 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.642237 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.642336 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.642546 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.642789 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.642879 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.643114 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.643201 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.643423 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.643519 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.643741 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.643860 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.644037 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.644135 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.644344 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.644448 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.644652 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.644740 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.644955 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.645042 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.645256 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.645356 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.645558 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.645645 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.645906 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.646118 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.646343 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.646440 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.646663 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.646759 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.646983 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.647071 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.647314 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.647403 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.647624 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.647719 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.647931 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.648020 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.648242 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.648332 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.648554 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.648643 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.648856 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.648943 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.649163 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.649252 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.649467 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.649554 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.649797 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.650010 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.650102 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.650170 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.650410 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.650511 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.650711 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.650808 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.651012 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.651100 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.651316 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.651441 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.651620 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.651841 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.651931 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.652185 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.652281 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.652496 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.652593 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.652796 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.652883 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.653111 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.653199 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.653424 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.653521 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.653726 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.653860 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.654052 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.654152 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.654355 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.654451 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.654657 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.654744 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.654966 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.655175 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.655279 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.655480 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.655570 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.655805 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.655893 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.656121 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.656219 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.656424 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.656511 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.656723 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.656810 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.657027 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.657128 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.657325 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.657427 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.657631 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.657726 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.657954 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.658057 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.658250 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.658337 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.658551 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.658637 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.658846 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.658935 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.659144 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.659230 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.659442 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.659530 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.659735 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.659831 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.660030 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.660125 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.660334 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.660424 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.660633 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.660855 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.660998 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.661196 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.661287 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.661504 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.661608 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.661850 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.661953 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.662157 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.662253 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.662496 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.662585 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.662797 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.662884 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.663103 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.663194 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.663401 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.663491 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.663698 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.663785 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.664004 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.664099 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.664305 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.664392 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.664602 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.664690 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.664898 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.664985 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.665200 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.665289 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.665500 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.665589 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.665898 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.666091 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.666182 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.666422 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.666512 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.666741 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.666829 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.667068 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.667156 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.667364 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.667452 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.667662 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.667750 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.667965 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.668055 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.668261 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.668350 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.668557 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.668646 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.668854 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.668943 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.669148 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.669237 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.669448 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.669545 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.669760 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.669853 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.670119 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.670234 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.670362 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.670461 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.670662 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.670749 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.670957 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.671044 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.671257 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.671353 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.671561 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.671651 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.671864 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.671953 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.672164 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.672254 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.672465 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.672559 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.672771 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.672867 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.673072 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.673162 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.673385 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.673474 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.673686 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.673793 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.674013 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.674106 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.674336 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.674469 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.674640 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.674729 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.674944 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.675164 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.675254 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.675490 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.675578 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.675803 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.675900 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.676126 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.676225 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.676441 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.676530 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.676740 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.676828 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.677037 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.677158 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.677362 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.677516 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.677786 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.677882 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.678087 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.678177 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.678390 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.678566 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.678693 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.678782 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.678997 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.679085 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.679314 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.679412 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.679617 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.679705 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.679919 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.680019 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.680227 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.680353 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.680530 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.680630 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.680828 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.680917 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.681128 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.681218 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.681427 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.681524 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.681731 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.681838 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.682062 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.682152 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.682365 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.682452 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.682683 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.682770 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.682990 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.683078 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.683290 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.683386 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.683588 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.683676 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.683889 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.683984 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.684187 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.684274 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.684486 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.684584 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.684785 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.684873 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.685081 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.685168 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.685382 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.685484 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.685679 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.685805 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.686000 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.686091 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.686298 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.686404 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.686595 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.686697 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.686891 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.687002 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.687187 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.687316 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.687488 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.687618 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.687785 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.687932 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.688083 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.688247 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.688378 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.688549 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.688675 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.688863 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.688962 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.689169 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.689284 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.689493 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.689610 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.689848 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.690006 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.690228 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.690339 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.690495 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.690602 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.690806 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.690896 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.691094 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.691182 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.691391 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.691478 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.691692 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.691788 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.692010 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.692106 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.692304 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.692392 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.692601 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.692690 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.692899 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.693008 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.693226 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.693328 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.693522 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.693610 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.693850 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.693997 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.694148 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.694246 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.694445 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.694588 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.694743 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.694840 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.695036 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.695140 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.695331 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.695420 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.695626 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.695714 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.695922 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.696022 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.696217 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.696306 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.696512 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.696599 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.696813 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.696901 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.697107 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.697206 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.697403 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.697492 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.697697 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.697843 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.698019 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.698108 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.698314 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.698410 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.698636 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.698736 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.698962 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.699050 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.699268 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.699370 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.699575 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.699664 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.699882 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.699968 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.700190 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.700297 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.700494 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.700657 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.700810 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.700899 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.701112 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.701214 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.701421 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.701509 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.701724 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.701843 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.702074 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.702171 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.702379 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.702468 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.702686 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.702772 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.702991 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.703080 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.703298 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.703387 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.703599 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.703687 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.703907 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.703996 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.704149 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 07:16:35.704243 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.704533 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.704835 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.705155 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.705465 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.705797 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.706112 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.706418 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.706741 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.707046 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.707350 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.707653 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.707957 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.708260 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.708589 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.708957 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.709263 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.709571 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.709917 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.710231 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.710548 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.710850 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.711168 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.711592 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.711941 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.712246 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.712583 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.712906 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.713213 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.713569 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.713846 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:16:35.714089 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 07:16:35.863805 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO dbcounter [None req-b185a969-97ef-40c8-9dea-d54fccb04b75 None None] Registered counter for database nova_api Jul 26 07:16:35.871562 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO dbcounter [None req-5e49cf5c-42a1-483d-adbb-b6552e1b0e06 None None] Registered counter for database nova_api Jul 26 07:16:35.885788 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG oslo_db.sqlalchemy.engines [None req-b185a969-97ef-40c8-9dea-d54fccb04b75 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 07:16:35.891331 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG oslo_db.sqlalchemy.engines [None req-5e49cf5c-42a1-483d-adbb-b6552e1b0e06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103176) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 07:16:35.892470 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG dbcounter [-] [103177] Writer thread running {{(pid=103177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 07:16:35.898234 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG dbcounter [-] [103176] Writer thread running {{(pid=103176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 07:16:35.948102 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.context [None req-b185a969-97ef-40c8-9dea-d54fccb04b75 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0c0ac969-2f99-49ee-92fc-c2c2e5e059a0(cell1) {{(pid=103177) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 07:16:35.952023 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG oslo_concurrency.lockutils [None req-b185a969-97ef-40c8-9dea-d54fccb04b75 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:16:35.953455 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.context [None req-5e49cf5c-42a1-483d-adbb-b6552e1b0e06 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0c0ac969-2f99-49ee-92fc-c2c2e5e059a0(cell1) {{(pid=103176) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 07:16:35.953590 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG oslo_concurrency.lockutils [None req-b185a969-97ef-40c8-9dea-d54fccb04b75 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:16:35.954378 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG oslo_concurrency.lockutils [None req-b185a969-97ef-40c8-9dea-d54fccb04b75 None None] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:16:35.956339 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG oslo_concurrency.lockutils [None req-b185a969-97ef-40c8-9dea-d54fccb04b75 None None] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:16:35.957385 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG oslo_concurrency.lockutils [None req-5e49cf5c-42a1-483d-adbb-b6552e1b0e06 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:16:35.958357 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO dbcounter [None req-b185a969-97ef-40c8-9dea-d54fccb04b75 None None] Registered counter for database nova_cell0 Jul 26 07:16:35.959003 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG oslo_concurrency.lockutils [None req-5e49cf5c-42a1-483d-adbb-b6552e1b0e06 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:16:35.959775 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG oslo_concurrency.lockutils [None req-5e49cf5c-42a1-483d-adbb-b6552e1b0e06 None None] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:16:35.961765 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG oslo_concurrency.lockutils [None req-5e49cf5c-42a1-483d-adbb-b6552e1b0e06 None None] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:16:35.963760 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO dbcounter [None req-5e49cf5c-42a1-483d-adbb-b6552e1b0e06 None None] Registered counter for database nova_cell0 Jul 26 07:16:35.963909 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO dbcounter [None req-b185a969-97ef-40c8-9dea-d54fccb04b75 None None] Registered counter for database nova_cell1 Jul 26 07:16:35.969149 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO dbcounter [None req-5e49cf5c-42a1-483d-adbb-b6552e1b0e06 None None] Registered counter for database nova_cell1 Jul 26 07:16:35.972003 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG oslo_db.sqlalchemy.engines [None req-b185a969-97ef-40c8-9dea-d54fccb04b75 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 07:16:35.973059 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG oslo_db.sqlalchemy.engines [None req-b185a969-97ef-40c8-9dea-d54fccb04b75 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 07:16:35.976754 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG oslo_db.sqlalchemy.engines [None req-5e49cf5c-42a1-483d-adbb-b6552e1b0e06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103176) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 07:16:35.978426 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG oslo_db.sqlalchemy.engines [None req-5e49cf5c-42a1-483d-adbb-b6552e1b0e06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103176) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 07:16:35.980291 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG dbcounter [-] [103177] Writer thread running {{(pid=103177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 07:16:35.981728 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG dbcounter [-] [103177] Writer thread running {{(pid=103177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 07:16:35.985192 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG dbcounter [-] [103176] Writer thread running {{(pid=103176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 07:16:35.985524 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG dbcounter [-] [103176] Writer thread running {{(pid=103176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 07:16:36.126718 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO dbcounter [None req-5e49cf5c-42a1-483d-adbb-b6552e1b0e06 None None] Registered counter for database nova_cell0 Jul 26 07:16:36.133950 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO dbcounter [None req-b185a969-97ef-40c8-9dea-d54fccb04b75 None None] Registered counter for database nova_cell0 Jul 26 07:16:36.134338 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG oslo_db.sqlalchemy.engines [None req-5e49cf5c-42a1-483d-adbb-b6552e1b0e06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103176) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 07:16:36.139224 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG dbcounter [-] [103176] Writer thread running {{(pid=103176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 07:16:36.141088 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG oslo_db.sqlalchemy.engines [None req-b185a969-97ef-40c8-9dea-d54fccb04b75 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 07:16:36.146457 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG dbcounter [-] [103177] Writer thread running {{(pid=103177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 07:16:36.471937 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: WARNING keystonemiddleware.auth_token [None req-5e49cf5c-42a1-483d-adbb-b6552e1b0e06 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 07:16:36.472509 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: WARNING keystonemiddleware.auth_token [None req-b185a969-97ef-40c8-9dea-d54fccb04b75 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 07:16:36.479417 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: WARNING keystonemiddleware.auth_token [None req-5e49cf5c-42a1-483d-adbb-b6552e1b0e06 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 07:16:36.479592 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: WARNING keystonemiddleware.auth_token [None req-b185a969-97ef-40c8-9dea-d54fccb04b75 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 07:16:36.818174 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: WARNING keystonemiddleware.auth_token [None req-5e49cf5c-42a1-483d-adbb-b6552e1b0e06 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 07:16:36.819311 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: WARNING keystonemiddleware.auth_token [None req-b185a969-97ef-40c8-9dea-d54fccb04b75 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 07:16:36.824308 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: WARNING keystonemiddleware.auth_token [None req-5e49cf5c-42a1-483d-adbb-b6552e1b0e06 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 07:16:36.825282 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: WARNING keystonemiddleware.auth_token [None req-b185a969-97ef-40c8-9dea-d54fccb04b75 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 07:16:36.829568 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5564cf4c89c0 pid: 103176 (default app) Jul 26 07:16:36.830521 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5564cf4c89c0 pid: 103177 (default app) Jul 26 07:16:36.831674 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-5e49cf5c-42a1-483d-adbb-b6552e1b0e06 None None] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:16:36.832835 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-5e49cf5c-42a1-483d-adbb-b6552e1b0e06 None None] 10.222.0.39 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001732 Jul 26 07:16:36.833228 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 788 bytes} [Tue Jul 26 07:16:36 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:17:56.464117 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-b185a969-97ef-40c8-9dea-d54fccb04b75 None None] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:17:56.466013 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-b185a969-97ef-40c8-9dea-d54fccb04b75 None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002607 Jul 26 07:17:56.466384 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 1/2] 10.222.0.39 () {54 vars in 930 bytes} [Tue Jul 26 07:17:56 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 07:17:56.481944 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG dbcounter [-] [103176] Writing DB stats nova_api:SELECT=3 {{(pid=103176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:56.482889 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG dbcounter [-] [103176] Writing DB stats nova_cell1:SELECT=3 {{(pid=103176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:56.483706 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG dbcounter [-] [103176] Writing DB stats nova_cell0:SELECT=3 {{(pid=103176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:56.484396 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG dbcounter [-] [103176] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:57.386136 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-1b84a6f8-5b53-418e-bc58-18c8777a9564 admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:17:57.419403 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-1b84a6f8-5b53-418e-bc58-18c8777a9564 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.946703 Jul 26 07:17:57.420196 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 2/3] 10.222.0.39 () {60 vars in 1291 bytes} [Tue Jul 26 07:17:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:17:59.645490 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-b185a969-97ef-40c8-9dea-d54fccb04b75 None None] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:17:59.647049 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-b185a969-97ef-40c8-9dea-d54fccb04b75 None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001942 Jul 26 07:17:59.647862 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 2/4] 10.222.0.39 () {54 vars in 930 bytes} [Tue Jul 26 07:17:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:18:00.128607 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-3625b21a-4740-449b-8f8e-440a6e41b334 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "disk": 1, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "id": "c1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256"}} {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:18:00.148824 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 07:18:00.148824 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: warnings.warn(msg) Jul 26 07:18:00.179375 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-3625b21a-4740-449b-8f8e-440a6e41b334 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.524924 Jul 26 07:18:00.179922 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 3/5] 10.222.0.39 () {64 vars in 1282 bytes} [Tue Jul 26 07:17:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:18:00.406641 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-e303e8f2-15e7-4967-9429-e7dca59e3d89 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:18:00.411717 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 07:18:00.411717 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: warnings.warn(msg) Jul 26 07:18:00.415067 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG dbcounter [-] [103177] Writing DB stats nova_api:SELECT=3 {{(pid=103177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:18:00.415946 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG dbcounter [-] [103177] Writing DB stats nova_cell0:SELECT=3 {{(pid=103177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:18:00.416929 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG dbcounter [-] [103177] Writing DB stats nova_cell1:SELECT=3 {{(pid=103177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:18:00.417869 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG dbcounter [-] [103177] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:18:00.490188 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-e303e8f2-15e7-4967-9429-e7dca59e3d89 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.301720 Jul 26 07:18:00.490853 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 3/6] 10.222.0.39 () {64 vars in 1335 bytes} [Tue Jul 26 07:18:00 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:18:03.005220 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-3625b21a-4740-449b-8f8e-440a6e41b334 admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:18:03.007171 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-3625b21a-4740-449b-8f8e-440a6e41b334 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002611 Jul 26 07:18:03.008394 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 4/7] 10.222.0.39 () {54 vars in 930 bytes} [Tue Jul 26 07:18:03 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:18:03.840570 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-20e13d1a-3ea9-40b2-b410-bf1e1dca0ff6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "disk": 5, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:18:03.861526 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 07:18:03.861526 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: warnings.warn(msg) Jul 26 07:18:03.883801 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-20e13d1a-3ea9-40b2-b410-bf1e1dca0ff6 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.865561 Jul 26 07:18:03.884676 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 4/8] 10.222.0.39 () {64 vars in 1282 bytes} [Tue Jul 26 07:18:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:18:03.904746 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-23dda14e-8a69-4323-b3cb-fb6035e47c58 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:18:03.911031 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 07:18:03.911031 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: warnings.warn(msg) Jul 26 07:18:03.973683 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-23dda14e-8a69-4323-b3cb-fb6035e47c58 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.075484 Jul 26 07:18:03.975162 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 5/9] 10.222.0.39 () {64 vars in 1335 bytes} [Tue Jul 26 07:18:03 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:18:06.718601 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-20e13d1a-3ea9-40b2-b410-bf1e1dca0ff6 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:18:06.719939 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-20e13d1a-3ea9-40b2-b410-bf1e1dca0ff6 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001740 Jul 26 07:18:06.720609 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 5/10] 10.222.0.39 () {54 vars in 930 bytes} [Tue Jul 26 07:18:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:18:07.249763 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-95665b5a-ea66-4967-921d-b2c164afaa55 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "name": "ds1G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "disk": 10, "id": "d2"}} {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:18:07.274672 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-95665b5a-ea66-4967-921d-b2c164afaa55 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.546710 Jul 26 07:18:07.278433 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 6/11] 10.222.0.39 () {64 vars in 1282 bytes} [Tue Jul 26 07:18:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:18:07.291444 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-51408f2e-54cd-4246-abe6-e43081bd6a79 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:18:07.327409 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-51408f2e-54cd-4246-abe6-e43081bd6a79 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041489 Jul 26 07:18:07.328491 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 6/12] 10.222.0.39 () {64 vars in 1335 bytes} [Tue Jul 26 07:18:07 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:18:09.757630 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-95665b5a-ea66-4967-921d-b2c164afaa55 admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:18:09.759421 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-95665b5a-ea66-4967-921d-b2c164afaa55 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002562 Jul 26 07:18:09.760145 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 7/13] 10.222.0.39 () {54 vars in 930 bytes} [Tue Jul 26 07:18:09 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:18:10.355693 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-c5130d6c-b062-4058-8ba0-c4cd2c7c684c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "id": "d3", "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "ram": 2048, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:18:10.397920 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-c5130d6c-b062-4058-8ba0-c4cd2c7c684c admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.628795 Jul 26 07:18:10.399296 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 7/14] 10.222.0.39 () {64 vars in 1282 bytes} [Tue Jul 26 07:18:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:18:10.417212 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-0c2af489-a328-486a-8a99-d374dbd5d8bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:18:10.459190 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-0c2af489-a328-486a-8a99-d374dbd5d8bc admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050353 Jul 26 07:18:10.460319 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 8/15] 10.222.0.39 () {64 vars in 1335 bytes} [Tue Jul 26 07:18:10 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:18:12.960495 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-c5130d6c-b062-4058-8ba0-c4cd2c7c684c admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:18:12.961473 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-c5130d6c-b062-4058-8ba0-c4cd2c7c684c admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jul 26 07:18:12.964583 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 8/16] 10.222.0.39 () {54 vars in 930 bytes} [Tue Jul 26 07:18:12 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:18:13.599328 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-b3baf9e7-9837-47bd-b1b0-3b00d53ec8ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d4", "name": "ds4G", "os-flavor-access:is_public": true, "disk": 20, "rxtx_factor": 1.0, "vcpus": 4, "ram": 4096}} {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:18:13.624955 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-b3baf9e7-9837-47bd-b1b0-3b00d53ec8ca admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.656399 Jul 26 07:18:13.625925 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 9/17] 10.222.0.39 () {64 vars in 1282 bytes} [Tue Jul 26 07:18:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:18:13.639660 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-117c2af2-85aa-44b9-bcc8-4c967eee3f5a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:18:13.670189 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-117c2af2-85aa-44b9-bcc8-4c967eee3f5a admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034512 Jul 26 07:18:13.671116 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 9/18] 10.222.0.39 () {64 vars in 1335 bytes} [Tue Jul 26 07:18:13 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:18:16.371563 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-b3baf9e7-9837-47bd-b1b0-3b00d53ec8ca admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:18:16.372943 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-b3baf9e7-9837-47bd-b1b0-3b00d53ec8ca admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002047 Jul 26 07:18:16.373427 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 10/19] 10.222.0.39 () {54 vars in 930 bytes} [Tue Jul 26 07:18:16 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:18:16.850621 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-fa7f71c7-fee6-4219-9253-a26fa34263ea admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:18:16.884093 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-fa7f71c7-fee6-4219-9253-a26fa34263ea admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.502430 Jul 26 07:18:16.885103 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 10/20] 10.222.0.39 () {60 vars in 1291 bytes} [Tue Jul 26 07:18:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:18:19.608825 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-b3baf9e7-9837-47bd-b1b0-3b00d53ec8ca admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:18:19.610192 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-b3baf9e7-9837-47bd-b1b0-3b00d53ec8ca admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002138 Jul 26 07:18:19.610746 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 11/21] 10.222.0.39 () {54 vars in 930 bytes} [Tue Jul 26 07:18:19 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:18:20.127870 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-b6898439-2875-4448-b60c-3fe03ff081f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "vcpus": 1, "disk": 1, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "ram": 512}} {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:18:20.151456 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-b6898439-2875-4448-b60c-3fe03ff081f5 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.532113 Jul 26 07:18:20.152028 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 11/22] 10.222.0.39 () {64 vars in 1282 bytes} [Tue Jul 26 07:18:19 2022] POST /compute/v2.1/flavors => generated 402 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 07:18:20.166142 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-e1e8b64f-5ad6-4b14-a23c-296bc18f1ae1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:18:20.194678 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-e1e8b64f-5ad6-4b14-a23c-296bc18f1ae1 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033080 Jul 26 07:18:20.195212 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 12/23] 10.222.0.39 () {64 vars in 1332 bytes} [Tue Jul 26 07:18:20 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:18:22.456764 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-b6898439-2875-4448-b60c-3fe03ff081f5 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:18:22.457797 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-b6898439-2875-4448-b60c-3fe03ff081f5 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jul 26 07:18:22.458211 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 12/24] 10.222.0.39 () {54 vars in 930 bytes} [Tue Jul 26 07:18:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:18:22.831065 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-93e5adc9-ec05-4219-aa79-c9c8a58cbffd admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 2048, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2"}} {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:18:22.851526 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-93e5adc9-ec05-4219-aa79-c9c8a58cbffd admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.387007 Jul 26 07:18:22.852266 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 13/25] 10.222.0.39 () {64 vars in 1282 bytes} [Tue Jul 26 07:18:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:18:22.864960 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-c1756e27-9eb1-4949-aa85-c573bef04818 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:18:22.890744 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-c1756e27-9eb1-4949-aa85-c573bef04818 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029771 Jul 26 07:18:22.891319 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 13/26] 10.222.0.39 () {64 vars in 1332 bytes} [Tue Jul 26 07:18:22 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:18:25.167979 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-93e5adc9-ec05-4219-aa79-c9c8a58cbffd admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:18:25.169016 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-93e5adc9-ec05-4219-aa79-c9c8a58cbffd admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001649 Jul 26 07:18:25.169434 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 14/27] 10.222.0.39 () {54 vars in 930 bytes} [Tue Jul 26 07:18:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:18:25.777395 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-721a3007-40a7-4912-b755-f3b455791de9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 40, "ram": 4096, "os-flavor-access:is_public": true, "name": "m1.medium", "id": "3"}} {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:18:25.799238 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-721a3007-40a7-4912-b755-f3b455791de9 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.623017 Jul 26 07:18:25.806388 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 14/28] 10.222.0.39 () {64 vars in 1282 bytes} [Tue Jul 26 07:18:25 2022] POST /compute/v2.1/flavors => generated 406 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:18:25.812378 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-069c88c1-737f-4733-8b29-32b9a37cca6d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:18:25.839613 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-069c88c1-737f-4733-8b29-32b9a37cca6d admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030710 Jul 26 07:18:25.840979 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 15/29] 10.222.0.39 () {64 vars in 1332 bytes} [Tue Jul 26 07:18:25 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:18:28.107919 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-721a3007-40a7-4912-b755-f3b455791de9 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:18:28.109143 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-721a3007-40a7-4912-b755-f3b455791de9 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001731 Jul 26 07:18:28.109663 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 15/30] 10.222.0.39 () {54 vars in 930 bytes} [Tue Jul 26 07:18:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:18:28.670347 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-4fc5e1a7-afd5-43dc-a49e-e25fc7179ab3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "swap": 0, "rxtx_factor": 1.0, "ram": 8192, "id": "4", "os-flavor-access:is_public": true, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80}} {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:18:28.680056 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG dbcounter [-] [103176] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:18:28.698856 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-4fc5e1a7-afd5-43dc-a49e-e25fc7179ab3 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.581279 Jul 26 07:18:28.699908 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 16/31] 10.222.0.39 () {64 vars in 1282 bytes} [Tue Jul 26 07:18:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:18:28.712038 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-c0e8a419-d5bd-421f-9f33-b5b33685469f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:18:28.749538 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-c0e8a419-d5bd-421f-9f33-b5b33685469f admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041104 Jul 26 07:18:28.756207 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 16/32] 10.222.0.39 () {64 vars in 1332 bytes} [Tue Jul 26 07:18:28 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:18:31.267679 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-4fc5e1a7-afd5-43dc-a49e-e25fc7179ab3 admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:18:31.269420 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-4fc5e1a7-afd5-43dc-a49e-e25fc7179ab3 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002159 Jul 26 07:18:31.273854 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 17/33] 10.222.0.39 () {54 vars in 930 bytes} [Tue Jul 26 07:18:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:18:31.763447 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-d47051bc-84d5-4e0e-abc6-8830dd27be70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "rxtx_factor": 1.0, "id": "5", "disk": 160, "ram": 16384, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:18:31.774777 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG dbcounter [-] [103177] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=103177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:18:31.789504 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-d47051bc-84d5-4e0e-abc6-8830dd27be70 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.513073 Jul 26 07:18:31.790738 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 17/34] 10.222.0.39 () {64 vars in 1282 bytes} [Tue Jul 26 07:18:31 2022] POST /compute/v2.1/flavors => generated 408 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 07:18:31.808050 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-6d54a770-ff01-46ba-98d0-d0878c6109d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:18:31.846712 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-6d54a770-ff01-46ba-98d0-d0878c6109d1 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044043 Jul 26 07:18:31.853974 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 18/35] 10.222.0.39 () {64 vars in 1332 bytes} [Tue Jul 26 07:18:31 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:18:49.827829 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-d47051bc-84d5-4e0e-abc6-8830dd27be70 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:18:49.828889 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-d47051bc-84d5-4e0e-abc6-8830dd27be70 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Jul 26 07:18:49.829277 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 18/36] 10.222.0.39 () {54 vars in 930 bytes} [Tue Jul 26 07:18:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:18:49.839976 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG dbcounter [-] [103176] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:18:50.253541 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-c3dd0149-eb8f-4c07-b5ec-ea311c1b73fc admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:18:50.271819 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-c3dd0149-eb8f-4c07-b5ec-ea311c1b73fc admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.436248 Jul 26 07:18:50.272269 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 19/37] 10.222.0.39 () {60 vars in 1291 bytes} [Tue Jul 26 07:18:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:18:51.403030 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-d47051bc-84d5-4e0e-abc6-8830dd27be70 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:18:51.404450 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-d47051bc-84d5-4e0e-abc6-8830dd27be70 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001755 Jul 26 07:18:51.404904 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 19/38] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Jul 26 07:18:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:18:51.960158 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-ce51c67c-2429-4857-a352-c5bf530cd9fd admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:18:51.966139 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.wsgi [None req-ce51c67c-2429-4857-a352-c5bf530cd9fd admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 26 07:18:51.969711 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-ce51c67c-2429-4857-a352-c5bf530cd9fd admin admin] Request method failure captured: Jul 26 07:18:51.969711 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 26 07:18:51.969711 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: Accept: application/json Jul 26 07:18:51.969711 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: Accept-Encoding: gzip, deflate Jul 26 07:18:51.969711 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: Connection: keep-alive Jul 26 07:18:51.969711 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: Content-Length: 0 Jul 26 07:18:51.969711 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: Host: 10.222.0.39 Jul 26 07:18:51.969711 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: Openstack-Api-Version: compute 2.90 Jul 26 07:18:51.969711 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: Openstack-System-Scope: None Jul 26 07:18:51.969711 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: User-Agent: python-novaclient Jul 26 07:18:51.969711 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Auth-Token: gAAAAABi35VbNQfNIlfxEGvDWOOwEKXYX04SvWpInUs4b3r7NX5W1aCOfjua0w4ldl4sX8YtKw8cUbmjOUPsMDklYDn79p4p_MM5wRGz3JHU7y0wiFm7-LkO_V5G-5UfCJysv5Ckm4rMfl9d2mSno8TgWJc5HpZxsfBi_tZwX9x6ZA4COWss1AE Jul 26 07:18:51.969711 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Domain-Id: None Jul 26 07:18:51.969711 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Domain-Name: None Jul 26 07:18:51.969711 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Identity-Status: Confirmed Jul 26 07:18:51.969711 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Is-Admin-Project: True Jul 26 07:18:51.969711 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 07:18:51.969711 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Project-Domain-Id: default Jul 26 07:18:51.969711 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Project-Domain-Name: Default Jul 26 07:18:51.969711 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Project-Id: 9aaf3bcccded4ffcb2a432d5c86ce8ea Jul 26 07:18:51.969711 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Project-Name: admin Jul 26 07:18:51.969711 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Role: admin,member,reader Jul 26 07:18:51.969711 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Roles: admin,member,reader Jul 26 07:18:51.971364 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9aaf3bcccded4ffcb2a432d5c86ce8ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9aaf3bcccded4ffcb2a432d5c86ce8ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9aaf3bcccded4ffcb2a432d5c86ce8ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9aaf3bcccded4ffcb2a432d5c86ce8ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:18:51.971364 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Tenant: admin Jul 26 07:18:51.971364 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Tenant-Id: 9aaf3bcccded4ffcb2a432d5c86ce8ea Jul 26 07:18:51.971364 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Tenant-Name: admin Jul 26 07:18:51.971364 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-User: admin Jul 26 07:18:51.971364 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-User-Domain-Id: default Jul 26 07:18:51.971364 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-User-Domain-Name: Default Jul 26 07:18:51.971364 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-User-Id: 9e725435b0294296a28451de9a0d08c4 Jul 26 07:18:51.971364 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-User-Name: admin Jul 26 07:18:51.971364 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: method: > Jul 26 07:18:51.971364 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: exception: Flavor 42 could not be found. Jul 26 07:18:51.971364 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: action_args: {'id': '42'} Jul 26 07:18:51.971364 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:18:51.971364 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:18:51.972298 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 07:18:51.972298 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 07:18:51.972298 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 07:18:51.972298 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 07:18:51.972298 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 07:18:51.972298 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 07:18:51.972298 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 07:18:51.972298 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 07:18:51.972298 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 07:18:51.972298 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:18:51.972298 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 07:18:51.972298 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 07:18:51.972298 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 26 07:18:51.972298 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Jul 26 07:18:51.972298 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:18:51.972298 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Jul 26 07:18:51.972298 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:18:51.972298 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:18:51.972298 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:18:51.974391 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:18:51.974391 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:18:51.974391 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:18:51.974391 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:18:51.974391 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 07:18:51.974391 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:18:51.974391 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 26 07:18:51.974391 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Jul 26 07:18:51.974391 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:18:51.974391 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Jul 26 07:18:51.974391 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:18:51.974391 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:18:51.974391 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:18:51.974391 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:18:51.974391 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:18:51.974391 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 26 07:18:51.974391 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Jul 26 07:18:51.974391 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-ce51c67c-2429-4857-a352-c5bf530cd9fd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:18:51.975758 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-ce51c67c-2429-4857-a352-c5bf530cd9fd admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.427588 Jul 26 07:18:51.975758 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 20/39] 10.222.0.39 () {60 vars in 1190 bytes} [Tue Jul 26 07:18:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 429 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 07:18:51.984416 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-2dcd6792-1e4d-4bea-9c4f-0c71f63887fd admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:18:52.012135 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-2dcd6792-1e4d-4bea-9c4f-0c71f63887fd admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.032305 Jul 26 07:18:52.012794 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 20/40] 10.222.0.39 () {60 vars in 1210 bytes} [Tue Jul 26 07:18:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:18:52.025277 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-56d8cad7-5fa4-4488-ac47-61edbdd00082 admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:18:52.050777 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-56d8cad7-5fa4-4488-ac47-61edbdd00082 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029556 Jul 26 07:18:52.051391 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 21/41] 10.222.0.39 () {60 vars in 1210 bytes} [Tue Jul 26 07:18:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 07:18:52.061412 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-140b00f9-b70d-4b66-8dff-ac97b5a57270 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:18:52.067733 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.wsgi [None req-140b00f9-b70d-4b66-8dff-ac97b5a57270 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 26 07:18:52.071210 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-140b00f9-b70d-4b66-8dff-ac97b5a57270 admin admin] Request method failure captured: Jul 26 07:18:52.071210 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 26 07:18:52.071210 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: Accept: application/json Jul 26 07:18:52.071210 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: Accept-Encoding: gzip, deflate Jul 26 07:18:52.071210 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: Connection: keep-alive Jul 26 07:18:52.071210 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: Content-Length: 0 Jul 26 07:18:52.071210 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: Host: 10.222.0.39 Jul 26 07:18:52.071210 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: Openstack-Api-Version: compute 2.90 Jul 26 07:18:52.071210 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: Openstack-System-Scope: None Jul 26 07:18:52.071210 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: User-Agent: python-novaclient Jul 26 07:18:52.071210 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Auth-Token: gAAAAABi35VbNQfNIlfxEGvDWOOwEKXYX04SvWpInUs4b3r7NX5W1aCOfjua0w4ldl4sX8YtKw8cUbmjOUPsMDklYDn79p4p_MM5wRGz3JHU7y0wiFm7-LkO_V5G-5UfCJysv5Ckm4rMfl9d2mSno8TgWJc5HpZxsfBi_tZwX9x6ZA4COWss1AE Jul 26 07:18:52.071210 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Domain-Id: None Jul 26 07:18:52.071210 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Domain-Name: None Jul 26 07:18:52.071210 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Identity-Status: Confirmed Jul 26 07:18:52.071210 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Is-Admin-Project: True Jul 26 07:18:52.071210 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 07:18:52.071210 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Project-Domain-Id: default Jul 26 07:18:52.071210 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Project-Domain-Name: Default Jul 26 07:18:52.071210 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Project-Id: 9aaf3bcccded4ffcb2a432d5c86ce8ea Jul 26 07:18:52.071210 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Project-Name: admin Jul 26 07:18:52.071210 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Role: admin,member,reader Jul 26 07:18:52.071210 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Roles: admin,member,reader Jul 26 07:18:52.072792 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9aaf3bcccded4ffcb2a432d5c86ce8ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9aaf3bcccded4ffcb2a432d5c86ce8ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9aaf3bcccded4ffcb2a432d5c86ce8ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9aaf3bcccded4ffcb2a432d5c86ce8ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:18:52.072792 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Tenant: admin Jul 26 07:18:52.072792 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Tenant-Id: 9aaf3bcccded4ffcb2a432d5c86ce8ea Jul 26 07:18:52.072792 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Tenant-Name: admin Jul 26 07:18:52.072792 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-User: admin Jul 26 07:18:52.072792 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-User-Domain-Id: default Jul 26 07:18:52.072792 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-User-Domain-Name: Default Jul 26 07:18:52.072792 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-User-Id: 9e725435b0294296a28451de9a0d08c4 Jul 26 07:18:52.072792 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-User-Name: admin Jul 26 07:18:52.072792 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: method: > Jul 26 07:18:52.072792 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: exception: Flavor 42 could not be found. Jul 26 07:18:52.072792 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: action_args: {'id': '42'} Jul 26 07:18:52.072792 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:18:52.072792 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:18:52.073896 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 07:18:52.073896 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 07:18:52.073896 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 07:18:52.073896 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 07:18:52.073896 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 07:18:52.073896 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 07:18:52.073896 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 07:18:52.073896 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 07:18:52.073896 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 07:18:52.073896 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:18:52.073896 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 07:18:52.073896 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 07:18:52.073896 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 26 07:18:52.073896 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jul 26 07:18:52.073896 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:18:52.073896 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jul 26 07:18:52.073896 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:18:52.073896 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:18:52.073896 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:18:52.075339 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:18:52.075339 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:18:52.075339 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:18:52.075339 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:18:52.075339 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 07:18:52.075339 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:18:52.075339 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 26 07:18:52.075339 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jul 26 07:18:52.075339 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:18:52.075339 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jul 26 07:18:52.075339 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:18:52.075339 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:18:52.075339 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:18:52.075339 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:18:52.075339 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:18:52.075339 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 26 07:18:52.075339 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jul 26 07:18:52.075339 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-140b00f9-b70d-4b66-8dff-ac97b5a57270 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:18:52.076661 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-140b00f9-b70d-4b66-8dff-ac97b5a57270 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014968 Jul 26 07:18:52.076661 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 21/42] 10.222.0.39 () {60 vars in 1190 bytes} [Tue Jul 26 07:18:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 07:18:53.067662 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-56d8cad7-5fa4-4488-ac47-61edbdd00082 admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:18:53.068675 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-56d8cad7-5fa4-4488-ac47-61edbdd00082 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jul 26 07:18:53.069075 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 22/43] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Jul 26 07:18:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:18:53.630378 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-da8fa17d-663d-4c7f-b5c7-9a2c607b4c55 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:18:53.635954 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.wsgi [None req-da8fa17d-663d-4c7f-b5c7-9a2c607b4c55 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 26 07:18:53.637491 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-da8fa17d-663d-4c7f-b5c7-9a2c607b4c55 admin admin] Request method failure captured: Jul 26 07:18:53.637491 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 26 07:18:53.637491 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: Accept: application/json Jul 26 07:18:53.637491 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: Accept-Encoding: gzip, deflate Jul 26 07:18:53.637491 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: Connection: keep-alive Jul 26 07:18:53.637491 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: Content-Length: 0 Jul 26 07:18:53.637491 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: Host: 10.222.0.39 Jul 26 07:18:53.637491 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: Openstack-Api-Version: compute 2.90 Jul 26 07:18:53.637491 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: Openstack-System-Scope: None Jul 26 07:18:53.637491 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: User-Agent: python-novaclient Jul 26 07:18:53.637491 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Auth-Token: gAAAAABi35Vc2ci6HX1031xNsYDigQmMMrORylt_NquZv05iYEsa11lvEy9s_c2cRxA_vo4FWzdXusKFQBvtmNAAVga2UvV6rjwjh7AJrSKzrlR90QsUmQQSGeq6QgcU9sCSAQ1sCC1Zry1KcAbuFWI5U4i0YGvn71yfojNZd1Z2yAXfxzKU-2g Jul 26 07:18:53.637491 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Domain-Id: None Jul 26 07:18:53.637491 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Domain-Name: None Jul 26 07:18:53.637491 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Identity-Status: Confirmed Jul 26 07:18:53.637491 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Is-Admin-Project: True Jul 26 07:18:53.637491 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 07:18:53.637491 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Project-Domain-Id: default Jul 26 07:18:53.637491 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Project-Domain-Name: Default Jul 26 07:18:53.637491 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Project-Id: 9aaf3bcccded4ffcb2a432d5c86ce8ea Jul 26 07:18:53.637491 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Project-Name: admin Jul 26 07:18:53.637491 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Role: admin,member,reader Jul 26 07:18:53.637491 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Roles: admin,member,reader Jul 26 07:18:53.638981 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9aaf3bcccded4ffcb2a432d5c86ce8ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9aaf3bcccded4ffcb2a432d5c86ce8ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9aaf3bcccded4ffcb2a432d5c86ce8ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9aaf3bcccded4ffcb2a432d5c86ce8ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:18:53.638981 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Tenant: admin Jul 26 07:18:53.638981 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Tenant-Id: 9aaf3bcccded4ffcb2a432d5c86ce8ea Jul 26 07:18:53.638981 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Tenant-Name: admin Jul 26 07:18:53.638981 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-User: admin Jul 26 07:18:53.638981 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-User-Domain-Id: default Jul 26 07:18:53.638981 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-User-Domain-Name: Default Jul 26 07:18:53.638981 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-User-Id: 9e725435b0294296a28451de9a0d08c4 Jul 26 07:18:53.638981 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-User-Name: admin Jul 26 07:18:53.638981 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: method: > Jul 26 07:18:53.638981 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: exception: Flavor 84 could not be found. Jul 26 07:18:53.638981 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: action_args: {'id': '84'} Jul 26 07:18:53.638981 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:18:53.638981 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:18:53.639947 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 07:18:53.639947 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 07:18:53.639947 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 07:18:53.639947 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 07:18:53.639947 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 07:18:53.639947 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 07:18:53.639947 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 07:18:53.639947 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 07:18:53.639947 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 07:18:53.639947 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:18:53.639947 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 07:18:53.639947 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 07:18:53.639947 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 26 07:18:53.639947 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jul 26 07:18:53.639947 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:18:53.639947 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jul 26 07:18:53.639947 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:18:53.639947 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:18:53.639947 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:18:53.640974 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:18:53.640974 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:18:53.640974 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:18:53.640974 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:18:53.640974 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 07:18:53.640974 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:18:53.640974 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 26 07:18:53.640974 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jul 26 07:18:53.640974 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:18:53.640974 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jul 26 07:18:53.640974 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:18:53.640974 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:18:53.640974 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:18:53.640974 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:18:53.640974 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:18:53.640974 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 26 07:18:53.640974 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jul 26 07:18:53.640974 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-da8fa17d-663d-4c7f-b5c7-9a2c607b4c55 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:18:53.642029 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-da8fa17d-663d-4c7f-b5c7-9a2c607b4c55 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.431711 Jul 26 07:18:53.642029 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 22/44] 10.222.0.39 () {60 vars in 1190 bytes} [Tue Jul 26 07:18:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 433 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 07:18:53.649189 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-777c7a8f-0811-402d-821e-48b01b93e66b admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:18:53.666824 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-777c7a8f-0811-402d-821e-48b01b93e66b admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021199 Jul 26 07:18:53.667430 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 23/45] 10.222.0.39 () {60 vars in 1210 bytes} [Tue Jul 26 07:18:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:18:53.678182 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-cab94d0f-6798-4add-a3fd-91352cf9cb62 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:18:53.696097 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-cab94d0f-6798-4add-a3fd-91352cf9cb62 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022128 Jul 26 07:18:53.696662 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 23/46] 10.222.0.39 () {60 vars in 1210 bytes} [Tue Jul 26 07:18:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:18:53.706485 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-ee2b5933-122e-4b2c-92fe-7aa8811c4540 admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:18:53.712095 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.wsgi [None req-ee2b5933-122e-4b2c-92fe-7aa8811c4540 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 26 07:18:53.713657 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-ee2b5933-122e-4b2c-92fe-7aa8811c4540 admin admin] Request method failure captured: Jul 26 07:18:53.713657 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 26 07:18:53.713657 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: Accept: application/json Jul 26 07:18:53.713657 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: Accept-Encoding: gzip, deflate Jul 26 07:18:53.713657 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: Connection: keep-alive Jul 26 07:18:53.713657 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: Content-Length: 0 Jul 26 07:18:53.713657 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: Host: 10.222.0.39 Jul 26 07:18:53.713657 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: Openstack-Api-Version: compute 2.90 Jul 26 07:18:53.713657 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: Openstack-System-Scope: None Jul 26 07:18:53.713657 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: User-Agent: python-novaclient Jul 26 07:18:53.713657 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Auth-Token: gAAAAABi35Vc2ci6HX1031xNsYDigQmMMrORylt_NquZv05iYEsa11lvEy9s_c2cRxA_vo4FWzdXusKFQBvtmNAAVga2UvV6rjwjh7AJrSKzrlR90QsUmQQSGeq6QgcU9sCSAQ1sCC1Zry1KcAbuFWI5U4i0YGvn71yfojNZd1Z2yAXfxzKU-2g Jul 26 07:18:53.713657 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Domain-Id: None Jul 26 07:18:53.713657 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Domain-Name: None Jul 26 07:18:53.713657 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Identity-Status: Confirmed Jul 26 07:18:53.713657 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Is-Admin-Project: True Jul 26 07:18:53.713657 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 07:18:53.713657 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Project-Domain-Id: default Jul 26 07:18:53.713657 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Project-Domain-Name: Default Jul 26 07:18:53.713657 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Project-Id: 9aaf3bcccded4ffcb2a432d5c86ce8ea Jul 26 07:18:53.713657 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Project-Name: admin Jul 26 07:18:53.713657 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Role: admin,member,reader Jul 26 07:18:53.713657 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Roles: admin,member,reader Jul 26 07:18:53.715194 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9aaf3bcccded4ffcb2a432d5c86ce8ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9aaf3bcccded4ffcb2a432d5c86ce8ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9aaf3bcccded4ffcb2a432d5c86ce8ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9aaf3bcccded4ffcb2a432d5c86ce8ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:18:53.715194 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Tenant: admin Jul 26 07:18:53.715194 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Tenant-Id: 9aaf3bcccded4ffcb2a432d5c86ce8ea Jul 26 07:18:53.715194 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Tenant-Name: admin Jul 26 07:18:53.715194 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-User: admin Jul 26 07:18:53.715194 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-User-Domain-Id: default Jul 26 07:18:53.715194 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-User-Domain-Name: Default Jul 26 07:18:53.715194 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-User-Id: 9e725435b0294296a28451de9a0d08c4 Jul 26 07:18:53.715194 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-User-Name: admin Jul 26 07:18:53.715194 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: method: > Jul 26 07:18:53.715194 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: exception: Flavor 84 could not be found. Jul 26 07:18:53.715194 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: action_args: {'id': '84'} Jul 26 07:18:53.715194 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:18:53.715194 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:18:53.716255 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 07:18:53.716255 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 07:18:53.716255 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 07:18:53.716255 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 07:18:53.716255 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 07:18:53.716255 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 07:18:53.716255 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 07:18:53.716255 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 07:18:53.716255 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 07:18:53.716255 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:18:53.716255 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 07:18:53.716255 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 07:18:53.716255 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 26 07:18:53.716255 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Jul 26 07:18:53.716255 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:18:53.716255 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Jul 26 07:18:53.716255 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:18:53.716255 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:18:53.716255 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:18:53.717654 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:18:53.717654 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:18:53.717654 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:18:53.717654 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:18:53.717654 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 07:18:53.717654 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:18:53.717654 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 26 07:18:53.717654 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Jul 26 07:18:53.717654 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:18:53.717654 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Jul 26 07:18:53.717654 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:18:53.717654 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:18:53.717654 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:18:53.717654 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:18:53.717654 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:18:53.717654 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 26 07:18:53.717654 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Jul 26 07:18:53.717654 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-ee2b5933-122e-4b2c-92fe-7aa8811c4540 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:18:53.718739 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-ee2b5933-122e-4b2c-92fe-7aa8811c4540 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012333 Jul 26 07:18:53.718739 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 24/47] 10.222.0.39 () {60 vars in 1190 bytes} [Tue Jul 26 07:18:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 07:18:54.726533 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-cab94d0f-6798-4add-a3fd-91352cf9cb62 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:18:54.727892 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-cab94d0f-6798-4add-a3fd-91352cf9cb62 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001899 Jul 26 07:18:54.728398 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 24/48] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Jul 26 07:18:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:18:55.287327 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-3c902a5c-0f54-4f16-a376-3b00cb47efd4 admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:18:55.293141 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.wsgi [None req-3c902a5c-0f54-4f16-a376-3b00cb47efd4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 26 07:18:55.294659 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-3c902a5c-0f54-4f16-a376-3b00cb47efd4 admin admin] Request method failure captured: Jul 26 07:18:55.294659 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 26 07:18:55.294659 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: Accept: application/json Jul 26 07:18:55.294659 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: Accept-Encoding: gzip, deflate Jul 26 07:18:55.294659 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: Connection: keep-alive Jul 26 07:18:55.294659 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: Content-Length: 0 Jul 26 07:18:55.294659 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: Host: 10.222.0.39 Jul 26 07:18:55.294659 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: Openstack-Api-Version: compute 2.90 Jul 26 07:18:55.294659 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: Openstack-System-Scope: None Jul 26 07:18:55.294659 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: User-Agent: python-novaclient Jul 26 07:18:55.294659 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Auth-Token: gAAAAABi35VeTJNg_faYhenn0Z2G023cq9rtRgzVuw-6clT1Wc_fZrdjbdH5zixpDO52aK3MdCTfuWZTxhyvN6lu1fMOarJ0V5ckrSh4myF_A1F7H73gyMHl453R5Cnm4HhfrGoc8RIWk7uJvBoX77mIuhja1Q0gQTSPE17v0KhdbjIeOJj11XY Jul 26 07:18:55.294659 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Domain-Id: None Jul 26 07:18:55.294659 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Domain-Name: None Jul 26 07:18:55.294659 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Identity-Status: Confirmed Jul 26 07:18:55.294659 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Is-Admin-Project: True Jul 26 07:18:55.294659 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 07:18:55.294659 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Project-Domain-Id: default Jul 26 07:18:55.294659 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Project-Domain-Name: Default Jul 26 07:18:55.294659 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Project-Id: 9aaf3bcccded4ffcb2a432d5c86ce8ea Jul 26 07:18:55.294659 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Project-Name: admin Jul 26 07:18:55.294659 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Role: admin,member,reader Jul 26 07:18:55.294659 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Roles: admin,member,reader Jul 26 07:18:55.296126 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9aaf3bcccded4ffcb2a432d5c86ce8ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9aaf3bcccded4ffcb2a432d5c86ce8ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9aaf3bcccded4ffcb2a432d5c86ce8ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9aaf3bcccded4ffcb2a432d5c86ce8ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:18:55.296126 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Tenant: admin Jul 26 07:18:55.296126 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Tenant-Id: 9aaf3bcccded4ffcb2a432d5c86ce8ea Jul 26 07:18:55.296126 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-Tenant-Name: admin Jul 26 07:18:55.296126 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-User: admin Jul 26 07:18:55.296126 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-User-Domain-Id: default Jul 26 07:18:55.296126 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-User-Domain-Name: Default Jul 26 07:18:55.296126 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-User-Id: 9e725435b0294296a28451de9a0d08c4 Jul 26 07:18:55.296126 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: X-User-Name: admin Jul 26 07:18:55.296126 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: method: > Jul 26 07:18:55.296126 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: exception: Flavor 451 could not be found. Jul 26 07:18:55.296126 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: action_args: {'id': '451'} Jul 26 07:18:55.296126 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:18:55.296126 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:18:55.296939 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 07:18:55.296939 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 07:18:55.296939 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 07:18:55.296939 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 07:18:55.296939 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 07:18:55.296939 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 07:18:55.296939 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 07:18:55.296939 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 07:18:55.296939 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 07:18:55.296939 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:18:55.296939 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 07:18:55.296939 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 07:18:55.296939 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 26 07:18:55.296939 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Jul 26 07:18:55.296939 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:18:55.296939 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Jul 26 07:18:55.296939 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:18:55.296939 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:18:55.296939 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:18:55.298043 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:18:55.298043 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:18:55.298043 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:18:55.298043 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:18:55.298043 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 07:18:55.298043 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:18:55.298043 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 26 07:18:55.298043 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Jul 26 07:18:55.298043 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:18:55.298043 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Jul 26 07:18:55.298043 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:18:55.298043 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:18:55.298043 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:18:55.298043 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:18:55.298043 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:18:55.298043 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 26 07:18:55.298043 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Jul 26 07:18:55.298043 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-3c902a5c-0f54-4f16-a376-3b00cb47efd4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:18:55.299186 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-3c902a5c-0f54-4f16-a376-3b00cb47efd4 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.429448 Jul 26 07:18:55.299186 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 25/49] 10.222.0.39 () {60 vars in 1193 bytes} [Tue Jul 26 07:18:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 431 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 07:18:55.306183 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-b634268f-df3f-4c01-8b76-17079310e79d admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:18:55.321136 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-b634268f-df3f-4c01-8b76-17079310e79d admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018602 Jul 26 07:18:55.321704 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 25/50] 10.222.0.39 () {60 vars in 1210 bytes} [Tue Jul 26 07:18:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:18:55.331736 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-9b6cb971-7337-462d-87a9-92059f9bcb90 admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:18:55.346853 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-9b6cb971-7337-462d-87a9-92059f9bcb90 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018787 Jul 26 07:18:55.347410 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 26/51] 10.222.0.39 () {60 vars in 1210 bytes} [Tue Jul 26 07:18:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:18:55.356942 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-c0b5189f-b2c7-4465-b95a-da6c365bb540 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:18:55.363050 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.wsgi [None req-c0b5189f-b2c7-4465-b95a-da6c365bb540 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 26 07:18:55.364595 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-c0b5189f-b2c7-4465-b95a-da6c365bb540 admin admin] Request method failure captured: Jul 26 07:18:55.364595 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 26 07:18:55.364595 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: Accept: application/json Jul 26 07:18:55.364595 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: Accept-Encoding: gzip, deflate Jul 26 07:18:55.364595 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: Connection: keep-alive Jul 26 07:18:55.364595 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: Content-Length: 0 Jul 26 07:18:55.364595 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: Host: 10.222.0.39 Jul 26 07:18:55.364595 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: Openstack-Api-Version: compute 2.90 Jul 26 07:18:55.364595 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: Openstack-System-Scope: None Jul 26 07:18:55.364595 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: User-Agent: python-novaclient Jul 26 07:18:55.364595 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Auth-Token: gAAAAABi35VeTJNg_faYhenn0Z2G023cq9rtRgzVuw-6clT1Wc_fZrdjbdH5zixpDO52aK3MdCTfuWZTxhyvN6lu1fMOarJ0V5ckrSh4myF_A1F7H73gyMHl453R5Cnm4HhfrGoc8RIWk7uJvBoX77mIuhja1Q0gQTSPE17v0KhdbjIeOJj11XY Jul 26 07:18:55.364595 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Domain-Id: None Jul 26 07:18:55.364595 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Domain-Name: None Jul 26 07:18:55.364595 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Identity-Status: Confirmed Jul 26 07:18:55.364595 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Is-Admin-Project: True Jul 26 07:18:55.364595 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 07:18:55.364595 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Project-Domain-Id: default Jul 26 07:18:55.364595 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Project-Domain-Name: Default Jul 26 07:18:55.364595 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Project-Id: 9aaf3bcccded4ffcb2a432d5c86ce8ea Jul 26 07:18:55.364595 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Project-Name: admin Jul 26 07:18:55.364595 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Role: admin,member,reader Jul 26 07:18:55.364595 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Roles: admin,member,reader Jul 26 07:18:55.366182 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9aaf3bcccded4ffcb2a432d5c86ce8ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9aaf3bcccded4ffcb2a432d5c86ce8ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9aaf3bcccded4ffcb2a432d5c86ce8ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9aaf3bcccded4ffcb2a432d5c86ce8ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:18:55.366182 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Tenant: admin Jul 26 07:18:55.366182 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Tenant-Id: 9aaf3bcccded4ffcb2a432d5c86ce8ea Jul 26 07:18:55.366182 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-Tenant-Name: admin Jul 26 07:18:55.366182 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-User: admin Jul 26 07:18:55.366182 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-User-Domain-Id: default Jul 26 07:18:55.366182 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-User-Domain-Name: Default Jul 26 07:18:55.366182 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-User-Id: 9e725435b0294296a28451de9a0d08c4 Jul 26 07:18:55.366182 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: X-User-Name: admin Jul 26 07:18:55.366182 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: method: > Jul 26 07:18:55.366182 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: exception: Flavor 451 could not be found. Jul 26 07:18:55.366182 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: action_args: {'id': '451'} Jul 26 07:18:55.366182 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:18:55.366182 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:18:55.367112 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 07:18:55.367112 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 07:18:55.367112 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 07:18:55.367112 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 07:18:55.367112 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 07:18:55.367112 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 07:18:55.367112 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 07:18:55.367112 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 07:18:55.367112 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 07:18:55.367112 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:18:55.367112 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 07:18:55.367112 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 07:18:55.367112 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 26 07:18:55.367112 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jul 26 07:18:55.367112 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:18:55.367112 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jul 26 07:18:55.367112 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:18:55.367112 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:18:55.367112 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:18:55.368346 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:18:55.368346 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:18:55.368346 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:18:55.368346 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:18:55.368346 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 07:18:55.368346 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:18:55.368346 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 26 07:18:55.368346 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jul 26 07:18:55.368346 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:18:55.368346 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jul 26 07:18:55.368346 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:18:55.368346 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:18:55.368346 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:18:55.368346 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:18:55.368346 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:18:55.368346 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 26 07:18:55.368346 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jul 26 07:18:55.368346 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-c0b5189f-b2c7-4465-b95a-da6c365bb540 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:18:55.369604 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-c0b5189f-b2c7-4465-b95a-da6c365bb540 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012640 Jul 26 07:18:55.369604 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 26/52] 10.222.0.39 () {60 vars in 1193 bytes} [Tue Jul 26 07:18:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 07:18:56.331932 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-9b6cb971-7337-462d-87a9-92059f9bcb90 admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:18:56.332852 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-9b6cb971-7337-462d-87a9-92059f9bcb90 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 26 07:18:56.333246 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 27/53] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Jul 26 07:18:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:18:56.897384 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-77ffdccd-7920-4067-b7bc-ea39967bcadd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:18:56.917703 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-77ffdccd-7920-4067-b7bc-ea39967bcadd admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.448292 Jul 26 07:18:56.918481 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 27/54] 10.222.0.39 () {64 vars in 1235 bytes} [Tue Jul 26 07:18:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:18:57.911605 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-9b6cb971-7337-462d-87a9-92059f9bcb90 admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:18:57.912872 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-9b6cb971-7337-462d-87a9-92059f9bcb90 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001919 Jul 26 07:18:57.913386 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 28/55] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Jul 26 07:18:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:18:58.474747 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-969ebb47-7c60-450b-8c65-20302bbb8bad admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:18:58.496450 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-969ebb47-7c60-450b-8c65-20302bbb8bad admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.445020 Jul 26 07:18:58.497003 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 28/56] 10.222.0.39 () {64 vars in 1235 bytes} [Tue Jul 26 07:18:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:18:59.478909 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-9b6cb971-7337-462d-87a9-92059f9bcb90 admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:18:59.479928 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-9b6cb971-7337-462d-87a9-92059f9bcb90 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jul 26 07:18:59.480351 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 29/57] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Jul 26 07:18:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:19:00.060493 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-a105db03-e2c2-4409-a450-b99499317d26 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:19:00.081057 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-a105db03-e2c2-4409-a450-b99499317d26 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.464252 Jul 26 07:19:00.081621 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 29/58] 10.222.0.39 () {64 vars in 1235 bytes} [Tue Jul 26 07:18:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:19:01.105154 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-9b6cb971-7337-462d-87a9-92059f9bcb90 admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:19:01.106996 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-9b6cb971-7337-462d-87a9-92059f9bcb90 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002513 Jul 26 07:19:01.107747 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 30/59] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Jul 26 07:19:01 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:19:01.739586 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-d8d4cfd5-73fa-448f-aff2-1fbd6e7c5c5b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:19:01.759601 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-d8d4cfd5-73fa-448f-aff2-1fbd6e7c5c5b admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.448525 Jul 26 07:19:01.760161 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 30/60] 10.222.0.39 () {64 vars in 1235 bytes} [Tue Jul 26 07:19:01 2022] POST /compute/v2.1/flavors => generated 409 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:19:02.785439 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-9b6cb971-7337-462d-87a9-92059f9bcb90 admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:19:02.786613 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-9b6cb971-7337-462d-87a9-92059f9bcb90 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001563 Jul 26 07:19:02.787049 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 31/61] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Jul 26 07:19:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:19:03.330719 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-5c07411e-6eff-4bda-93ee-4caa36b6dd62 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:19:03.352360 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-5c07411e-6eff-4bda-93ee-4caa36b6dd62 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.427394 Jul 26 07:19:03.352823 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 31/62] 10.222.0.39 () {60 vars in 1202 bytes} [Tue Jul 26 07:19:02 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:19:56.316562 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-9b6cb971-7337-462d-87a9-92059f9bcb90 admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:19:56.317496 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-9b6cb971-7337-462d-87a9-92059f9bcb90 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jul 26 07:19:56.317931 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 32/63] 10.222.0.39 () {54 vars in 930 bytes} [Tue Jul 26 07:19:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:19:56.329647 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG dbcounter [-] [103177] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=103177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:19:56.917705 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-e1385bc4-a76c-4d78-8861-9245cd99aad6 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:19:56.939245 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-e1385bc4-a76c-4d78-8861-9245cd99aad6 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.614177 Jul 26 07:19:56.939839 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 32/64] 10.222.0.39 () {60 vars in 1291 bytes} [Tue Jul 26 07:19:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:19:56.960814 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG dbcounter [-] [103176] Writing DB stats nova_api:SELECT=14 {{(pid=103176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:19:56.964731 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-0c500792-35ec-43eb-8c5c-f57b60589d70 admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:19:56.973238 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-0c500792-35ec-43eb-8c5c-f57b60589d70 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013927 Jul 26 07:19:56.973902 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 33/65] 10.222.0.39 () {60 vars in 1282 bytes} [Tue Jul 26 07:19:56 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:19:56.986752 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-4e705e1f-cf7d-45a5-8373-78c34739b5ec admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:19:56.995023 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-4e705e1f-cf7d-45a5-8373-78c34739b5ec admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012115 Jul 26 07:19:56.995603 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 33/66] 10.222.0.39 () {60 vars in 1285 bytes} [Tue Jul 26 07:19:56 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:19:57.007852 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-51dda5c7-72c5-4f36-a6cd-d49983855fe9 admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:19:57.016498 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-51dda5c7-72c5-4f36-a6cd-d49983855fe9 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012209 Jul 26 07:19:57.017080 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 34/67] 10.222.0.39 () {60 vars in 1285 bytes} [Tue Jul 26 07:19:57 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:19:57.030268 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-c8a5451a-64f8-4240-bfee-751f16a03a23 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:19:57.039164 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-c8a5451a-64f8-4240-bfee-751f16a03a23 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012555 Jul 26 07:19:57.039720 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 34/68] 10.222.0.39 () {60 vars in 1282 bytes} [Tue Jul 26 07:19:57 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:23:24.334852 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-51dda5c7-72c5-4f36-a6cd-d49983855fe9 admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:23:24.335916 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-51dda5c7-72c5-4f36-a6cd-d49983855fe9 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jul 26 07:23:24.336345 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 35/69] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Jul 26 07:23:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:23:24.476449 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG dbcounter [-] [103177] Writing DB stats nova_api:SELECT=6 {{(pid=103177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:23:24.648545 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-9e8a4467-5cf1-4f3c-8ac4-42dd8aafcd62 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:23:24.650925 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 07:23:24.650925 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: warnings.warn(msg) Jul 26 07:23:24.652146 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG oslo_concurrency.lockutils [None req-9e8a4467-5cf1-4f3c-8ac4-42dd8aafcd62 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:23:24.652621 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG oslo_concurrency.lockutils [None req-9e8a4467-5cf1-4f3c-8ac4-42dd8aafcd62 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:23:24.653406 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG oslo_concurrency.lockutils [None req-9e8a4467-5cf1-4f3c-8ac4-42dd8aafcd62 admin admin] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:23:24.653929 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG oslo_concurrency.lockutils [None req-9e8a4467-5cf1-4f3c-8ac4-42dd8aafcd62 admin admin] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:23:24.688332 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-9e8a4467-5cf1-4f3c-8ac4-42dd8aafcd62 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.213265 Jul 26 07:23:24.688912 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 35/70] 10.222.0.39 () {60 vars in 1193 bytes} [Tue Jul 26 07:23:24 2022] GET /compute/v2.1/os-services => generated 791 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:23:25.520581 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-51dda5c7-72c5-4f36-a6cd-d49983855fe9 admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:23:25.521636 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-51dda5c7-72c5-4f36-a6cd-d49983855fe9 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jul 26 07:23:25.522086 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 36/71] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Jul 26 07:23:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 07:23:25.714575 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-ea7660ec-fbeb-409a-a38e-1f71d1a9c9c1 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:23:25.717052 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 07:23:25.717052 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: warnings.warn(msg) Jul 26 07:23:25.718287 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG oslo_concurrency.lockutils [None req-ea7660ec-fbeb-409a-a38e-1f71d1a9c9c1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:23:25.718730 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG oslo_concurrency.lockutils [None req-ea7660ec-fbeb-409a-a38e-1f71d1a9c9c1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:23:25.719551 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG oslo_concurrency.lockutils [None req-ea7660ec-fbeb-409a-a38e-1f71d1a9c9c1 admin admin] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:23:25.719992 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG oslo_concurrency.lockutils [None req-ea7660ec-fbeb-409a-a38e-1f71d1a9c9c1 admin admin] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:23:25.740027 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-ea7660ec-fbeb-409a-a38e-1f71d1a9c9c1 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078342 Jul 26 07:23:25.740498 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 36/72] 10.222.0.39 () {60 vars in 1193 bytes} [Tue Jul 26 07:23:25 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:23:36.992490 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-51dda5c7-72c5-4f36-a6cd-d49983855fe9 admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:23:36.993535 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-51dda5c7-72c5-4f36-a6cd-d49983855fe9 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001594 Jul 26 07:23:36.994007 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 37/73] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Jul 26 07:23:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:23:37.137764 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG dbcounter [-] [103177] Writing DB stats nova_cell0:SELECT=4 {{(pid=103177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:23:37.138426 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG dbcounter [-] [103177] Writing DB stats nova_cell1:SELECT=4 {{(pid=103177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:23:37.139122 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG dbcounter [-] [103177] Writing DB stats nova_api:SELECT=8 {{(pid=103177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:23:37.190762 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-689eaade-fb0b-44d0-a63a-a7647a091e3b admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:23:37.193191 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 07:23:37.193191 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: warnings.warn(msg) Jul 26 07:23:37.194691 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG oslo_concurrency.lockutils [None req-689eaade-fb0b-44d0-a63a-a7647a091e3b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:23:37.195157 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG oslo_concurrency.lockutils [None req-689eaade-fb0b-44d0-a63a-a7647a091e3b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:23:37.196039 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG oslo_concurrency.lockutils [None req-689eaade-fb0b-44d0-a63a-a7647a091e3b admin admin] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:23:37.196472 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG oslo_concurrency.lockutils [None req-689eaade-fb0b-44d0-a63a-a7647a091e3b admin admin] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:23:37.222307 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-689eaade-fb0b-44d0-a63a-a7647a091e3b admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.088789 Jul 26 07:23:37.222853 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 37/74] 10.222.0.39 () {60 vars in 1193 bytes} [Tue Jul 26 07:23:37 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:23:38.043660 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-51dda5c7-72c5-4f36-a6cd-d49983855fe9 admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:23:38.044667 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-51dda5c7-72c5-4f36-a6cd-d49983855fe9 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jul 26 07:23:38.045063 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 38/75] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Jul 26 07:23:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:23:38.238036 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-0a300746-4ab0-4440-b81e-00f94bc38faa admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:23:38.240466 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 07:23:38.240466 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: warnings.warn(msg) Jul 26 07:23:38.241658 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG oslo_concurrency.lockutils [None req-0a300746-4ab0-4440-b81e-00f94bc38faa admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:23:38.242122 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG oslo_concurrency.lockutils [None req-0a300746-4ab0-4440-b81e-00f94bc38faa admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:23:38.242900 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG oslo_concurrency.lockutils [None req-0a300746-4ab0-4440-b81e-00f94bc38faa admin admin] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:23:38.243317 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: DEBUG oslo_concurrency.lockutils [None req-0a300746-4ab0-4440-b81e-00f94bc38faa admin admin] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:23:38.264871 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-0a300746-4ab0-4440-b81e-00f94bc38faa admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081862 Jul 26 07:23:38.265418 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 38/76] 10.222.0.39 () {60 vars in 1193 bytes} [Tue Jul 26 07:23:38 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:24:34.108977 dv-cinder-850836-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 26 07:24:34.109599 dv-cinder-850836-1-iscsi devstack@n-api.service[103175]: Tue Jul 26 07:24:34 2022 - graceful shutdown triggered... Jul 26 07:24:34.110073 dv-cinder-850836-1-iscsi devstack@n-api.service[103176]: Gracefully killing worker 1 (pid: 103176)... Jul 26 07:24:34.110429 dv-cinder-850836-1-iscsi devstack@n-api.service[103177]: Gracefully killing worker 2 (pid: 103177)... Jul 26 07:24:35.110780 dv-cinder-850836-1-iscsi devstack@n-api.service[103175]: worker 1 buried after 1 seconds Jul 26 07:24:35.110780 dv-cinder-850836-1-iscsi devstack@n-api.service[103175]: worker 2 buried after 1 seconds Jul 26 07:24:35.110780 dv-cinder-850836-1-iscsi devstack@n-api.service[103175]: goodbye to uWSGI. Jul 26 07:24:35.112491 dv-cinder-850836-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 26 07:24:35.113088 dv-cinder-850836-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 26 07:24:35.115994 dv-cinder-850836-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 26 07:24:35.126659 dv-cinder-850836-1-iscsi devstack@n-api.service[117698]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 26 07:24:35.129283 dv-cinder-850836-1-iscsi devstack@n-api.service[117698]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 26 07:24:35 2022] *** Jul 26 07:24:35.129436 dv-cinder-850836-1-iscsi devstack@n-api.service[117698]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 26 07:24:35.129567 dv-cinder-850836-1-iscsi devstack@n-api.service[117698]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 26 07:24:35.129679 dv-cinder-850836-1-iscsi devstack@n-api.service[117698]: nodename: dv-cinder-850836-1-iscsi Jul 26 07:24:35.129804 dv-cinder-850836-1-iscsi devstack@n-api.service[117698]: machine: x86_64 Jul 26 07:24:35.129916 dv-cinder-850836-1-iscsi devstack@n-api.service[117698]: clock source: unix Jul 26 07:24:35.130016 dv-cinder-850836-1-iscsi devstack@n-api.service[117698]: pcre jit disabled Jul 26 07:24:35.130182 dv-cinder-850836-1-iscsi devstack@n-api.service[117698]: detected number of CPU cores: 4 Jul 26 07:24:35.130182 dv-cinder-850836-1-iscsi devstack@n-api.service[117698]: current working directory: / Jul 26 07:24:35.130182 dv-cinder-850836-1-iscsi devstack@n-api.service[117698]: detected binary path: /usr/bin/uwsgi-core Jul 26 07:24:35.130182 dv-cinder-850836-1-iscsi devstack@n-api.service[117698]: your processes number limit is 47680 Jul 26 07:24:35.130182 dv-cinder-850836-1-iscsi devstack@n-api.service[117698]: your memory page size is 4096 bytes Jul 26 07:24:35.130182 dv-cinder-850836-1-iscsi devstack@n-api.service[117698]: detected max file descriptor number: 2048 Jul 26 07:24:35.130182 dv-cinder-850836-1-iscsi devstack@n-api.service[117698]: lock engine: pthread robust mutexes Jul 26 07:24:35.130666 dv-cinder-850836-1-iscsi devstack@n-api.service[117698]: thunder lock: enabled Jul 26 07:24:35.130666 dv-cinder-850836-1-iscsi devstack@n-api.service[117698]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 26 07:24:35.130666 dv-cinder-850836-1-iscsi devstack@n-api.service[117698]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 26 07:24:35.169900 dv-cinder-850836-1-iscsi devstack@n-api.service[117698]: Python main interpreter initialized at 0x5567881c49c0 Jul 26 07:24:35.169900 dv-cinder-850836-1-iscsi devstack@n-api.service[117698]: python threads support enabled Jul 26 07:24:35.169900 dv-cinder-850836-1-iscsi devstack@n-api.service[117698]: your server socket listen backlog is limited to 100 connections Jul 26 07:24:35.169900 dv-cinder-850836-1-iscsi devstack@n-api.service[117698]: your mercy for graceful operations on workers is 90 seconds Jul 26 07:24:35.170324 dv-cinder-850836-1-iscsi devstack@n-api.service[117698]: mapped 403077 bytes (393 KB) for 2 cores Jul 26 07:24:35.170324 dv-cinder-850836-1-iscsi devstack@n-api.service[117698]: *** Operational MODE: preforking *** Jul 26 07:24:35.170624 dv-cinder-850836-1-iscsi devstack@n-api.service[117698]: *** uWSGI is running in multiple interpreter mode *** Jul 26 07:24:35.170624 dv-cinder-850836-1-iscsi devstack@n-api.service[117698]: spawned uWSGI master process (pid: 117698) Jul 26 07:24:35.170833 dv-cinder-850836-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 26 07:24:35.172941 dv-cinder-850836-1-iscsi devstack@n-api.service[117698]: spawned uWSGI worker 1 (pid: 117715, cores: 1) Jul 26 07:24:35.172941 dv-cinder-850836-1-iscsi devstack@n-api.service[117698]: spawned uWSGI worker 2 (pid: 117716, cores: 1) Jul 26 07:24:35.172941 dv-cinder-850836-1-iscsi devstack@n-api.service[117698]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 26 07:24:35.834532 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 07:24:35.838099 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 07:24:36.967653 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 07:24:36.967653 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: from cryptography.utils import int_from_bytes Jul 26 07:24:36.968397 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 07:24:36.968397 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: from cryptography.utils import int_from_bytes Jul 26 07:24:36.968778 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 07:24:36.968778 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: from cryptography.utils import int_from_bytes Jul 26 07:24:36.968900 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 07:24:36.968900 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: from cryptography.utils import int_from_bytes Jul 26 07:24:39.445109 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 07:24:39.445645 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 07:24:39.445949 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 07:24:39.446317 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 07:24:39.446547 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 07:24:39.446946 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.447275 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.447624 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.447948 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.448283 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.448597 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.448920 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.449246 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.449561 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.449846 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.450170 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.450496 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850836-1-iscsi {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.450821 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.451283 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.451618 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.451942 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.452239 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.452610 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.452920 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.453449 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.454669 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 07:24:39.455118 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.455198 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 07:24:39.455277 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.455277 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.455456 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 07:24:39.455539 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.455611 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 07:24:39.455688 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.455765 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 07:24:39.455847 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.456140 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.456296 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.456467 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.456801 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.457065 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.457176 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.457518 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850836-1-iscsi {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.457849 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.457986 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.458193 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.458319 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.458474 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.458603 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.458791 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.459118 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.459441 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.459681 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.459799 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.459994 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.460107 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.460306 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.460425 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.460623 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850836-1-iscsi {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.460742 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.460940 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.461079 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.461274 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.461668 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.462029 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.462166 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.462332 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.462464 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.462661 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.462972 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.463260 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.463387 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.463596 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.463983 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.464111 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.464406 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.464712 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.464899 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.465018 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.465236 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.465352 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.465566 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.465665 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.465911 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.466021 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.466208 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.466313 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.466463 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.466588 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.466880 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.467190 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.467396 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.467586 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850836-1-iscsi {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.467716 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.468037 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.468172 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.468448 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.468707 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.468812 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.468962 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.469077 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.469478 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.469712 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.469860 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.470077 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.470177 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.470400 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.470938 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.471073 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.471190 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.471386 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.471500 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.471740 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.472058 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.472278 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.472434 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.472761 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.473027 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.473210 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.473392 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.473550 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.474067 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.474343 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.474605 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.474871 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.475117 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.475383 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.475628 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.475628 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.476116 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.476386 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.476562 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.476722 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.476875 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.477019 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.477185 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.477338 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.477493 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.477650 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.477910 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.478074 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.478240 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.478392 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.478549 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.478703 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.478857 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.479010 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.479169 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.479845 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.480020 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.480167 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.480319 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.480474 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.480631 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.480786 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.480937 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.481101 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.481245 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.481413 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.481573 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.481763 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.482024 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.482174 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.482336 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.482629 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.482889 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.483066 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.483315 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.483485 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.483665 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.483818 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.483970 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.483970 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.484388 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.484388 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.484388 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.484824 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.484986 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.485131 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.485274 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.485423 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.485591 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.485781 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.485938 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.486084 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.486227 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.486369 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.486538 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.487284 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.487440 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.487585 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.487728 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.487887 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.488049 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.488207 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.488366 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.488519 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.488670 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.488911 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.489066 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.489219 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.489392 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.489392 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.490104 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.490104 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.490406 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.490406 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.490723 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.490884 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.491036 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.491194 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.491360 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.491566 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.491733 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.491877 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.492039 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.492287 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.492444 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.492651 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.492941 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.493191 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.493442 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.493629 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.493818 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.493985 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.494145 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.494298 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.494449 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.494593 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.494784 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.494951 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.495113 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.495311 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.495480 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.495636 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.495788 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.495941 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.496101 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.496261 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.496415 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.496560 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.496710 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.496872 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.497024 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.497175 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.497345 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.497506 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.497658 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.497658 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.498099 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.498255 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.498255 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.498555 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.498705 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.498848 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.501993 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.501993 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.502488 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.502668 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.502668 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.503129 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.503396 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.503396 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.503832 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.503996 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.504141 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.504292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.504292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.504586 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.504731 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.504889 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.505065 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.505219 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.505369 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.505531 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.505684 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.505903 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.506049 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.506203 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.506357 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.506502 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.506651 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.506811 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.506976 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.507136 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.507298 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.507450 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.507603 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.507760 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.507921 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.508072 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.508232 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.508392 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.508543 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.508695 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.508847 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.509011 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.509166 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.509325 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.509485 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.509628 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.509790 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.509965 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.510111 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.510261 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:24:39.510416 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.510566 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.510711 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.510868 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.511043 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.511333 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.511510 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.511988 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.512174 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.512174 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.512738 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.512901 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.513055 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.513345 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.513616 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.513936 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.514126 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.514290 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.514443 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.514586 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.514738 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.514897 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.515086 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.516019 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.516181 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.516327 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.516472 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.516633 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.516786 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.516952 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.517097 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.517241 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.517241 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.517539 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.517692 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.517906 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.518058 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.518222 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.518374 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.518535 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.518693 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.518851 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.519023 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.519181 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.519332 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.519491 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.519651 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.519800 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.519966 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.520124 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.520284 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.521000 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.521173 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.521334 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.521497 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.521660 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.522250 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.522421 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.522573 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.522981 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.523140 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.523302 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.523469 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.523637 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.523899 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.524246 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.524246 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.524569 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.524569 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.524887 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.524887 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.525177 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.525327 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.525491 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.525649 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.525901 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.526075 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.526227 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.526384 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.526552 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.526715 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.526866 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.526866 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.527151 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.527308 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.527476 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.527627 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.527777 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.527939 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.528097 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.528247 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.528410 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.528561 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.528721 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.528878 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.529039 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.529204 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.529362 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.529523 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.529682 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.529868 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.530022 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.530181 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.530333 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.530494 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.530652 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.530889 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.531043 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.531209 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.531362 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.531520 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.531686 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.531845 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.532299 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.532474 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.532627 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.532786 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.533164 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.533359 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.533521 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.533681 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.533903 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.533903 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.534525 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.534685 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.534851 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.535013 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.535163 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.535321 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.535471 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.535629 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.535806 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.535966 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.536118 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.536276 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.536444 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.536603 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.536764 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.536916 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.537081 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.537243 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.537411 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.537578 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.537755 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.537943 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.538104 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.538261 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.538422 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.538588 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.538747 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.538898 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.539057 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.539206 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.539355 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.539514 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.539682 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.539833 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.540009 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.540843 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.541010 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.541178 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.541331 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.541490 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.541750 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.541941 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.542124 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.542669 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.542841 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.542994 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.543420 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.543579 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.543747 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.543906 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.544058 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.544340 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.544783 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.544948 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.545117 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.545269 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.545420 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.545578 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.545785 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.545955 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.546123 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.546274 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.546466 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.546627 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.546777 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.546934 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.547096 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.547246 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.547405 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.547563 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.547720 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.547889 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.548066 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.548225 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.548383 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.548541 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.548693 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.549897 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.549897 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.550220 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.550373 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.551076 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.551247 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.551553 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.551740 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.551916 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.552069 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.552226 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.552401 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.552860 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.553029 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.553191 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.553458 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.553623 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.553814 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.554015 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.554277 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.554556 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.554811 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.555077 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.555255 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.555416 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.555567 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.555717 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.555866 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.556063 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.556226 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.556398 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.556558 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.556710 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.556876 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.557034 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.557194 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.557354 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.557513 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.557664 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.557861 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.558108 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.558262 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.558421 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.558421 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.558713 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.558871 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.559057 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.559210 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.559368 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.559535 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.559686 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.559835 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.559993 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.560152 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.560309 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.560477 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.560636 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.560786 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.560950 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.561111 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.561269 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.561429 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.561589 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.561765 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.561963 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.562156 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.562316 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.562467 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.562628 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.563048 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.563207 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.563366 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.563366 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.563772 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.563931 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.564092 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.564243 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.564537 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.564787 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.565038 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.565038 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.565472 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.565625 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.565868 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.566034 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.566197 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.566355 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.566516 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.566516 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.566803 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.566953 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.567102 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.567102 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.567407 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.567407 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.567700 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.567861 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.568022 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.568186 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.568337 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.568485 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.568635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.568635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.568920 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.569079 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.569229 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.569395 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.569546 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.569703 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.569888 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.570061 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.570240 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.570537 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.570718 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.570879 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.571054 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.571214 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.571372 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.571523 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.571673 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.571823 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.571989 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.572148 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.572315 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.572473 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.572633 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.572785 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.573216 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.573385 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.573545 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.573861 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.574030 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.574191 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.574191 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.574519 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.574793 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.575070 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.575343 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.575624 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.575782 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.575941 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.576098 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.576251 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.576410 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.576571 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.576722 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.576879 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.577030 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.577202 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.577361 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.577361 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.577732 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.577910 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.578060 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.578213 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.578372 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.578534 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.578687 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.578930 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.578930 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.579236 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.579409 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.579591 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.579745 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.579902 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.580060 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.580388 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.580558 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.580718 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.580869 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.581036 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.581198 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.581350 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.581509 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.581676 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.581865 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.582034 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.582186 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.582336 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.582503 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.582655 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.582814 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.582974 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.583416 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.583585 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.583735 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.583948 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.584115 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.584355 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.584519 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.584679 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.584679 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.585216 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.585478 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.585663 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.585858 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.586010 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.586161 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.586318 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.586497 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.586660 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.586812 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.586962 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.587113 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.587263 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.587428 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.587588 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.587749 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.587908 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.588060 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.588222 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.588382 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.588553 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.588714 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.588886 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.589046 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.589206 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.589206 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.589495 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.589644 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.589843 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.590006 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.590165 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.590326 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.590585 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.590762 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.590937 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.591097 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.591248 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.591398 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.591556 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.591714 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.591882 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.592041 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.592193 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.592351 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.592502 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.592672 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.592832 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.593000 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.593152 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.593644 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.593832 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.594006 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.594160 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.594318 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.594471 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.594630 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.594791 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.594978 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.595270 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.595887 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.596134 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.596297 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.596458 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.596624 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.596782 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.596942 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.597096 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.597255 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.597422 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.597582 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.597782 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.598094 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.598285 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.598285 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.598605 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.598605 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.598605 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.598605 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.598605 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.599320 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.599492 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.599644 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.599801 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.599960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.600130 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.600293 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.600444 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.600619 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.600848 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.601005 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.601155 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.601322 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.601474 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.601474 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.601838 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.602008 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.602171 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.602171 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.602477 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.602627 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.602786 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.602951 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.603102 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.603262 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.603422 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.603839 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.604006 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.604158 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.604317 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.604495 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.604655 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.604807 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.604974 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.605133 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.605416 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.605676 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.605917 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.606079 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.606335 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.606492 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.606663 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.606817 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.606979 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.607137 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.607296 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.607296 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.607603 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.607764 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.607925 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.608091 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.608293 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.608449 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.608615 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.608784 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.608968 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.609140 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.609314 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.609476 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.609636 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.609636 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.609967 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.610126 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.610285 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.610452 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.610604 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.610763 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.611028 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.611187 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.611349 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.611626 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.611793 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.611946 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.612104 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.612262 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.612423 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.612581 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.612732 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.612883 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.613041 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.613193 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.613371 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.613371 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.613695 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.614096 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.614261 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.614415 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.614706 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.614877 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.615041 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.615207 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.615358 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.615852 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.616102 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.616277 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.616584 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.616752 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.616912 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.617072 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.617234 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.617393 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.617554 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.617714 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.617955 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.618119 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.618289 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.618449 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.618620 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.618772 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.618953 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.619135 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.619353 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.619515 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.619667 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.619967 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.620119 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.620288 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.620448 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.620600 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.620751 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.620913 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.621171 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.621340 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.621492 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.621492 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.621805 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.621962 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.622126 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.622280 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.622431 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.622597 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.622756 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.622916 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.623088 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.623248 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.623408 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.623568 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.623725 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.623905 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.624338 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.624559 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.624717 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.624878 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.625045 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.625208 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.625390 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.625560 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.625712 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.626108 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.626285 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.626454 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.626722 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.626889 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.627042 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.627203 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.627363 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.627526 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.627679 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.627679 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.627986 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.627986 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.628283 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.628449 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.628611 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.628763 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.628913 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.629063 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.629220 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.629382 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.629534 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.629694 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.629881 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.630033 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.630201 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.630363 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.630521 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.630521 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.630820 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.630979 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.631159 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.631418 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.631575 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.631743 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.631907 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.632059 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.632220 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.632372 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.632530 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.632688 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.632841 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.632841 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.633157 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.633326 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.633478 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.633629 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.633799 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.633985 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.634512 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.634732 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.634732 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.635036 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.635188 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.635362 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.635522 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.635676 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.635834 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.636014 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.636438 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.637396 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.637576 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.637576 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.637960 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.638122 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.638285 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.638285 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.638591 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.638751 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.638903 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.639053 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.639211 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.639387 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.639547 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.639784 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.639951 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.640164 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.640347 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.640509 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.640662 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.640829 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.640981 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.641141 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.641293 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.641580 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.641843 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.642014 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.642167 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.642330 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.642491 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.642491 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.642909 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.643091 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.643245 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.643245 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.643542 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.643703 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.643868 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.644027 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.644281 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.644830 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.645009 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.645173 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.645356 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.645356 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.645698 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.645987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.646158 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.646459 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.646757 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.646960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.647122 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.647294 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.647572 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.647739 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.647891 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.648043 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.648207 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.648458 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.648709 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.648960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.649211 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.649400 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.649568 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.649731 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.650023 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.650205 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.650358 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.650509 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.650668 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.650846 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.651005 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.651382 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.651382 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.651828 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.651995 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.652175 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.652328 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.652479 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.652638 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.652790 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.652950 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.653119 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.653272 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.653438 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.653590 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.653805 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.653977 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.654143 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.654309 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.654470 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.654983 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.655153 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.655153 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.655454 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.655454 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.655790 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.655954 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.656110 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.656271 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.656460 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.656753 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.657054 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.657218 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.657382 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.657382 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.657814 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.657814 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.658126 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.658285 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.658446 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.658605 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.658766 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.658917 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.659088 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.659238 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.659398 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.659550 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.659700 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.659850 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.660009 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.660178 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.660339 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.660491 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.660649 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.660809 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.660961 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.661133 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.661300 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.661452 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.661611 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.661788 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.661788 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.662202 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.662202 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.662499 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.662499 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.662785 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.662943 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.663118 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.663279 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.663429 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.663579 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.663729 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.663880 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.664092 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.664250 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.664401 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.667804 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.667939 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.668039 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.668115 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.668195 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.668267 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.668336 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.668411 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.668496 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.668574 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.668574 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.668717 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.668789 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.668858 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.668936 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.669014 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.669091 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.669168 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.669253 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.669324 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.669401 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.669479 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.669550 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.669624 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.669701 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.670157 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.670157 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.670337 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.670409 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.670478 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.670546 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.670654 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.671129 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.671224 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.671318 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.671415 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.671496 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.671594 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.671594 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.671746 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.671818 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.671896 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.671966 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.671966 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.672125 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.672205 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.672276 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.672276 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.672410 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.672903 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.673054 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.673158 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.673246 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.673491 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.673640 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.673759 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.673850 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.673936 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.674020 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.674105 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.674205 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.674293 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.674387 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.674473 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.674566 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.674653 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.674747 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.674841 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.674927 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.674927 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.675108 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.675207 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.675302 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.675387 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.675471 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.675556 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.675648 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.675648 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.678308 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.678481 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.678624 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.678748 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.678875 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.678999 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.679123 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.679246 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.679367 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.679498 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.679498 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.679752 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.679873 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.680018 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.680185 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.680481 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.680625 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.680753 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.680868 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.680990 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.681104 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.681298 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.681415 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.681535 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.681657 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.681818 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.681936 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.682068 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.682242 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.682361 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.682483 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.682605 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.682718 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.682845 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.682967 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.683090 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.683204 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.683324 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.683452 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.683579 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.683704 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.683824 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.683945 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.684058 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.684182 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.684304 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.684438 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.684553 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.684672 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.684783 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.684905 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.685009 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.685009 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.685179 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.685179 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.685359 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.685454 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.685587 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.685709 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.685935 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.686042 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.686142 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.686231 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.686311 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.686390 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.686475 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.686574 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.686840 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.687023 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.687180 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.687340 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.687504 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.687617 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.687719 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.687719 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.687955 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.688097 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.688240 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.688240 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.688416 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.688496 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.688568 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.688645 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.688724 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.688811 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.688883 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.688960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.689032 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.689108 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.689187 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.689271 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.689343 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.689476 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.689599 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.689693 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.689800 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.689878 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.689971 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.690066 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.690159 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.690253 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.690353 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.690428 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.690516 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.690588 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.690680 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.690774 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.690914 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.691028 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.691140 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.691252 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.691362 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.691454 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.691541 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.691615 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.691701 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.691810 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.691810 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.692156 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.692308 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.692416 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.692504 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.692587 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.692674 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.692760 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.692847 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.692926 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.693015 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.693108 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.693195 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.693277 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.693364 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.693437 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.693529 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.693625 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.693697 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.693872 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.695183 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.695301 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.695379 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.695449 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.695531 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.695618 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.695699 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.695792 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.695887 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.695974 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.696060 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.696146 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.696218 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.696311 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.696403 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.696498 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.696580 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.696665 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.696744 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.696836 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.696932 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.697006 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.697006 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.697168 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.697255 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.697328 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.697419 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.697514 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.697588 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.697666 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.697777 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.697777 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.697927 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.698026 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.698113 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.698184 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.698254 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.698254 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.698254 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.698461 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.698572 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.698706 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.698858 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.698858 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.699152 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.699331 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.699331 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.699613 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.699833 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.699991 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.700099 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.700196 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.700283 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.700375 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.700469 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.700563 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.700664 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.700760 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.700846 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.700930 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.701015 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.701099 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.701099 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.701274 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.701366 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.701458 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.701544 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.701629 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.701722 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.701883 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.701981 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.702075 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.702075 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.702075 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.702322 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.702415 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.702577 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.702701 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.702789 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.702889 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.702985 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.703072 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.703072 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.703245 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.703334 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.703427 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.703527 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.703622 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.703716 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.703816 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.703917 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.704006 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.704097 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.704190 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.704275 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.704367 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.704367 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.704367 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.704367 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.704367 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.704859 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.704980 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.705087 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.705213 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.705213 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.705377 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.705461 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.705682 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.705806 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.705904 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.705997 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.706083 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.706156 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.706314 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.706396 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.706478 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.706552 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.706629 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.706708 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.706793 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.706866 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.706946 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.707041 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.707128 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.707228 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.707315 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.707399 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.707482 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.707482 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.707482 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.707482 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.707763 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.707849 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.707940 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.708032 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.708124 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.708220 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.708313 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.708399 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.708534 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.708635 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.708719 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.708812 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.708906 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.709044 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.709146 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.709240 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.709336 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.709430 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.709516 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.709609 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.709708 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.709845 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.709930 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.710004 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.710099 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.710186 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.710258 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.710329 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.710410 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.710491 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.710563 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.710633 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.710710 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.710796 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.710876 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.710948 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.711017 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.711086 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.711086 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.711235 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.711315 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.711394 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.711472 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.711549 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.711621 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.711700 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.711781 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.711862 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.711862 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.711994 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.712064 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.712142 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.712214 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.712283 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.712353 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.712429 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.712509 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.712590 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.712662 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.712733 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.712802 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.712878 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.712962 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.713034 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.713110 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.713187 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.713257 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.713334 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.713413 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.713486 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.713555 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.713630 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.713702 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.713802 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.713887 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.713960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.714029 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.714106 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.714185 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.714185 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.714328 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.718257 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.718466 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.718584 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.718672 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.718763 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.718851 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.718937 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.719021 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.719151 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.719273 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.719398 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.719513 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.719625 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.721379 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.721483 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.721588 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.721681 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.721850 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.721943 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.722040 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.722127 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.722222 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.722317 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.722411 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.722504 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.722598 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.723266 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.723387 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.723477 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.723564 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.723648 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.723741 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.723841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.723937 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.724031 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.724118 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.724210 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.724296 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.724395 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.724395 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.724563 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.724656 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.724751 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.724837 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.724980 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.725084 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.725160 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.725239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.725319 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.725398 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.725485 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.725565 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.725636 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.725789 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.725954 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.726061 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.726150 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.726244 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.726331 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.726416 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.726500 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.726594 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.726688 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.726784 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.726870 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.726970 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.727058 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 07:24:39.727153 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.727153 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.727153 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.727153 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.727153 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.727153 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.727153 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.727153 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.727766 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.727766 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.727766 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.727766 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.727766 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.727766 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.727766 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.727766 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.728390 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.728390 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.728390 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.728390 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.728390 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:24:39.728390 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 07:24:39.777755 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO dbcounter [None req-fa87515d-79dc-4977-90d9-b9bff248b4ae None None] Registered counter for database nova_api Jul 26 07:24:39.781896 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO dbcounter [None req-042bc116-27df-480b-84ea-bdbf42910b67 None None] Registered counter for database nova_api Jul 26 07:24:39.799842 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_db.sqlalchemy.engines [None req-fa87515d-79dc-4977-90d9-b9bff248b4ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117715) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 07:24:39.803276 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_db.sqlalchemy.engines [None req-042bc116-27df-480b-84ea-bdbf42910b67 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 07:24:39.812324 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writer thread running {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 07:24:39.812881 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writer thread running {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 07:24:39.876771 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.context [None req-042bc116-27df-480b-84ea-bdbf42910b67 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0c0ac969-2f99-49ee-92fc-c2c2e5e059a0(cell1) {{(pid=117716) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 07:24:39.881074 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-042bc116-27df-480b-84ea-bdbf42910b67 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:24:39.882936 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-042bc116-27df-480b-84ea-bdbf42910b67 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:24:39.883902 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-042bc116-27df-480b-84ea-bdbf42910b67 None None] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:24:39.884557 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.context [None req-fa87515d-79dc-4977-90d9-b9bff248b4ae None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0c0ac969-2f99-49ee-92fc-c2c2e5e059a0(cell1) {{(pid=117715) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 07:24:39.886179 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-042bc116-27df-480b-84ea-bdbf42910b67 None None] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:24:39.888244 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO dbcounter [None req-042bc116-27df-480b-84ea-bdbf42910b67 None None] Registered counter for database nova_cell0 Jul 26 07:24:39.888756 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fa87515d-79dc-4977-90d9-b9bff248b4ae None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:24:39.890566 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fa87515d-79dc-4977-90d9-b9bff248b4ae None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:24:39.891415 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fa87515d-79dc-4977-90d9-b9bff248b4ae None None] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:24:39.892348 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO dbcounter [None req-042bc116-27df-480b-84ea-bdbf42910b67 None None] Registered counter for database nova_cell1 Jul 26 07:24:39.893684 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fa87515d-79dc-4977-90d9-b9bff248b4ae None None] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:24:39.895852 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO dbcounter [None req-fa87515d-79dc-4977-90d9-b9bff248b4ae None None] Registered counter for database nova_cell0 Jul 26 07:24:39.900771 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_db.sqlalchemy.engines [None req-042bc116-27df-480b-84ea-bdbf42910b67 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 07:24:39.900946 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO dbcounter [None req-fa87515d-79dc-4977-90d9-b9bff248b4ae None None] Registered counter for database nova_cell1 Jul 26 07:24:39.901313 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_db.sqlalchemy.engines [None req-042bc116-27df-480b-84ea-bdbf42910b67 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 07:24:39.908084 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_db.sqlalchemy.engines [None req-fa87515d-79dc-4977-90d9-b9bff248b4ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117715) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 07:24:39.908885 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writer thread running {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 07:24:39.910191 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writer thread running {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 07:24:39.911058 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_db.sqlalchemy.engines [None req-fa87515d-79dc-4977-90d9-b9bff248b4ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117715) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 07:24:39.921338 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writer thread running {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 07:24:39.921696 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writer thread running {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 07:24:40.075372 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO dbcounter [None req-fa87515d-79dc-4977-90d9-b9bff248b4ae None None] Registered counter for database nova_cell0 Jul 26 07:24:40.082282 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO dbcounter [None req-042bc116-27df-480b-84ea-bdbf42910b67 None None] Registered counter for database nova_cell0 Jul 26 07:24:40.082694 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_db.sqlalchemy.engines [None req-fa87515d-79dc-4977-90d9-b9bff248b4ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117715) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 07:24:40.088013 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writer thread running {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 07:24:40.089985 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_db.sqlalchemy.engines [None req-042bc116-27df-480b-84ea-bdbf42910b67 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 07:24:40.095268 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writer thread running {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 07:24:40.425931 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: WARNING keystonemiddleware.auth_token [None req-042bc116-27df-480b-84ea-bdbf42910b67 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 07:24:40.432600 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: WARNING keystonemiddleware.auth_token [None req-fa87515d-79dc-4977-90d9-b9bff248b4ae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 07:24:40.433464 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: WARNING keystonemiddleware.auth_token [None req-042bc116-27df-480b-84ea-bdbf42910b67 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 07:24:40.442595 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: WARNING keystonemiddleware.auth_token [None req-fa87515d-79dc-4977-90d9-b9bff248b4ae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 07:24:40.802201 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: WARNING keystonemiddleware.auth_token [None req-042bc116-27df-480b-84ea-bdbf42910b67 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 07:24:40.808835 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: WARNING keystonemiddleware.auth_token [None req-042bc116-27df-480b-84ea-bdbf42910b67 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 07:24:40.814388 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5567881c49c0 pid: 117716 (default app) Jul 26 07:24:40.818805 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: WARNING keystonemiddleware.auth_token [None req-fa87515d-79dc-4977-90d9-b9bff248b4ae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 07:24:40.824849 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: WARNING keystonemiddleware.auth_token [None req-fa87515d-79dc-4977-90d9-b9bff248b4ae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 07:24:40.830274 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5567881c49c0 pid: 117715 (default app) Jul 26 07:25:22.516025 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=3 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:25:22.517366 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell0:SELECT=3 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:25:22.518984 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=3 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:25:22.522316 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell0:SELECT=3 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:25:22.680059 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=3 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:25:22.686877 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell0:SELECT=3 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:25:22.687785 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=3 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:25:22.688568 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell0:SELECT=3 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:25:23.718469 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-530f2195-60f8-4bb2-9b95-55172cde021c tempest-VolumesGetTestJSON-447812382 tempest-VolumesGetTestJSON-447812382-project] Action: 'create', calling method: .version_select at 0x7f7f046d5940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-537183485", "metadata": {"Type": "work"}}} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:25:23.882414 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8071264b-c122-4182-b910-ce504bb6fe11 tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] Action: 'create', calling method: .version_select at 0x7f7f046d6940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-340465899"}} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:25:25.250002 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8071264b-c122-4182-b910-ce504bb6fe11 tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.758357 Jul 26 07:25:25.251449 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1/1] 10.222.0.39 () {60 vars in 1155 bytes} [Tue Jul 26 07:25:22 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2763 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 26 07:25:25.313121 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-530f2195-60f8-4bb2-9b95-55172cde021c tempest-VolumesGetTestJSON-447812382 tempest-VolumesGetTestJSON-447812382-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.647536 Jul 26 07:25:25.319260 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1/2] 10.222.0.39 () {60 vars in 1156 bytes} [Tue Jul 26 07:25:22 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2655 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 26 07:25:25.340834 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-838ec7c4-3e10-4100-ac9b-2b62178353a1 tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] Calling method '.version_select at 0x7f7f04529820>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:25.490667 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-838ec7c4-3e10-4100-ac9b-2b62178353a1 tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/c1c38534-7468-4637-b7c7-47ae4b20f00f" status: 200 len: 344 microversion: 2.1 time: 0.169829 Jul 26 07:25:25.491646 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 2/3] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Jul 26 07:25:25 2022] GET /compute/v2.1/os-volumes/c1c38534-7468-4637-b7c7-47ae4b20f00f => generated 344 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:25:25.498777 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-fefb8b78-d71e-46b0-9d04-ab05097bf25c tempest-VolumesGetTestJSON-447812382 tempest-VolumesGetTestJSON-447812382-project] Calling method '.version_select at 0x7f7f04529f70>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:25.589904 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9fe4c516-032d-4dee-833a-63d595950017 tempest-VolumesNegativeTest-479512864 tempest-VolumesNegativeTest-479512864-project] Action: 'create', calling method: .version_select at 0x7f7f0452a700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1212496224", "metadata": {"Type": "work"}}} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:25:25.595621 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9fe4c516-032d-4dee-833a-63d595950017 tempest-VolumesNegativeTest-479512864 tempest-VolumesNegativeTest-479512864-project] Request method failure captured: Jul 26 07:25:25.595621 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 26 07:25:25.595621 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept: application/json Jul 26 07:25:25.595621 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept-Encoding: identity Jul 26 07:25:25.595621 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Connection: close Jul 26 07:25:25.595621 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Length: 122 Jul 26 07:25:25.595621 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Type: application/json Jul 26 07:25:25.595621 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Host: 10.222.0.39 Jul 26 07:25:25.595621 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Openstack-System-Scope: None Jul 26 07:25:25.595621 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: User-Agent: python-urllib3/1.26.10 Jul 26 07:25:25.595621 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Auth-Token: gAAAAABi35biNlcRM0NvkwVlgHh3OUGkew6YkoXYmXaRf6wAq8Eh-DAYvPWyPk2Z_rj2ds_skBVK3U_GdtV-QGqgp-niVnazw3SMKYk0fU6UPYp6_liZHUHn3psy8cJ6vYXsWFLq17O8W5C7XGo0X0PmTc3pwdqD9tktD2bkrI0-YuZjdorq6EI Jul 26 07:25:25.595621 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Id: None Jul 26 07:25:25.595621 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Name: None Jul 26 07:25:25.595621 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Identity-Status: Confirmed Jul 26 07:25:25.595621 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Is-Admin-Project: True Jul 26 07:25:25.595621 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Id: default Jul 26 07:25:25.595621 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Name: Default Jul 26 07:25:25.595621 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Id: 8d86f999900147c0a2fa7d75d9ce90fb Jul 26 07:25:25.595621 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Name: tempest-VolumesNegativeTest-479512864 Jul 26 07:25:25.595621 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Role: member,reader Jul 26 07:25:25.595621 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Roles: member,reader Jul 26 07:25:25.598006 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8d86f999900147c0a2fa7d75d9ce90fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8d86f999900147c0a2fa7d75d9ce90fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8d86f999900147c0a2fa7d75d9ce90fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8d86f999900147c0a2fa7d75d9ce90fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:25:25.598006 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant: tempest-VolumesNegativeTest-479512864 Jul 26 07:25:25.598006 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Id: 8d86f999900147c0a2fa7d75d9ce90fb Jul 26 07:25:25.598006 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Name: tempest-VolumesNegativeTest-479512864 Jul 26 07:25:25.598006 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User: tempest-VolumesNegativeTest-479512864-project Jul 26 07:25:25.598006 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Id: default Jul 26 07:25:25.598006 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Name: Default Jul 26 07:25:25.598006 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Id: 618965bf5e3046ecace7edb01420bd17 Jul 26 07:25:25.598006 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Name: tempest-VolumesNegativeTest-479512864-project Jul 26 07:25:25.598006 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Jul 26 07:25:25.598006 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1212496224", "metadata": {"Type": "work"}}} Jul 26 07:25:25.598006 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: method: Jul 26 07:25:25.598006 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 26 07:25:25.599131 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1212496224', 'metadata': {'Type': 'work'}}}} Jul 26 07:25:25.599131 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:25:25.599131 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:25.599131 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 07:25:25.599131 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 07:25:25.599131 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 07:25:25.599131 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise error Jul 26 07:25:25.599131 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 26 07:25:25.599131 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.599131 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 26 07:25:25.599131 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 26 07:25:25.599131 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.599131 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 26 07:25:25.599131 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi '#$%' Jul 26 07:25:25.599131 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.599131 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:25:25.599131 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.599131 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:25.599131 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:25:25.599131 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:25:25.599131 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:25:25.599131 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:25:25.600789 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 07:25:25.600789 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 07:25:25.600789 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:25:25.600789 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:25:25.600789 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 07:25:25.600789 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 07:25:25.600789 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 07:25:25.600789 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 07:25:25.600789 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 07:25:25.600789 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 07:25:25.600789 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 26 07:25:25.600789 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.600789 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:25:25.600789 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.600789 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:25.600789 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:25:25.600789 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:25:25.600789 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 07:25:25.600789 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 07:25:25.602234 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 26 07:25:25.602234 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.602234 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9fe4c516-032d-4dee-833a-63d595950017 tempest-VolumesNegativeTest-479512864 tempest-VolumesNegativeTest-479512864-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:25:25.602234 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-9fe4c516-032d-4dee-833a-63d595950017 tempest-VolumesNegativeTest-479512864 tempest-VolumesNegativeTest-479512864-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.348832 Jul 26 07:25:25.609272 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 2/4] 10.222.0.39 () {60 vars in 1156 bytes} [Tue Jul 26 07:25:25 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 357 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 07:25:25.635742 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-55479e52-8056-45b1-ab8a-9f27a5e9183b tempest-VolumesNegativeTest-479512864 tempest-VolumesNegativeTest-479512864-project] Action: 'create', calling method: .version_select at 0x7f7f044fa0d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1393848343", "metadata": {"Type": "work"}}} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:25:25.655416 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-55479e52-8056-45b1-ab8a-9f27a5e9183b tempest-VolumesNegativeTest-479512864 tempest-VolumesNegativeTest-479512864-project] Request method failure captured: Jul 26 07:25:25.655416 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 26 07:25:25.655416 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept: application/json Jul 26 07:25:25.655416 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept-Encoding: identity Jul 26 07:25:25.655416 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Connection: close Jul 26 07:25:25.655416 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Length: 120 Jul 26 07:25:25.655416 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Type: application/json Jul 26 07:25:25.655416 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Host: 10.222.0.39 Jul 26 07:25:25.655416 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Openstack-System-Scope: None Jul 26 07:25:25.655416 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: User-Agent: python-urllib3/1.26.10 Jul 26 07:25:25.655416 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Auth-Token: gAAAAABi35biNlcRM0NvkwVlgHh3OUGkew6YkoXYmXaRf6wAq8Eh-DAYvPWyPk2Z_rj2ds_skBVK3U_GdtV-QGqgp-niVnazw3SMKYk0fU6UPYp6_liZHUHn3psy8cJ6vYXsWFLq17O8W5C7XGo0X0PmTc3pwdqD9tktD2bkrI0-YuZjdorq6EI Jul 26 07:25:25.655416 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Id: None Jul 26 07:25:25.655416 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Name: None Jul 26 07:25:25.655416 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Identity-Status: Confirmed Jul 26 07:25:25.655416 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Is-Admin-Project: True Jul 26 07:25:25.655416 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Id: default Jul 26 07:25:25.655416 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Name: Default Jul 26 07:25:25.655416 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Id: 8d86f999900147c0a2fa7d75d9ce90fb Jul 26 07:25:25.655416 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Name: tempest-VolumesNegativeTest-479512864 Jul 26 07:25:25.655416 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Role: member,reader Jul 26 07:25:25.655416 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Roles: member,reader Jul 26 07:25:25.656720 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8d86f999900147c0a2fa7d75d9ce90fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8d86f999900147c0a2fa7d75d9ce90fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8d86f999900147c0a2fa7d75d9ce90fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8d86f999900147c0a2fa7d75d9ce90fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:25:25.656720 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant: tempest-VolumesNegativeTest-479512864 Jul 26 07:25:25.656720 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Id: 8d86f999900147c0a2fa7d75d9ce90fb Jul 26 07:25:25.656720 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Name: tempest-VolumesNegativeTest-479512864 Jul 26 07:25:25.656720 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User: tempest-VolumesNegativeTest-479512864-project Jul 26 07:25:25.656720 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Id: default Jul 26 07:25:25.656720 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Name: Default Jul 26 07:25:25.656720 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Id: 618965bf5e3046ecace7edb01420bd17 Jul 26 07:25:25.656720 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Name: tempest-VolumesNegativeTest-479512864-project Jul 26 07:25:25.656720 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Jul 26 07:25:25.656720 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1393848343", "metadata": {"Type": "work"}}} Jul 26 07:25:25.656720 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: method: Jul 26 07:25:25.656720 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 26 07:25:25.657727 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1393848343', 'metadata': {'Type': 'work'}}}} Jul 26 07:25:25.657727 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:25:25.657727 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:25.657727 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 07:25:25.657727 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 07:25:25.657727 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 07:25:25.657727 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise error Jul 26 07:25:25.657727 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 26 07:25:25.657727 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.657727 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 26 07:25:25.657727 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 26 07:25:25.657727 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.657727 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 26 07:25:25.657727 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi '0' Jul 26 07:25:25.657727 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.657727 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:25:25.657727 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.657727 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:25.657727 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:25:25.657727 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:25:25.657727 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:25:25.657727 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:25:25.659155 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 07:25:25.659155 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 07:25:25.659155 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:25:25.659155 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:25:25.659155 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 07:25:25.659155 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 07:25:25.659155 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 07:25:25.659155 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 07:25:25.659155 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 07:25:25.659155 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 07:25:25.659155 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 26 07:25:25.659155 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.659155 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:25:25.659155 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.659155 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:25.659155 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:25:25.659155 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:25:25.659155 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 07:25:25.659155 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 07:25:25.660342 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 26 07:25:25.660342 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.660342 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-55479e52-8056-45b1-ab8a-9f27a5e9183b tempest-VolumesNegativeTest-479512864 tempest-VolumesNegativeTest-479512864-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:25:25.660557 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-fefb8b78-d71e-46b0-9d04-ab05097bf25c tempest-VolumesGetTestJSON-447812382 tempest-VolumesGetTestJSON-447812382-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/3c80d73d-5dc4-4e6c-8c3c-648a0c8abb50" status: 200 len: 352 microversion: 2.1 time: 0.163876 Jul 26 07:25:25.660637 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-55479e52-8056-45b1-ab8a-9f27a5e9183b tempest-VolumesNegativeTest-479512864 tempest-VolumesNegativeTest-479512864-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.046601 Jul 26 07:25:25.663581 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 3/5] 10.222.0.39 () {60 vars in 1156 bytes} [Tue Jul 26 07:25:25 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 07:25:25.664628 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 3/6] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Jul 26 07:25:25 2022] GET /compute/v2.1/os-volumes/3c80d73d-5dc4-4e6c-8c3c-648a0c8abb50 => generated 352 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:25:25.676231 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-74d6a469-f7d6-4a7f-98d0-0e1bdb525f5b tempest-VolumesNegativeTest-479512864 tempest-VolumesNegativeTest-479512864-project] Action: 'create', calling method: .version_select at 0x7f7f0452adc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-188884822", "metadata": {"Type": "work"}}} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:25:25.683729 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-74d6a469-f7d6-4a7f-98d0-0e1bdb525f5b tempest-VolumesNegativeTest-479512864 tempest-VolumesNegativeTest-479512864-project] Request method failure captured: Jul 26 07:25:25.683729 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 26 07:25:25.683729 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept: application/json Jul 26 07:25:25.683729 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept-Encoding: identity Jul 26 07:25:25.683729 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Connection: close Jul 26 07:25:25.683729 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Length: 118 Jul 26 07:25:25.683729 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Type: application/json Jul 26 07:25:25.683729 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Host: 10.222.0.39 Jul 26 07:25:25.683729 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Openstack-System-Scope: None Jul 26 07:25:25.683729 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: User-Agent: python-urllib3/1.26.10 Jul 26 07:25:25.683729 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Auth-Token: gAAAAABi35biNlcRM0NvkwVlgHh3OUGkew6YkoXYmXaRf6wAq8Eh-DAYvPWyPk2Z_rj2ds_skBVK3U_GdtV-QGqgp-niVnazw3SMKYk0fU6UPYp6_liZHUHn3psy8cJ6vYXsWFLq17O8W5C7XGo0X0PmTc3pwdqD9tktD2bkrI0-YuZjdorq6EI Jul 26 07:25:25.683729 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Id: None Jul 26 07:25:25.683729 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Name: None Jul 26 07:25:25.683729 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Identity-Status: Confirmed Jul 26 07:25:25.683729 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Is-Admin-Project: True Jul 26 07:25:25.683729 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Id: default Jul 26 07:25:25.683729 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Name: Default Jul 26 07:25:25.683729 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Id: 8d86f999900147c0a2fa7d75d9ce90fb Jul 26 07:25:25.683729 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Name: tempest-VolumesNegativeTest-479512864 Jul 26 07:25:25.683729 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Role: member,reader Jul 26 07:25:25.683729 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Roles: member,reader Jul 26 07:25:25.685326 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8d86f999900147c0a2fa7d75d9ce90fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8d86f999900147c0a2fa7d75d9ce90fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8d86f999900147c0a2fa7d75d9ce90fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8d86f999900147c0a2fa7d75d9ce90fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:25:25.685326 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant: tempest-VolumesNegativeTest-479512864 Jul 26 07:25:25.685326 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Id: 8d86f999900147c0a2fa7d75d9ce90fb Jul 26 07:25:25.685326 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Name: tempest-VolumesNegativeTest-479512864 Jul 26 07:25:25.685326 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User: tempest-VolumesNegativeTest-479512864-project Jul 26 07:25:25.685326 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Id: default Jul 26 07:25:25.685326 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Name: Default Jul 26 07:25:25.685326 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Id: 618965bf5e3046ecace7edb01420bd17 Jul 26 07:25:25.685326 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Name: tempest-VolumesNegativeTest-479512864-project Jul 26 07:25:25.685326 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Jul 26 07:25:25.685326 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-188884822", "metadata": {"Type": "work"}}} Jul 26 07:25:25.685326 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: method: Jul 26 07:25:25.685326 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 26 07:25:25.686424 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-188884822', 'metadata': {'Type': 'work'}}}} Jul 26 07:25:25.686424 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:25:25.686424 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:25.686424 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 07:25:25.686424 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 07:25:25.686424 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 07:25:25.686424 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise error Jul 26 07:25:25.686424 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 26 07:25:25.686424 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.686424 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 26 07:25:25.686424 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 26 07:25:25.686424 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.686424 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 26 07:25:25.686424 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi '' Jul 26 07:25:25.686424 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.686424 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:25:25.686424 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.686424 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:25.686424 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:25:25.686424 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:25:25.686424 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:25:25.686424 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:25:25.687982 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 07:25:25.687982 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 07:25:25.687982 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:25:25.687982 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:25:25.687982 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 07:25:25.687982 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 07:25:25.687982 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 07:25:25.687982 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 07:25:25.687982 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 07:25:25.687982 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 07:25:25.687982 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 26 07:25:25.687982 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.687982 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:25:25.687982 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.687982 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:25.687982 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:25:25.687982 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:25:25.687982 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 07:25:25.687982 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 07:25:25.689392 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 26 07:25:25.689392 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.689392 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-74d6a469-f7d6-4a7f-98d0-0e1bdb525f5b tempest-VolumesNegativeTest-479512864 tempest-VolumesNegativeTest-479512864-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:25:25.689392 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-74d6a469-f7d6-4a7f-98d0-0e1bdb525f5b tempest-VolumesNegativeTest-479512864 tempest-VolumesNegativeTest-479512864-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.020400 Jul 26 07:25:25.690748 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 4/7] 10.222.0.39 () {60 vars in 1156 bytes} [Tue Jul 26 07:25:25 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 07:25:25.698971 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-40b89ac9-797f-4074-bd6a-a9d13bfd261c tempest-VolumesNegativeTest-479512864 tempest-VolumesNegativeTest-479512864-project] Calling method '.version_select at 0x7f7f04541670>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:25.743503 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.wsgi [None req-40b89ac9-797f-4074-bd6a-a9d13bfd261c tempest-VolumesNegativeTest-479512864 tempest-VolumesNegativeTest-479512864-project] HTTP exception thrown: Volume tempest-invalid-1603907227 could not be found. Jul 26 07:25:25.750230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-40b89ac9-797f-4074-bd6a-a9d13bfd261c tempest-VolumesNegativeTest-479512864 tempest-VolumesNegativeTest-479512864-project] Request method failure captured: Jul 26 07:25:25.750230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1603907227 HTTP/1.1 Jul 26 07:25:25.750230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept: application/json Jul 26 07:25:25.750230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept-Encoding: identity Jul 26 07:25:25.750230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Connection: close Jul 26 07:25:25.750230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Length: 0 Jul 26 07:25:25.750230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Type: application/json Jul 26 07:25:25.750230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Host: 10.222.0.39 Jul 26 07:25:25.750230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Openstack-System-Scope: None Jul 26 07:25:25.750230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: User-Agent: python-urllib3/1.26.10 Jul 26 07:25:25.750230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Auth-Token: gAAAAABi35biNlcRM0NvkwVlgHh3OUGkew6YkoXYmXaRf6wAq8Eh-DAYvPWyPk2Z_rj2ds_skBVK3U_GdtV-QGqgp-niVnazw3SMKYk0fU6UPYp6_liZHUHn3psy8cJ6vYXsWFLq17O8W5C7XGo0X0PmTc3pwdqD9tktD2bkrI0-YuZjdorq6EI Jul 26 07:25:25.750230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Id: None Jul 26 07:25:25.750230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Name: None Jul 26 07:25:25.750230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Identity-Status: Confirmed Jul 26 07:25:25.750230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Is-Admin-Project: True Jul 26 07:25:25.750230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Id: default Jul 26 07:25:25.750230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Name: Default Jul 26 07:25:25.750230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Id: 8d86f999900147c0a2fa7d75d9ce90fb Jul 26 07:25:25.750230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Name: tempest-VolumesNegativeTest-479512864 Jul 26 07:25:25.750230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Role: member,reader Jul 26 07:25:25.750230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Roles: member,reader Jul 26 07:25:25.751781 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8d86f999900147c0a2fa7d75d9ce90fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8d86f999900147c0a2fa7d75d9ce90fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8d86f999900147c0a2fa7d75d9ce90fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8d86f999900147c0a2fa7d75d9ce90fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:25:25.751781 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant: tempest-VolumesNegativeTest-479512864 Jul 26 07:25:25.751781 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Id: 8d86f999900147c0a2fa7d75d9ce90fb Jul 26 07:25:25.751781 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Name: tempest-VolumesNegativeTest-479512864 Jul 26 07:25:25.751781 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User: tempest-VolumesNegativeTest-479512864-project Jul 26 07:25:25.751781 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Id: default Jul 26 07:25:25.751781 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Name: Default Jul 26 07:25:25.751781 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Id: 618965bf5e3046ecace7edb01420bd17 Jul 26 07:25:25.751781 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Name: tempest-VolumesNegativeTest-479512864-project Jul 26 07:25:25.751781 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: method: Jul 26 07:25:25.751781 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: exception: Volume tempest-invalid-1603907227 could not be found. Jul 26 07:25:25.751781 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: action_args: {'id': 'tempest-invalid-1603907227'} Jul 26 07:25:25.751781 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:25:25.752714 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:25.752714 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 07:25:25.752714 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 07:25:25.752714 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 07:25:25.752714 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 07:25:25.752714 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 07:25:25.752714 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 07:25:25.752714 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 07:25:25.752714 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 07:25:25.752714 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 07:25:25.752714 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 07:25:25.752714 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 07:25:25.752714 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 07:25:25.752714 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 07:25:25.752714 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 07:25:25.752714 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1603907227 could not be found. (HTTP 404) (Request-ID: req-0467fd75-be00-4c44-a0c0-3a28f3779819) Jul 26 07:25:25.752714 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.752714 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:25:25.752714 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.754236 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:25.754236 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 26 07:25:25.754236 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 26 07:25:25.754236 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 07:25:25.754236 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 07:25:25.754236 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 07:25:25.754236 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 07:25:25.754236 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 07:25:25.754236 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 07:25:25.754236 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 07:25:25.754236 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 07:25:25.754236 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 07:25:25.754236 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 07:25:25.754236 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 07:25:25.754236 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 07:25:25.754236 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 07:25:25.754236 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 07:25:25.754236 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 07:25:25.754236 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 07:25:25.757657 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 07:25:25.757657 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 07:25:25.757657 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 07:25:25.757657 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 07:25:25.757657 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1603907227 could not be found. Jul 26 07:25:25.757657 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.757657 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:25:25.757657 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.757657 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:25.757657 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:25:25.757657 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:25:25.757657 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:25:25.757657 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:25:25.757657 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 07:25:25.757657 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 07:25:25.757657 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:25:25.757657 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:25:25.757657 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 26 07:25:25.757657 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:25:25.757657 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1603907227 could not be found. Jul 26 07:25:25.760713 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.760713 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:25:25.760713 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.760713 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:25.760713 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:25:25.760713 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:25:25.760713 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:25:25.760713 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:25:25.760713 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1603907227 could not be found. Jul 26 07:25:25.760713 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.765116 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-40b89ac9-797f-4074-bd6a-a9d13bfd261c tempest-VolumesNegativeTest-479512864 tempest-VolumesNegativeTest-479512864-project] Returning 404 to user: Volume tempest-invalid-1603907227 could not be found. {{(pid=117715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:25:25.766062 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-40b89ac9-797f-4074-bd6a-a9d13bfd261c tempest-VolumesNegativeTest-479512864 tempest-VolumesNegativeTest-479512864-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1603907227" status: 404 len: 99 microversion: 2.1 time: 0.072607 Jul 26 07:25:25.766971 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 4/8] 10.222.0.39 () {58 vars in 1218 bytes} [Tue Jul 26 07:25:25 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1603907227 => generated 99 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 07:25:25.776679 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-319ddbd0-73f2-42c4-b1a0-66fc94b30e4b tempest-VolumesNegativeTest-479512864 tempest-VolumesNegativeTest-479512864-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004526 Jul 26 07:25:25.782582 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 5/9] 10.222.0.39 () {58 vars in 1140 bytes} [Tue Jul 26 07:25:25 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 26 07:25:25.786894 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-fb87d086-ef32-4b4b-ad17-d86c595c5061 tempest-VolumesNegativeTest-479512864 tempest-VolumesNegativeTest-479512864-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003905 Jul 26 07:25:25.787790 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 5/10] 10.222.0.39 () {58 vars in 1137 bytes} [Tue Jul 26 07:25:25 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 26 07:25:25.804958 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b00fd1e4-7b72-4390-8c7b-a860c82b8e80 tempest-VolumesNegativeTest-479512864 tempest-VolumesNegativeTest-479512864-project] Calling method '.version_select at 0x7f7f0452a550>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:25.846262 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.wsgi [None req-b00fd1e4-7b72-4390-8c7b-a860c82b8e80 tempest-VolumesNegativeTest-479512864 tempest-VolumesNegativeTest-479512864-project] HTTP exception thrown: Volume cfd2d5a7-eec8-48e3-aacc-97b9b253910c could not be found. Jul 26 07:25:25.850623 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b00fd1e4-7b72-4390-8c7b-a860c82b8e80 tempest-VolumesNegativeTest-479512864 tempest-VolumesNegativeTest-479512864-project] Request method failure captured: Jul 26 07:25:25.850623 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: request: DELETE /compute/v2.1/os-volumes/cfd2d5a7-eec8-48e3-aacc-97b9b253910c HTTP/1.1 Jul 26 07:25:25.850623 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept: application/json Jul 26 07:25:25.850623 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept-Encoding: identity Jul 26 07:25:25.850623 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Connection: close Jul 26 07:25:25.850623 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Length: 0 Jul 26 07:25:25.850623 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Type: application/json Jul 26 07:25:25.850623 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Host: 10.222.0.39 Jul 26 07:25:25.850623 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Openstack-System-Scope: None Jul 26 07:25:25.850623 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: User-Agent: python-urllib3/1.26.10 Jul 26 07:25:25.850623 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Auth-Token: gAAAAABi35biNlcRM0NvkwVlgHh3OUGkew6YkoXYmXaRf6wAq8Eh-DAYvPWyPk2Z_rj2ds_skBVK3U_GdtV-QGqgp-niVnazw3SMKYk0fU6UPYp6_liZHUHn3psy8cJ6vYXsWFLq17O8W5C7XGo0X0PmTc3pwdqD9tktD2bkrI0-YuZjdorq6EI Jul 26 07:25:25.850623 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Id: None Jul 26 07:25:25.850623 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Name: None Jul 26 07:25:25.850623 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Identity-Status: Confirmed Jul 26 07:25:25.850623 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Is-Admin-Project: True Jul 26 07:25:25.850623 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Id: default Jul 26 07:25:25.850623 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Name: Default Jul 26 07:25:25.850623 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Id: 8d86f999900147c0a2fa7d75d9ce90fb Jul 26 07:25:25.850623 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Name: tempest-VolumesNegativeTest-479512864 Jul 26 07:25:25.850623 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Role: member,reader Jul 26 07:25:25.850623 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Roles: member,reader Jul 26 07:25:25.857772 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8d86f999900147c0a2fa7d75d9ce90fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8d86f999900147c0a2fa7d75d9ce90fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8d86f999900147c0a2fa7d75d9ce90fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8d86f999900147c0a2fa7d75d9ce90fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:25:25.857772 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant: tempest-VolumesNegativeTest-479512864 Jul 26 07:25:25.857772 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Id: 8d86f999900147c0a2fa7d75d9ce90fb Jul 26 07:25:25.857772 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Name: tempest-VolumesNegativeTest-479512864 Jul 26 07:25:25.857772 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User: tempest-VolumesNegativeTest-479512864-project Jul 26 07:25:25.857772 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Id: default Jul 26 07:25:25.857772 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Name: Default Jul 26 07:25:25.857772 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Id: 618965bf5e3046ecace7edb01420bd17 Jul 26 07:25:25.857772 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Name: tempest-VolumesNegativeTest-479512864-project Jul 26 07:25:25.857772 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: method: Jul 26 07:25:25.857772 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: exception: Volume cfd2d5a7-eec8-48e3-aacc-97b9b253910c could not be found. Jul 26 07:25:25.857772 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: action_args: {'id': 'cfd2d5a7-eec8-48e3-aacc-97b9b253910c'} Jul 26 07:25:25.857772 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:25:25.858827 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:25.858827 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 07:25:25.858827 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 07:25:25.858827 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 07:25:25.858827 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 07:25:25.858827 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 07:25:25.858827 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 07:25:25.858827 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 07:25:25.858827 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 07:25:25.858827 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 07:25:25.858827 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 07:25:25.858827 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 07:25:25.858827 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 07:25:25.858827 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 07:25:25.858827 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 07:25:25.858827 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cfd2d5a7-eec8-48e3-aacc-97b9b253910c could not be found. (HTTP 404) (Request-ID: req-4a282b52-8616-45e5-8ac1-869c7495802c) Jul 26 07:25:25.858827 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.858827 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:25:25.858827 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.861536 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:25.861536 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 26 07:25:25.861536 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 26 07:25:25.861536 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 07:25:25.861536 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 07:25:25.861536 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 07:25:25.861536 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 07:25:25.861536 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 07:25:25.861536 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 07:25:25.861536 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 07:25:25.861536 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 07:25:25.861536 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 07:25:25.861536 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 07:25:25.861536 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 07:25:25.861536 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 07:25:25.861536 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 07:25:25.861536 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 07:25:25.861536 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 07:25:25.861536 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 07:25:25.863988 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 07:25:25.863988 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 07:25:25.863988 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 07:25:25.863988 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 07:25:25.863988 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cfd2d5a7-eec8-48e3-aacc-97b9b253910c could not be found. Jul 26 07:25:25.863988 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.863988 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:25:25.863988 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.863988 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:25.863988 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:25:25.863988 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:25:25.863988 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:25:25.863988 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:25:25.863988 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 07:25:25.863988 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 07:25:25.863988 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:25:25.863988 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:25:25.863988 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 26 07:25:25.863988 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:25:25.865841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cfd2d5a7-eec8-48e3-aacc-97b9b253910c could not be found. Jul 26 07:25:25.865841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.865841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:25:25.865841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.865841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:25.865841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:25:25.865841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:25:25.865841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:25:25.865841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:25:25.865841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cfd2d5a7-eec8-48e3-aacc-97b9b253910c could not be found. Jul 26 07:25:25.865841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.865841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b00fd1e4-7b72-4390-8c7b-a860c82b8e80 tempest-VolumesNegativeTest-479512864 tempest-VolumesNegativeTest-479512864-project] Returning 404 to user: Volume cfd2d5a7-eec8-48e3-aacc-97b9b253910c could not be found. {{(pid=117716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:25:25.865841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b00fd1e4-7b72-4390-8c7b-a860c82b8e80 tempest-VolumesNegativeTest-479512864 tempest-VolumesNegativeTest-479512864-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/cfd2d5a7-eec8-48e3-aacc-97b9b253910c" status: 404 len: 109 microversion: 2.1 time: 0.058119 Jul 26 07:25:25.865841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 6/11] 10.222.0.39 () {58 vars in 1248 bytes} [Tue Jul 26 07:25:25 2022] DELETE /compute/v2.1/os-volumes/cfd2d5a7-eec8-48e3-aacc-97b9b253910c => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 07:25:25.866969 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-383547a4-7222-4692-9073-ff9bda539c3b tempest-VolumesNegativeTest-479512864 tempest-VolumesNegativeTest-479512864-project] Calling method '.version_select at 0x7f7f044ae280>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:25.918649 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.wsgi [None req-383547a4-7222-4692-9073-ff9bda539c3b tempest-VolumesNegativeTest-479512864 tempest-VolumesNegativeTest-479512864-project] HTTP exception thrown: Volume 32948ad8-2438-4d20-88cb-d38cfc93bdea could not be found. Jul 26 07:25:25.920987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-383547a4-7222-4692-9073-ff9bda539c3b tempest-VolumesNegativeTest-479512864 tempest-VolumesNegativeTest-479512864-project] Request method failure captured: Jul 26 07:25:25.920987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: request: GET /compute/v2.1/os-volumes/32948ad8-2438-4d20-88cb-d38cfc93bdea HTTP/1.1 Jul 26 07:25:25.920987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept: application/json Jul 26 07:25:25.920987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept-Encoding: identity Jul 26 07:25:25.920987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Connection: close Jul 26 07:25:25.920987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Length: 0 Jul 26 07:25:25.920987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Type: application/json Jul 26 07:25:25.920987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Host: 10.222.0.39 Jul 26 07:25:25.920987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Openstack-System-Scope: None Jul 26 07:25:25.920987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: User-Agent: python-urllib3/1.26.10 Jul 26 07:25:25.920987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Auth-Token: gAAAAABi35biNlcRM0NvkwVlgHh3OUGkew6YkoXYmXaRf6wAq8Eh-DAYvPWyPk2Z_rj2ds_skBVK3U_GdtV-QGqgp-niVnazw3SMKYk0fU6UPYp6_liZHUHn3psy8cJ6vYXsWFLq17O8W5C7XGo0X0PmTc3pwdqD9tktD2bkrI0-YuZjdorq6EI Jul 26 07:25:25.920987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Id: None Jul 26 07:25:25.920987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Name: None Jul 26 07:25:25.920987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Identity-Status: Confirmed Jul 26 07:25:25.920987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Is-Admin-Project: True Jul 26 07:25:25.920987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Id: default Jul 26 07:25:25.920987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Name: Default Jul 26 07:25:25.920987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Id: 8d86f999900147c0a2fa7d75d9ce90fb Jul 26 07:25:25.920987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Name: tempest-VolumesNegativeTest-479512864 Jul 26 07:25:25.920987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Role: member,reader Jul 26 07:25:25.920987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Roles: member,reader Jul 26 07:25:25.922350 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8d86f999900147c0a2fa7d75d9ce90fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8d86f999900147c0a2fa7d75d9ce90fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8d86f999900147c0a2fa7d75d9ce90fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8d86f999900147c0a2fa7d75d9ce90fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:25:25.922350 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant: tempest-VolumesNegativeTest-479512864 Jul 26 07:25:25.922350 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Id: 8d86f999900147c0a2fa7d75d9ce90fb Jul 26 07:25:25.922350 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Name: tempest-VolumesNegativeTest-479512864 Jul 26 07:25:25.922350 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User: tempest-VolumesNegativeTest-479512864-project Jul 26 07:25:25.922350 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Id: default Jul 26 07:25:25.922350 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Name: Default Jul 26 07:25:25.922350 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Id: 618965bf5e3046ecace7edb01420bd17 Jul 26 07:25:25.922350 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Name: tempest-VolumesNegativeTest-479512864-project Jul 26 07:25:25.922350 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: method: Jul 26 07:25:25.922350 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: exception: Volume 32948ad8-2438-4d20-88cb-d38cfc93bdea could not be found. Jul 26 07:25:25.922350 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: action_args: {'id': '32948ad8-2438-4d20-88cb-d38cfc93bdea'} Jul 26 07:25:25.922350 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:25:25.923145 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:25.923145 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 07:25:25.923145 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 07:25:25.923145 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 07:25:25.923145 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 07:25:25.923145 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 07:25:25.923145 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 07:25:25.923145 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 07:25:25.923145 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 07:25:25.923145 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 07:25:25.923145 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 07:25:25.923145 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 07:25:25.923145 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 07:25:25.923145 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 07:25:25.923145 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 07:25:25.923145 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 32948ad8-2438-4d20-88cb-d38cfc93bdea could not be found. (HTTP 404) (Request-ID: req-26191d92-8004-47fe-a590-8eb75570dd40) Jul 26 07:25:25.923145 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.923145 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:25:25.923145 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.933106 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:25.933106 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 07:25:25.933106 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 07:25:25.933106 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 07:25:25.933106 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 07:25:25.933106 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 07:25:25.933106 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 07:25:25.933106 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 07:25:25.933106 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 07:25:25.933106 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 07:25:25.933106 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 07:25:25.933106 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 07:25:25.933106 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 07:25:25.933106 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 07:25:25.933106 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 07:25:25.933106 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 07:25:25.933106 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 07:25:25.933106 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 07:25:25.933106 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 07:25:25.935124 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 07:25:25.935124 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 07:25:25.935124 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 07:25:25.935124 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 07:25:25.935124 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 32948ad8-2438-4d20-88cb-d38cfc93bdea could not be found. Jul 26 07:25:25.935124 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.935124 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:25:25.935124 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.935124 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:25.935124 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:25:25.935124 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:25:25.935124 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:25:25.935124 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:25:25.935124 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 07:25:25.935124 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 07:25:25.935124 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:25:25.935124 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:25:25.935124 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 07:25:25.935124 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:25:25.936719 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 32948ad8-2438-4d20-88cb-d38cfc93bdea could not be found. Jul 26 07:25:25.936719 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.936719 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:25:25.936719 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.936719 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:25.936719 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:25:25.936719 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:25:25.936719 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:25:25.936719 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:25:25.936719 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 32948ad8-2438-4d20-88cb-d38cfc93bdea could not be found. Jul 26 07:25:25.936719 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:25:25.936719 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-383547a4-7222-4692-9073-ff9bda539c3b tempest-VolumesNegativeTest-479512864 tempest-VolumesNegativeTest-479512864-project] Returning 404 to user: Volume 32948ad8-2438-4d20-88cb-d38cfc93bdea could not be found. {{(pid=117715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:25:25.936719 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-383547a4-7222-4692-9073-ff9bda539c3b tempest-VolumesNegativeTest-479512864 tempest-VolumesNegativeTest-479512864-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/32948ad8-2438-4d20-88cb-d38cfc93bdea" status: 404 len: 109 microversion: 2.1 time: 0.064771 Jul 26 07:25:25.936719 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 6/12] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Jul 26 07:25:25 2022] GET /compute/v2.1/os-volumes/32948ad8-2438-4d20-88cb-d38cfc93bdea => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 07:25:26.505040 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-91e1a7b3-343e-49a9-ad21-eae7d115b9a8 tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] Calling method '.version_select at 0x7f7f044fa670>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:26.645938 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-91e1a7b3-343e-49a9-ad21-eae7d115b9a8 tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/c1c38534-7468-4637-b7c7-47ae4b20f00f" status: 200 len: 345 microversion: 2.1 time: 0.145048 Jul 26 07:25:26.646515 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 7/13] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Jul 26 07:25:26 2022] GET /compute/v2.1/os-volumes/c1c38534-7468-4637-b7c7-47ae4b20f00f => generated 345 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:25:26.661865 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7690b4f5-4738-42be-bab9-02a2b09a4e75 tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] Action: 'create', calling method: .version_select at 0x7f7f04efdd30>, body: {"snapshot": {"volume_id": "c1c38534-7468-4637-b7c7-47ae4b20f00f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-126083194"}} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:25:26.673277 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-50c1a6d3-e28c-4b6e-a300-2053e4b4519d tempest-VolumesGetTestJSON-447812382 tempest-VolumesGetTestJSON-447812382-project] Calling method '.version_select at 0x7f7f044fae50>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:26.797511 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-50c1a6d3-e28c-4b6e-a300-2053e4b4519d tempest-VolumesGetTestJSON-447812382 tempest-VolumesGetTestJSON-447812382-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/3c80d73d-5dc4-4e6c-8c3c-648a0c8abb50" status: 200 len: 353 microversion: 2.1 time: 0.130167 Jul 26 07:25:26.807623 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 8/14] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Jul 26 07:25:26 2022] GET /compute/v2.1/os-volumes/3c80d73d-5dc4-4e6c-8c3c-648a0c8abb50 => generated 353 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:25:26.813264 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-3280e416-fc5e-4fa7-9837-2c4753c19d99 tempest-VolumesGetTestJSON-447812382 tempest-VolumesGetTestJSON-447812382-project] Calling method '.version_select at 0x7f7f044fa8b0>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:26.916021 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-3280e416-fc5e-4fa7-9837-2c4753c19d99 tempest-VolumesGetTestJSON-447812382 tempest-VolumesGetTestJSON-447812382-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/3c80d73d-5dc4-4e6c-8c3c-648a0c8abb50" status: 200 len: 353 microversion: 2.1 time: 0.106994 Jul 26 07:25:26.930147 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 9/15] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Jul 26 07:25:26 2022] GET /compute/v2.1/os-volumes/3c80d73d-5dc4-4e6c-8c3c-648a0c8abb50 => generated 353 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:25:26.940097 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6d0267b3-cf71-4809-a78f-d65d8a405d09 tempest-VolumesGetTestJSON-447812382 tempest-VolumesGetTestJSON-447812382-project] Calling method '.version_select at 0x7f7f046d6a60>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:27.165404 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7690b4f5-4738-42be-bab9-02a2b09a4e75 tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] 10.222.0.39 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.509214 Jul 26 07:25:27.166544 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 7/16] 10.222.0.39 () {60 vars in 1162 bytes} [Tue Jul 26 07:25:26 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:25:27.178021 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-556a6a6f-8f9a-4177-b9c4-6e6ae35654bb tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] Calling method '.version_select at 0x7f7f044b0040>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:27.362708 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-556a6a6f-8f9a-4177-b9c4-6e6ae35654bb tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/08bf83e8-5f5b-4c45-946b-a0b923d4272a" status: 200 len: 286 microversion: 2.1 time: 0.189381 Jul 26 07:25:27.364038 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 8/17] 10.222.0.39 () {58 vars in 1251 bytes} [Tue Jul 26 07:25:27 2022] GET /compute/v2.1/os-snapshots/08bf83e8-5f5b-4c45-946b-a0b923d4272a => generated 286 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:25:27.377598 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-de8e5ee6-1913-434d-98e3-95bc210ab20b tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] Calling method '.version_select at 0x7f7f044ae9d0>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:27.430014 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6d0267b3-cf71-4809-a78f-d65d8a405d09 tempest-VolumesGetTestJSON-447812382 tempest-VolumesGetTestJSON-447812382-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/3c80d73d-5dc4-4e6c-8c3c-648a0c8abb50" status: 202 len: 0 microversion: 2.1 time: 0.494142 Jul 26 07:25:27.430858 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 10/18] 10.222.0.39 () {58 vars in 1248 bytes} [Tue Jul 26 07:25:26 2022] DELETE /compute/v2.1/os-volumes/3c80d73d-5dc4-4e6c-8c3c-648a0c8abb50 => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 07:25:27.441683 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f75e603f-e1b9-4aba-a4ac-57557886b195 tempest-VolumesGetTestJSON-447812382 tempest-VolumesGetTestJSON-447812382-project] Calling method '.version_select at 0x7f7f044fa160>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:27.522172 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-de8e5ee6-1913-434d-98e3-95bc210ab20b tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.151221 Jul 26 07:25:27.523349 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 9/19] 10.222.0.39 () {58 vars in 1140 bytes} [Tue Jul 26 07:25:27 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:25:27.542694 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ffb56730-02ed-4a40-bccd-77a41f22d722 tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] Calling method '.version_select at 0x7f7f04529ee0>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:27.608820 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f75e603f-e1b9-4aba-a4ac-57557886b195 tempest-VolumesGetTestJSON-447812382 tempest-VolumesGetTestJSON-447812382-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/3c80d73d-5dc4-4e6c-8c3c-648a0c8abb50" status: 200 len: 352 microversion: 2.1 time: 0.172811 Jul 26 07:25:27.610046 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 11/20] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Jul 26 07:25:27 2022] GET /compute/v2.1/os-volumes/3c80d73d-5dc4-4e6c-8c3c-648a0c8abb50 => generated 352 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:25:27.669753 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ffb56730-02ed-4a40-bccd-77a41f22d722 tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/08bf83e8-5f5b-4c45-946b-a0b923d4272a" status: 200 len: 286 microversion: 2.1 time: 0.139073 Jul 26 07:25:27.671047 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 10/21] 10.222.0.39 () {58 vars in 1251 bytes} [Tue Jul 26 07:25:27 2022] GET /compute/v2.1/os-snapshots/08bf83e8-5f5b-4c45-946b-a0b923d4272a => generated 286 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:25:28.629046 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ebabba26-5048-4891-8d60-fc38fb523587 tempest-VolumesGetTestJSON-447812382 tempest-VolumesGetTestJSON-447812382-project] Calling method '.version_select at 0x7f7f044fadc0>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:28.691956 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e467e03d-336d-4b6e-8b6e-76fa627034da tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] Calling method '.version_select at 0x7f7f044b0280>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:28.780113 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ebabba26-5048-4891-8d60-fc38fb523587 tempest-VolumesGetTestJSON-447812382 tempest-VolumesGetTestJSON-447812382-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/3c80d73d-5dc4-4e6c-8c3c-648a0c8abb50" status: 200 len: 352 microversion: 2.1 time: 0.158861 Jul 26 07:25:28.787097 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 12/22] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Jul 26 07:25:28 2022] GET /compute/v2.1/os-volumes/3c80d73d-5dc4-4e6c-8c3c-648a0c8abb50 => generated 352 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:25:28.836428 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e467e03d-336d-4b6e-8b6e-76fa627034da tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/08bf83e8-5f5b-4c45-946b-a0b923d4272a" status: 200 len: 286 microversion: 2.1 time: 0.155754 Jul 26 07:25:28.838013 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 11/23] 10.222.0.39 () {58 vars in 1251 bytes} [Tue Jul 26 07:25:28 2022] GET /compute/v2.1/os-snapshots/08bf83e8-5f5b-4c45-946b-a0b923d4272a => generated 286 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:25:29.804973 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b57f89af-f637-41f8-8a8d-e741a7849291 tempest-VolumesGetTestJSON-447812382 tempest-VolumesGetTestJSON-447812382-project] Calling method '.version_select at 0x7f7f0452a940>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:29.853927 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7f86203e-b9f9-4b42-b081-1f030892c9d1 tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] Calling method '.version_select at 0x7f7f04541ca0>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:29.919742 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b57f89af-f637-41f8-8a8d-e741a7849291 tempest-VolumesGetTestJSON-447812382 tempest-VolumesGetTestJSON-447812382-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/3c80d73d-5dc4-4e6c-8c3c-648a0c8abb50" status: 200 len: 352 microversion: 2.1 time: 0.126993 Jul 26 07:25:29.929246 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7f86203e-b9f9-4b42-b081-1f030892c9d1 tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/08bf83e8-5f5b-4c45-946b-a0b923d4272a" status: 200 len: 286 microversion: 2.1 time: 0.080373 Jul 26 07:25:29.935018 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 12/24] 10.222.0.39 () {58 vars in 1251 bytes} [Tue Jul 26 07:25:29 2022] GET /compute/v2.1/os-snapshots/08bf83e8-5f5b-4c45-946b-a0b923d4272a => generated 286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:25:29.935192 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 13/25] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Jul 26 07:25:29 2022] GET /compute/v2.1/os-volumes/3c80d73d-5dc4-4e6c-8c3c-648a0c8abb50 => generated 352 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:25:30.149661 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-4cafa276-a720-4f92-8627-26910cda11f5 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Action: 'create', calling method: .version_select at 0x7f7f046d5dc0>, body: {"keypair": {"name": "tempest-keypair-785816003", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGb4OWLd/oQu3pxD53sJZFcoJkHWF4gKwkNwKEk0JEqtmSbqXRaXQW0UXvMNy7Um42wUOYjq/rvhKP2m9zA7Z6u0P465DScolZpTzhrZ4WZRgxANRTVt+Fwy4FweO4R8w=="}} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:25:30.205104 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.quota [None req-4cafa276-a720-4f92-8627-26910cda11f5 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Getting quotas for project 4fa0c5574ef9497ebe29658f8164764c. Resources: {'key_pairs'} {{(pid=117715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 07:25:30.223053 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.quota [None req-4cafa276-a720-4f92-8627-26910cda11f5 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Getting quotas for user 57029844165f4d83892176fe82594685 and project 4fa0c5574ef9497ebe29658f8164764c. Resources: {'key_pairs'} {{(pid=117715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 07:25:30.289055 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-4cafa276-a720-4f92-8627-26910cda11f5 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.352398 Jul 26 07:25:30.290467 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 13/26] 10.222.0.39 () {60 vars in 1159 bytes} [Tue Jul 26 07:25:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:25:30.935999 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8a041d37-f07a-4458-bdee-94f0bfc10937 tempest-VolumesGetTestJSON-447812382 tempest-VolumesGetTestJSON-447812382-project] Calling method '.version_select at 0x7f7f04504790>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:30.947719 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e11855ea-4599-4a18-8d68-26e3c8bff446 tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] Calling method '.version_select at 0x7f7f04483ee0>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:31.062478 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.wsgi [None req-8a041d37-f07a-4458-bdee-94f0bfc10937 tempest-VolumesGetTestJSON-447812382 tempest-VolumesGetTestJSON-447812382-project] HTTP exception thrown: Volume 3c80d73d-5dc4-4e6c-8c3c-648a0c8abb50 could not be found. Jul 26 07:25:31.068174 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e11855ea-4599-4a18-8d68-26e3c8bff446 tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/08bf83e8-5f5b-4c45-946b-a0b923d4272a" status: 200 len: 287 microversion: 2.1 time: 0.129742 Jul 26 07:25:31.069598 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 14/27] 10.222.0.39 () {58 vars in 1251 bytes} [Tue Jul 26 07:25:30 2022] GET /compute/v2.1/os-snapshots/08bf83e8-5f5b-4c45-946b-a0b923d4272a => generated 287 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:25:31.070889 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8a041d37-f07a-4458-bdee-94f0bfc10937 tempest-VolumesGetTestJSON-447812382 tempest-VolumesGetTestJSON-447812382-project] Request method failure captured: Jul 26 07:25:31.070889 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: request: GET /compute/v2.1/os-volumes/3c80d73d-5dc4-4e6c-8c3c-648a0c8abb50 HTTP/1.1 Jul 26 07:25:31.070889 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept: application/json Jul 26 07:25:31.070889 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept-Encoding: identity Jul 26 07:25:31.070889 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Connection: close Jul 26 07:25:31.070889 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Length: 0 Jul 26 07:25:31.070889 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Type: application/json Jul 26 07:25:31.070889 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Host: 10.222.0.39 Jul 26 07:25:31.070889 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Openstack-System-Scope: None Jul 26 07:25:31.070889 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: User-Agent: python-urllib3/1.26.10 Jul 26 07:25:31.070889 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Auth-Token: gAAAAABi35biny46bfCrd-VJ2TkENfyNCHw52V575z2FHhwuPRaCIXnxA3usBThZi11EOoGifp81AW_5BlFtcGqgmxDiVOyZcwExXwMipJZ9EsvuZrHq2i7KulSutoFykvp3S6RuT43ZgWilSjikAfblDCJNQfNTeNq_s5h8hXA9yBMLTKRZscg Jul 26 07:25:31.070889 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Id: None Jul 26 07:25:31.070889 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Name: None Jul 26 07:25:31.070889 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Identity-Status: Confirmed Jul 26 07:25:31.070889 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Is-Admin-Project: True Jul 26 07:25:31.070889 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Id: default Jul 26 07:25:31.070889 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Name: Default Jul 26 07:25:31.070889 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Id: cd9ccb653b7d4c7ebc362319c284c1c5 Jul 26 07:25:31.070889 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Name: tempest-VolumesGetTestJSON-447812382 Jul 26 07:25:31.070889 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Role: member,reader Jul 26 07:25:31.070889 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Roles: member,reader Jul 26 07:25:31.072074 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cd9ccb653b7d4c7ebc362319c284c1c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cd9ccb653b7d4c7ebc362319c284c1c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cd9ccb653b7d4c7ebc362319c284c1c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cd9ccb653b7d4c7ebc362319c284c1c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:25:31.072074 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant: tempest-VolumesGetTestJSON-447812382 Jul 26 07:25:31.072074 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Id: cd9ccb653b7d4c7ebc362319c284c1c5 Jul 26 07:25:31.072074 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Name: tempest-VolumesGetTestJSON-447812382 Jul 26 07:25:31.072074 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User: tempest-VolumesGetTestJSON-447812382-project Jul 26 07:25:31.072074 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Id: default Jul 26 07:25:31.072074 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Name: Default Jul 26 07:25:31.072074 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Id: a0d5ec89a5064c43b4eb31ae77565d15 Jul 26 07:25:31.072074 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Name: tempest-VolumesGetTestJSON-447812382-project Jul 26 07:25:31.072074 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: method: Jul 26 07:25:31.072074 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: exception: Volume 3c80d73d-5dc4-4e6c-8c3c-648a0c8abb50 could not be found. Jul 26 07:25:31.072074 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: action_args: {'id': '3c80d73d-5dc4-4e6c-8c3c-648a0c8abb50'} Jul 26 07:25:31.072074 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:25:31.072760 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:31.072760 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 07:25:31.072760 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 07:25:31.072760 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 07:25:31.072760 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 07:25:31.072760 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 07:25:31.072760 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 07:25:31.072760 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 07:25:31.072760 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 07:25:31.072760 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 07:25:31.072760 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 07:25:31.072760 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 07:25:31.072760 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 07:25:31.072760 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 07:25:31.072760 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 07:25:31.072760 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3c80d73d-5dc4-4e6c-8c3c-648a0c8abb50 could not be found. (HTTP 404) (Request-ID: req-969fbfaf-0acc-4a1f-b42f-e7f2bb2a7f80) Jul 26 07:25:31.072760 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:31.072760 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:25:31.072760 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:31.073800 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:31.073800 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 07:25:31.073800 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 07:25:31.073800 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 07:25:31.073800 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 07:25:31.073800 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 07:25:31.073800 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 07:25:31.073800 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 07:25:31.073800 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 07:25:31.073800 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 07:25:31.073800 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 07:25:31.073800 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 07:25:31.073800 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 07:25:31.073800 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 07:25:31.073800 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 07:25:31.073800 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 07:25:31.073800 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 07:25:31.073800 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 07:25:31.073800 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 07:25:31.074820 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 07:25:31.074820 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 07:25:31.074820 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 07:25:31.074820 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 07:25:31.074820 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3c80d73d-5dc4-4e6c-8c3c-648a0c8abb50 could not be found. Jul 26 07:25:31.074820 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:31.074820 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:25:31.074820 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:31.074820 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:31.074820 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:25:31.074820 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:25:31.074820 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:25:31.074820 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:25:31.074820 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 07:25:31.074820 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 07:25:31.074820 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:25:31.074820 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:25:31.074820 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 07:25:31.074820 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:25:31.077129 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3c80d73d-5dc4-4e6c-8c3c-648a0c8abb50 could not be found. Jul 26 07:25:31.077129 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:31.077129 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:25:31.077129 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:31.077129 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:31.077129 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:25:31.077129 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:25:31.077129 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:25:31.077129 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:25:31.077129 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3c80d73d-5dc4-4e6c-8c3c-648a0c8abb50 could not be found. Jul 26 07:25:31.077129 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:31.081857 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8a041d37-f07a-4458-bdee-94f0bfc10937 tempest-VolumesGetTestJSON-447812382 tempest-VolumesGetTestJSON-447812382-project] Returning 404 to user: Volume 3c80d73d-5dc4-4e6c-8c3c-648a0c8abb50 could not be found. {{(pid=117716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:25:31.085798 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8a041d37-f07a-4458-bdee-94f0bfc10937 tempest-VolumesGetTestJSON-447812382 tempest-VolumesGetTestJSON-447812382-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/3c80d73d-5dc4-4e6c-8c3c-648a0c8abb50" status: 404 len: 109 microversion: 2.1 time: 0.154315 Jul 26 07:25:31.087701 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 14/28] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Jul 26 07:25:30 2022] GET /compute/v2.1/os-volumes/3c80d73d-5dc4-4e6c-8c3c-648a0c8abb50 => generated 109 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 07:25:31.089707 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7cb067e4-7a38-446d-8d57-789d11dad9c3 tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] Calling method '.version_select at 0x7f7f03c3b5e0>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:31.254233 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7cb067e4-7a38-446d-8d57-789d11dad9c3 tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] 10.222.0.39 "DELETE /compute/v2.1/os-snapshots/08bf83e8-5f5b-4c45-946b-a0b923d4272a" status: 202 len: 0 microversion: 2.1 time: 0.173883 Jul 26 07:25:31.257591 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 15/29] 10.222.0.39 () {58 vars in 1254 bytes} [Tue Jul 26 07:25:31 2022] DELETE /compute/v2.1/os-snapshots/08bf83e8-5f5b-4c45-946b-a0b923d4272a => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 07:25:31.264624 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-06e79050-7ff9-4fa7-a7e5-39037ff2369c tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] Calling method '.version_select at 0x7f7f044fa940>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:31.400137 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-06e79050-7ff9-4fa7-a7e5-39037ff2369c tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/08bf83e8-5f5b-4c45-946b-a0b923d4272a" status: 200 len: 286 microversion: 2.1 time: 0.139802 Jul 26 07:25:31.405016 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 15/30] 10.222.0.39 () {58 vars in 1251 bytes} [Tue Jul 26 07:25:31 2022] GET /compute/v2.1/os-snapshots/08bf83e8-5f5b-4c45-946b-a0b923d4272a => generated 286 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 07:25:32.419392 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-17cb7b52-0cc5-46a0-8a7d-4567c1d7c5d9 tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] Calling method '.version_select at 0x7f7f03c3bca0>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:32.480046 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.wsgi [None req-17cb7b52-0cc5-46a0-8a7d-4567c1d7c5d9 tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] HTTP exception thrown: Snapshot 08bf83e8-5f5b-4c45-946b-a0b923d4272a could not be found. Jul 26 07:25:32.484832 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-17cb7b52-0cc5-46a0-8a7d-4567c1d7c5d9 tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] Request method failure captured: Jul 26 07:25:32.484832 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: request: GET /compute/v2.1/os-snapshots/08bf83e8-5f5b-4c45-946b-a0b923d4272a HTTP/1.1 Jul 26 07:25:32.484832 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept: application/json Jul 26 07:25:32.484832 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept-Encoding: identity Jul 26 07:25:32.484832 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Connection: close Jul 26 07:25:32.484832 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Length: 0 Jul 26 07:25:32.484832 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Type: application/json Jul 26 07:25:32.484832 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Host: 10.222.0.39 Jul 26 07:25:32.484832 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Openstack-System-Scope: None Jul 26 07:25:32.484832 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: User-Agent: python-urllib3/1.26.10 Jul 26 07:25:32.484832 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Auth-Token: gAAAAABi35biiFw_167kLXF_Ml4uLhzUHWHben69re433FVrGnvIWgoamduVkESvfQ_Axv00fH8YmS0fpLldeWet86YgMWPJb8g4M8_dFABKSpjENAwgEm3MAHRihmgqJpI4TtrquuEkbH_4LqqQVRxYUkOWaPcBWjbBn2dbNzpIlivdXrd0_Dc Jul 26 07:25:32.484832 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Id: None Jul 26 07:25:32.484832 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Name: None Jul 26 07:25:32.484832 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Identity-Status: Confirmed Jul 26 07:25:32.484832 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Is-Admin-Project: True Jul 26 07:25:32.484832 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Id: default Jul 26 07:25:32.484832 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Name: Default Jul 26 07:25:32.484832 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Id: 9c39dec587e24c84b3c9702e177a2dbd Jul 26 07:25:32.484832 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1059653454 Jul 26 07:25:32.484832 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Role: member,reader Jul 26 07:25:32.484832 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Roles: member,reader Jul 26 07:25:32.487027 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9c39dec587e24c84b3c9702e177a2dbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9c39dec587e24c84b3c9702e177a2dbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9c39dec587e24c84b3c9702e177a2dbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9c39dec587e24c84b3c9702e177a2dbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:25:32.487027 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1059653454 Jul 26 07:25:32.487027 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Id: 9c39dec587e24c84b3c9702e177a2dbd Jul 26 07:25:32.487027 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1059653454 Jul 26 07:25:32.487027 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User: tempest-VolumesSnapshotsTestJSON-1059653454-project Jul 26 07:25:32.487027 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Id: default Jul 26 07:25:32.487027 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Name: Default Jul 26 07:25:32.487027 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Id: 1a58299139db4f02beca97cd8feed5f9 Jul 26 07:25:32.487027 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1059653454-project Jul 26 07:25:32.487027 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: method: Jul 26 07:25:32.487027 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: exception: Snapshot 08bf83e8-5f5b-4c45-946b-a0b923d4272a could not be found. Jul 26 07:25:32.487027 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: action_args: {'id': '08bf83e8-5f5b-4c45-946b-a0b923d4272a'} Jul 26 07:25:32.487027 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:25:32.488314 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:32.488314 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 26 07:25:32.488314 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 26 07:25:32.488314 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 26 07:25:32.488314 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 26 07:25:32.488314 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 26 07:25:32.488314 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 26 07:25:32.488314 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 07:25:32.488314 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 07:25:32.488314 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 07:25:32.488314 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 07:25:32.488314 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 07:25:32.488314 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 07:25:32.488314 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 07:25:32.488314 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 07:25:32.488314 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 08bf83e8-5f5b-4c45-946b-a0b923d4272a could not be found. (HTTP 404) (Request-ID: req-e1f6b805-b4ab-407c-868b-10339a0c8825) Jul 26 07:25:32.488314 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:25:32.488314 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:25:32.489960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:25:32.489960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:32.489960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 26 07:25:32.489960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 26 07:25:32.489960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 07:25:32.489960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 07:25:32.489960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 26 07:25:32.489960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 26 07:25:32.489960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 07:25:32.489960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 07:25:32.489960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 26 07:25:32.489960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 26 07:25:32.489960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 26 07:25:32.489960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 26 07:25:32.489960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 26 07:25:32.489960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 26 07:25:32.489960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 07:25:32.489960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 07:25:32.489960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 07:25:32.491894 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 07:25:32.491894 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 07:25:32.491894 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 07:25:32.491894 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 07:25:32.491894 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 07:25:32.491894 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 08bf83e8-5f5b-4c45-946b-a0b923d4272a could not be found. Jul 26 07:25:32.491894 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:25:32.491894 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:25:32.491894 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:25:32.491894 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:32.491894 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:25:32.491894 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:25:32.491894 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:25:32.491894 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:25:32.491894 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 07:25:32.491894 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 07:25:32.491894 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:25:32.491894 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:25:32.491894 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 26 07:25:32.491894 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:25:32.493686 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 08bf83e8-5f5b-4c45-946b-a0b923d4272a could not be found. Jul 26 07:25:32.493686 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:25:32.493686 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:25:32.493686 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:25:32.493686 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:32.493686 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:25:32.493686 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:25:32.493686 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:25:32.493686 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:25:32.493686 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 08bf83e8-5f5b-4c45-946b-a0b923d4272a could not be found. Jul 26 07:25:32.493686 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:25:32.499860 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-17cb7b52-0cc5-46a0-8a7d-4567c1d7c5d9 tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] Returning 404 to user: Snapshot 08bf83e8-5f5b-4c45-946b-a0b923d4272a could not be found. {{(pid=117715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:25:32.502119 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-17cb7b52-0cc5-46a0-8a7d-4567c1d7c5d9 tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/08bf83e8-5f5b-4c45-946b-a0b923d4272a" status: 404 len: 111 microversion: 2.1 time: 0.086697 Jul 26 07:25:32.506935 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 16/31] 10.222.0.39 () {58 vars in 1251 bytes} [Tue Jul 26 07:25:32 2022] GET /compute/v2.1/os-snapshots/08bf83e8-5f5b-4c45-946b-a0b923d4272a => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 07:25:32.514295 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f8dd039b-bc26-4495-b0d5-e1c777f84219 tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] Calling method '.version_select at 0x7f7f044fa9d0>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:32.735660 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f8dd039b-bc26-4495-b0d5-e1c777f84219 tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/c1c38534-7468-4637-b7c7-47ae4b20f00f" status: 202 len: 0 microversion: 2.1 time: 0.226617 Jul 26 07:25:32.739544 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 16/32] 10.222.0.39 () {58 vars in 1248 bytes} [Tue Jul 26 07:25:32 2022] DELETE /compute/v2.1/os-volumes/c1c38534-7468-4637-b7c7-47ae4b20f00f => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 07:25:32.744720 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b2ad34fd-2a8f-40ab-87f7-89c3e3e61120 tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] Calling method '.version_select at 0x7f7f03c3b4c0>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:32.839130 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b2ad34fd-2a8f-40ab-87f7-89c3e3e61120 tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/c1c38534-7468-4637-b7c7-47ae4b20f00f" status: 200 len: 344 microversion: 2.1 time: 0.098280 Jul 26 07:25:32.840163 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 17/33] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Jul 26 07:25:32 2022] GET /compute/v2.1/os-volumes/c1c38534-7468-4637-b7c7-47ae4b20f00f => generated 344 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:25:33.856012 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-77e7acc1-20f0-4eb1-b081-d72d22df4138 tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] Calling method '.version_select at 0x7f7f044fa700>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:34.008791 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-77e7acc1-20f0-4eb1-b081-d72d22df4138 tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/c1c38534-7468-4637-b7c7-47ae4b20f00f" status: 200 len: 344 microversion: 2.1 time: 0.158082 Jul 26 07:25:34.009913 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 17/34] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Jul 26 07:25:33 2022] GET /compute/v2.1/os-volumes/c1c38534-7468-4637-b7c7-47ae4b20f00f => generated 344 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:25:34.723624 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-23457f79-89b9-4c1f-a053-946112d0f3ff tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-765830339", "imageRef": "b9589773-813f-42af-846a-43bcf9d4d002", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4aa6648c-5052-41c3-a55b-aea07445bb59"}], "security_groups": [{"name": "tempest-securitygroup--277530102"}], "key_name": "tempest-keypair-785816003", "user_data": "}} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:25:35.024221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ad67466d-76fa-4a3c-998f-bfe4006fe2aa tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] Calling method '.version_select at 0x7f7f044faca0>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:35.062392 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.network.neutron [None req-23457f79-89b9-4c1f-a053-946112d0f3ff tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] validate_networks() for [('4aa6648c-5052-41c3-a55b-aea07445bb59', None, None, None, None, None)] {{(pid=117715) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 07:25:35.145376 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ad67466d-76fa-4a3c-998f-bfe4006fe2aa tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/c1c38534-7468-4637-b7c7-47ae4b20f00f" status: 200 len: 344 microversion: 2.1 time: 0.126177 Jul 26 07:25:35.146278 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 18/35] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Jul 26 07:25:35 2022] GET /compute/v2.1/os-volumes/c1c38534-7468-4637-b7c7-47ae4b20f00f => generated 344 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 07:25:36.166320 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9c8db0a1-76df-49c8-b686-64e07bfd6454 tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] Calling method '.version_select at 0x7f7f0452a940>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:36.423127 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.wsgi [None req-9c8db0a1-76df-49c8-b686-64e07bfd6454 tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] HTTP exception thrown: Volume c1c38534-7468-4637-b7c7-47ae4b20f00f could not be found. Jul 26 07:25:36.427105 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9c8db0a1-76df-49c8-b686-64e07bfd6454 tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] Request method failure captured: Jul 26 07:25:36.427105 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: request: GET /compute/v2.1/os-volumes/c1c38534-7468-4637-b7c7-47ae4b20f00f HTTP/1.1 Jul 26 07:25:36.427105 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept: application/json Jul 26 07:25:36.427105 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept-Encoding: identity Jul 26 07:25:36.427105 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Connection: close Jul 26 07:25:36.427105 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Length: 0 Jul 26 07:25:36.427105 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Type: application/json Jul 26 07:25:36.427105 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Host: 10.222.0.39 Jul 26 07:25:36.427105 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Openstack-System-Scope: None Jul 26 07:25:36.427105 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: User-Agent: python-urllib3/1.26.10 Jul 26 07:25:36.427105 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Auth-Token: gAAAAABi35biiFw_167kLXF_Ml4uLhzUHWHben69re433FVrGnvIWgoamduVkESvfQ_Axv00fH8YmS0fpLldeWet86YgMWPJb8g4M8_dFABKSpjENAwgEm3MAHRihmgqJpI4TtrquuEkbH_4LqqQVRxYUkOWaPcBWjbBn2dbNzpIlivdXrd0_Dc Jul 26 07:25:36.427105 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Id: None Jul 26 07:25:36.427105 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Name: None Jul 26 07:25:36.427105 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Identity-Status: Confirmed Jul 26 07:25:36.427105 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Is-Admin-Project: True Jul 26 07:25:36.427105 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Id: default Jul 26 07:25:36.427105 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Name: Default Jul 26 07:25:36.427105 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Id: 9c39dec587e24c84b3c9702e177a2dbd Jul 26 07:25:36.427105 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1059653454 Jul 26 07:25:36.427105 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Role: member,reader Jul 26 07:25:36.427105 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Roles: member,reader Jul 26 07:25:36.428221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9c39dec587e24c84b3c9702e177a2dbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9c39dec587e24c84b3c9702e177a2dbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9c39dec587e24c84b3c9702e177a2dbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9c39dec587e24c84b3c9702e177a2dbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:25:36.428221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1059653454 Jul 26 07:25:36.428221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Id: 9c39dec587e24c84b3c9702e177a2dbd Jul 26 07:25:36.428221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1059653454 Jul 26 07:25:36.428221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User: tempest-VolumesSnapshotsTestJSON-1059653454-project Jul 26 07:25:36.428221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Id: default Jul 26 07:25:36.428221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Name: Default Jul 26 07:25:36.428221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Id: 1a58299139db4f02beca97cd8feed5f9 Jul 26 07:25:36.428221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1059653454-project Jul 26 07:25:36.428221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: method: Jul 26 07:25:36.428221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: exception: Volume c1c38534-7468-4637-b7c7-47ae4b20f00f could not be found. Jul 26 07:25:36.428221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: action_args: {'id': 'c1c38534-7468-4637-b7c7-47ae4b20f00f'} Jul 26 07:25:36.428221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:25:36.428858 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:36.428858 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 07:25:36.428858 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 07:25:36.428858 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 07:25:36.428858 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 07:25:36.428858 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 07:25:36.428858 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 07:25:36.428858 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 07:25:36.428858 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 07:25:36.428858 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 07:25:36.428858 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 07:25:36.428858 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 07:25:36.428858 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 07:25:36.428858 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 07:25:36.428858 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 07:25:36.428858 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c1c38534-7468-4637-b7c7-47ae4b20f00f could not be found. (HTTP 404) (Request-ID: req-c20bd3e9-6fda-4d23-a7ce-d2b4c5c821e4) Jul 26 07:25:36.428858 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:36.428858 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:25:36.428858 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:36.429778 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:36.429778 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 07:25:36.429778 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 07:25:36.429778 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 07:25:36.429778 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 07:25:36.429778 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 07:25:36.429778 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 07:25:36.429778 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 07:25:36.429778 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 07:25:36.429778 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 07:25:36.429778 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 07:25:36.429778 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 07:25:36.429778 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 07:25:36.429778 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 07:25:36.429778 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 07:25:36.429778 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 07:25:36.429778 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 07:25:36.429778 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 07:25:36.429778 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 07:25:36.430709 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 07:25:36.430709 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 07:25:36.430709 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 07:25:36.430709 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 07:25:36.430709 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c1c38534-7468-4637-b7c7-47ae4b20f00f could not be found. Jul 26 07:25:36.430709 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:36.430709 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:25:36.430709 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:36.430709 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:36.430709 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:25:36.430709 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:25:36.430709 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:25:36.430709 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:25:36.430709 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 07:25:36.430709 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 07:25:36.430709 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:25:36.430709 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:25:36.430709 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 07:25:36.430709 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:25:36.431583 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c1c38534-7468-4637-b7c7-47ae4b20f00f could not be found. Jul 26 07:25:36.431583 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:36.431583 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:25:36.431583 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:36.431583 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:36.431583 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:25:36.431583 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:25:36.431583 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:25:36.431583 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:25:36.431583 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c1c38534-7468-4637-b7c7-47ae4b20f00f could not be found. Jul 26 07:25:36.431583 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:36.431583 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9c8db0a1-76df-49c8-b686-64e07bfd6454 tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] Returning 404 to user: Volume c1c38534-7468-4637-b7c7-47ae4b20f00f could not be found. {{(pid=117716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:25:36.431583 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-9c8db0a1-76df-49c8-b686-64e07bfd6454 tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/c1c38534-7468-4637-b7c7-47ae4b20f00f" status: 404 len: 109 microversion: 2.1 time: 0.273172 Jul 26 07:25:36.431583 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 19/36] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Jul 26 07:25:36 2022] GET /compute/v2.1/os-volumes/c1c38534-7468-4637-b7c7-47ae4b20f00f => generated 109 bytes in 275 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 07:25:36.632144 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-23457f79-89b9-4c1f-a053-946112d0f3ff tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Flavor limits 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 07:25:36.632653 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-23457f79-89b9-4c1f-a053-946112d0f3ff tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Image limits 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 07:25:36.633477 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-23457f79-89b9-4c1f-a053-946112d0f3ff tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Flavor pref 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 07:25:36.634427 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-23457f79-89b9-4c1f-a053-946112d0f3ff tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Image pref 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 07:25:36.635063 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-23457f79-89b9-4c1f-a053-946112d0f3ff tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 07:25:36.667196 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-23457f79-89b9-4c1f-a053-946112d0f3ff tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:36.667962 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-23457f79-89b9-4c1f-a053-946112d0f3ff tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:36.671717 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-23457f79-89b9-4c1f-a053-946112d0f3ff tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:36.673965 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-23457f79-89b9-4c1f-a053-946112d0f3ff tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:36.777315 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.quota [None req-23457f79-89b9-4c1f-a053-946112d0f3ff tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Getting quotas for project 4fa0c5574ef9497ebe29658f8164764c. Resources: {'instances', 'cores', 'ram'} {{(pid=117715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 07:25:36.785392 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.quota [None req-23457f79-89b9-4c1f-a053-946112d0f3ff tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Getting quotas for user 57029844165f4d83892176fe82594685 and project 4fa0c5574ef9497ebe29658f8164764c. Resources: {'instances', 'cores', 'ram'} {{(pid=117715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 07:25:36.835048 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-23457f79-89b9-4c1f-a053-946112d0f3ff tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Going to run 1 instances... {{(pid=117715) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 07:25:36.841157 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-23457f79-89b9-4c1f-a053-946112d0f3ff tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: c0b50e8b-a23c-4aa8-826e-3e2141006ede] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9589773-813f-42af-846a-43bcf9d4d002',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 07:25:37.037168 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-23457f79-89b9-4c1f-a053-946112d0f3ff tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.320371 Jul 26 07:25:37.039229 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 18/37] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Jul 26 07:25:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 2326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 07:25:37.054400 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-629d552f-eed1-49c5-b9ee-4f1281c90327 tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] Calling method '.version_select at 0x7f7f03b71040>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:37.231829 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.wsgi [None req-629d552f-eed1-49c5-b9ee-4f1281c90327 tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] HTTP exception thrown: Volume c1c38534-7468-4637-b7c7-47ae4b20f00f could not be found. Jul 26 07:25:37.234560 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-629d552f-eed1-49c5-b9ee-4f1281c90327 tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] Request method failure captured: Jul 26 07:25:37.234560 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: request: DELETE /compute/v2.1/os-volumes/c1c38534-7468-4637-b7c7-47ae4b20f00f HTTP/1.1 Jul 26 07:25:37.234560 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept: application/json Jul 26 07:25:37.234560 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept-Encoding: identity Jul 26 07:25:37.234560 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Connection: close Jul 26 07:25:37.234560 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Length: 0 Jul 26 07:25:37.234560 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Type: application/json Jul 26 07:25:37.234560 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Host: 10.222.0.39 Jul 26 07:25:37.234560 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Openstack-System-Scope: None Jul 26 07:25:37.234560 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: User-Agent: python-urllib3/1.26.10 Jul 26 07:25:37.234560 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Auth-Token: gAAAAABi35biiFw_167kLXF_Ml4uLhzUHWHben69re433FVrGnvIWgoamduVkESvfQ_Axv00fH8YmS0fpLldeWet86YgMWPJb8g4M8_dFABKSpjENAwgEm3MAHRihmgqJpI4TtrquuEkbH_4LqqQVRxYUkOWaPcBWjbBn2dbNzpIlivdXrd0_Dc Jul 26 07:25:37.234560 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Id: None Jul 26 07:25:37.234560 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Name: None Jul 26 07:25:37.234560 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Identity-Status: Confirmed Jul 26 07:25:37.234560 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Is-Admin-Project: True Jul 26 07:25:37.234560 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Id: default Jul 26 07:25:37.234560 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Name: Default Jul 26 07:25:37.234560 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Id: 9c39dec587e24c84b3c9702e177a2dbd Jul 26 07:25:37.234560 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1059653454 Jul 26 07:25:37.234560 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Role: member,reader Jul 26 07:25:37.234560 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Roles: member,reader Jul 26 07:25:37.235823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9c39dec587e24c84b3c9702e177a2dbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9c39dec587e24c84b3c9702e177a2dbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9c39dec587e24c84b3c9702e177a2dbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9c39dec587e24c84b3c9702e177a2dbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:25:37.235823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1059653454 Jul 26 07:25:37.235823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Id: 9c39dec587e24c84b3c9702e177a2dbd Jul 26 07:25:37.235823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1059653454 Jul 26 07:25:37.235823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User: tempest-VolumesSnapshotsTestJSON-1059653454-project Jul 26 07:25:37.235823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Id: default Jul 26 07:25:37.235823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Name: Default Jul 26 07:25:37.235823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Id: 1a58299139db4f02beca97cd8feed5f9 Jul 26 07:25:37.235823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1059653454-project Jul 26 07:25:37.235823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: method: Jul 26 07:25:37.235823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: exception: Volume c1c38534-7468-4637-b7c7-47ae4b20f00f could not be found. Jul 26 07:25:37.235823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: action_args: {'id': 'c1c38534-7468-4637-b7c7-47ae4b20f00f'} Jul 26 07:25:37.235823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:25:37.236602 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:37.236602 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 07:25:37.236602 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 07:25:37.236602 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 07:25:37.236602 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 07:25:37.236602 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 07:25:37.236602 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 07:25:37.236602 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 07:25:37.236602 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 07:25:37.236602 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 07:25:37.236602 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 07:25:37.236602 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 07:25:37.236602 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 07:25:37.236602 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 07:25:37.236602 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 07:25:37.236602 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c1c38534-7468-4637-b7c7-47ae4b20f00f could not be found. (HTTP 404) (Request-ID: req-09cdc3e8-8eee-4bc1-b79c-a207916449f9) Jul 26 07:25:37.236602 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:25:37.236602 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:25:37.236602 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:25:37.238263 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:37.238263 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 26 07:25:37.238263 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 26 07:25:37.238263 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 07:25:37.238263 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 07:25:37.238263 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 07:25:37.238263 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 07:25:37.238263 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 07:25:37.238263 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 07:25:37.238263 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 07:25:37.238263 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 07:25:37.238263 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 07:25:37.238263 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 07:25:37.238263 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 07:25:37.238263 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 07:25:37.238263 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 07:25:37.238263 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 07:25:37.238263 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 07:25:37.238263 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 07:25:37.240256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 07:25:37.240256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 07:25:37.240256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 07:25:37.240256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 07:25:37.240256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c1c38534-7468-4637-b7c7-47ae4b20f00f could not be found. Jul 26 07:25:37.240256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:25:37.240256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:25:37.240256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:25:37.240256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:37.240256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:25:37.240256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:25:37.240256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:25:37.240256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:25:37.240256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 07:25:37.240256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 07:25:37.240256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:25:37.240256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:25:37.240256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 26 07:25:37.240256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:25:37.242104 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c1c38534-7468-4637-b7c7-47ae4b20f00f could not be found. Jul 26 07:25:37.242104 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:25:37.242104 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:25:37.242104 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:25:37.242104 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:37.242104 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:25:37.242104 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:25:37.242104 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:25:37.242104 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:25:37.242104 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c1c38534-7468-4637-b7c7-47ae4b20f00f could not be found. Jul 26 07:25:37.242104 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:25:37.242104 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-629d552f-eed1-49c5-b9ee-4f1281c90327 tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] Returning 404 to user: Volume c1c38534-7468-4637-b7c7-47ae4b20f00f could not be found. {{(pid=117715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:25:37.242104 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-629d552f-eed1-49c5-b9ee-4f1281c90327 tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/c1c38534-7468-4637-b7c7-47ae4b20f00f" status: 404 len: 109 microversion: 2.1 time: 0.195547 Jul 26 07:25:37.242104 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 19/38] 10.222.0.39 () {58 vars in 1248 bytes} [Tue Jul 26 07:25:37 2022] DELETE /compute/v2.1/os-volumes/c1c38534-7468-4637-b7c7-47ae4b20f00f => generated 109 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 07:25:37.248084 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6df7f057-969d-4195-9efd-f07abd8c94a1 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:37.250954 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-6df7f057-969d-4195-9efd-f07abd8c94a1 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: c0b50e8b-a23c-4aa8-826e-3e2141006ede] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:25:37.329346 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7831c547-2903-41c9-9930-b35f57ca2ad3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Action: 'create', calling method: .version_select at 0x7f7f0452ae50>, body: {"keypair": {"name": "tempest-keypair-1391012606", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRjY/CHpt0BnDC5IWLLhMNW+I7xWRqPePKttcf0zqA8EZrBbxLFTRSmMpT9Hv/+kjlSbVIge1S6v4l7jEtdDAhlb8ika0wTr9SevzLG0OeI2gozhE/aBkea75KznvGNUA=="}} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:25:37.515175 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.quota [None req-7831c547-2903-41c9-9930-b35f57ca2ad3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Getting quotas for project 0874292e3f8f4db98adc2b9672f840c4. Resources: {'key_pairs'} {{(pid=117716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 07:25:37.544866 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.quota [None req-7831c547-2903-41c9-9930-b35f57ca2ad3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Getting quotas for user 08c4ec6a688c4608aa75aaf046933eec and project 0874292e3f8f4db98adc2b9672f840c4. Resources: {'key_pairs'} {{(pid=117716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 07:25:37.622443 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-6df7f057-969d-4195-9efd-f07abd8c94a1 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:25:37.660280 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7831c547-2903-41c9-9930-b35f57ca2ad3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.228964 Jul 26 07:25:37.662150 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 20/39] 10.222.0.39 () {62 vars in 1200 bytes} [Tue Jul 26 07:25:36 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1232 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 07:25:37.667522 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ad5648a5-fe4b-44b4-a829-9e064b83481a tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] Calling method '.version_select at 0x7f7f0442f8b0>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:37.684972 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6df7f057-969d-4195-9efd-f07abd8c94a1 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede" status: 200 len: 1240 microversion: 2.1 time: 0.447351 Jul 26 07:25:37.691752 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 20/40] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:25:37 2022] GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede => generated 1240 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:25:38.109615 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.wsgi [None req-ad5648a5-fe4b-44b4-a829-9e064b83481a tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] HTTP exception thrown: Volume c1c38534-7468-4637-b7c7-47ae4b20f00f could not be found. Jul 26 07:25:38.114182 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ad5648a5-fe4b-44b4-a829-9e064b83481a tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] Request method failure captured: Jul 26 07:25:38.114182 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: request: GET /compute/v2.1/os-volumes/c1c38534-7468-4637-b7c7-47ae4b20f00f HTTP/1.1 Jul 26 07:25:38.114182 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept: application/json Jul 26 07:25:38.114182 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept-Encoding: identity Jul 26 07:25:38.114182 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Connection: close Jul 26 07:25:38.114182 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Length: 0 Jul 26 07:25:38.114182 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Type: application/json Jul 26 07:25:38.114182 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Host: 10.222.0.39 Jul 26 07:25:38.114182 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Openstack-System-Scope: None Jul 26 07:25:38.114182 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: User-Agent: python-urllib3/1.26.10 Jul 26 07:25:38.114182 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Auth-Token: gAAAAABi35biiFw_167kLXF_Ml4uLhzUHWHben69re433FVrGnvIWgoamduVkESvfQ_Axv00fH8YmS0fpLldeWet86YgMWPJb8g4M8_dFABKSpjENAwgEm3MAHRihmgqJpI4TtrquuEkbH_4LqqQVRxYUkOWaPcBWjbBn2dbNzpIlivdXrd0_Dc Jul 26 07:25:38.114182 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Id: None Jul 26 07:25:38.114182 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Name: None Jul 26 07:25:38.114182 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Identity-Status: Confirmed Jul 26 07:25:38.114182 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Is-Admin-Project: True Jul 26 07:25:38.114182 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Id: default Jul 26 07:25:38.114182 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Name: Default Jul 26 07:25:38.114182 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Id: 9c39dec587e24c84b3c9702e177a2dbd Jul 26 07:25:38.114182 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1059653454 Jul 26 07:25:38.114182 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Role: member,reader Jul 26 07:25:38.114182 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Roles: member,reader Jul 26 07:25:38.115455 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9c39dec587e24c84b3c9702e177a2dbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9c39dec587e24c84b3c9702e177a2dbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9c39dec587e24c84b3c9702e177a2dbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9c39dec587e24c84b3c9702e177a2dbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:25:38.115455 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1059653454 Jul 26 07:25:38.115455 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Id: 9c39dec587e24c84b3c9702e177a2dbd Jul 26 07:25:38.115455 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1059653454 Jul 26 07:25:38.115455 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User: tempest-VolumesSnapshotsTestJSON-1059653454-project Jul 26 07:25:38.115455 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Id: default Jul 26 07:25:38.115455 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Name: Default Jul 26 07:25:38.115455 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Id: 1a58299139db4f02beca97cd8feed5f9 Jul 26 07:25:38.115455 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1059653454-project Jul 26 07:25:38.115455 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: method: Jul 26 07:25:38.115455 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: exception: Volume c1c38534-7468-4637-b7c7-47ae4b20f00f could not be found. Jul 26 07:25:38.115455 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: action_args: {'id': 'c1c38534-7468-4637-b7c7-47ae4b20f00f'} Jul 26 07:25:38.115455 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:25:38.116103 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:38.116103 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 07:25:38.116103 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 07:25:38.116103 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 07:25:38.116103 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 07:25:38.116103 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 07:25:38.116103 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 07:25:38.116103 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 07:25:38.116103 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 07:25:38.116103 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 07:25:38.116103 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 07:25:38.116103 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 07:25:38.116103 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 07:25:38.116103 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 07:25:38.116103 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 07:25:38.116103 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c1c38534-7468-4637-b7c7-47ae4b20f00f could not be found. (HTTP 404) (Request-ID: req-6b43a7f2-4c4a-4fd9-a9e6-2a6aa007b569) Jul 26 07:25:38.116103 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:38.116103 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:25:38.116103 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:38.117024 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:38.117024 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 07:25:38.117024 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 07:25:38.117024 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 07:25:38.117024 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 07:25:38.117024 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 07:25:38.117024 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 07:25:38.117024 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 07:25:38.117024 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 07:25:38.117024 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 07:25:38.117024 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 07:25:38.117024 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 07:25:38.117024 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 07:25:38.117024 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 07:25:38.117024 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 07:25:38.117024 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 07:25:38.117024 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 07:25:38.117024 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 07:25:38.117024 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 07:25:38.117979 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 07:25:38.117979 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 07:25:38.117979 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 07:25:38.117979 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 07:25:38.117979 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c1c38534-7468-4637-b7c7-47ae4b20f00f could not be found. Jul 26 07:25:38.117979 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:38.117979 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:25:38.117979 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:38.117979 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:38.117979 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:25:38.117979 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:25:38.117979 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:25:38.117979 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:25:38.117979 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 07:25:38.117979 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 07:25:38.117979 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:25:38.117979 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:25:38.117979 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 07:25:38.117979 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:25:38.118930 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c1c38534-7468-4637-b7c7-47ae4b20f00f could not be found. Jul 26 07:25:38.118930 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:38.118930 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:25:38.118930 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:38.118930 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:25:38.118930 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:25:38.118930 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:25:38.118930 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:25:38.118930 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:25:38.118930 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c1c38534-7468-4637-b7c7-47ae4b20f00f could not be found. Jul 26 07:25:38.118930 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:25:38.123124 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ad5648a5-fe4b-44b4-a829-9e064b83481a tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] Returning 404 to user: Volume c1c38534-7468-4637-b7c7-47ae4b20f00f could not be found. {{(pid=117716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:25:38.125005 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ad5648a5-fe4b-44b4-a829-9e064b83481a tempest-VolumesSnapshotsTestJSON-1059653454 tempest-VolumesSnapshotsTestJSON-1059653454-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/c1c38534-7468-4637-b7c7-47ae4b20f00f" status: 404 len: 109 microversion: 2.1 time: 0.461003 Jul 26 07:25:38.126058 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 21/41] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Jul 26 07:25:37 2022] GET /compute/v2.1/os-volumes/c1c38534-7468-4637-b7c7-47ae4b20f00f => generated 109 bytes in 463 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 07:25:38.718439 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-dd90f247-65db-4f86-acd6-5e30e506eec3 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:38.719068 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-dd90f247-65db-4f86-acd6-5e30e506eec3 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: c0b50e8b-a23c-4aa8-826e-3e2141006ede] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:25:38.930740 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-dd90f247-65db-4f86-acd6-5e30e506eec3 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:25:38.942240 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-dd90f247-65db-4f86-acd6-5e30e506eec3 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede" status: 200 len: 1240 microversion: 2.1 time: 0.228807 Jul 26 07:25:38.948388 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 21/42] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:25:38 2022] GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede => generated 1240 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:25:39.967499 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-73e22af9-e6c8-481d-899c-cc4ea6bd9c1b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:39.968275 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-73e22af9-e6c8-481d-899c-cc4ea6bd9c1b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: c0b50e8b-a23c-4aa8-826e-3e2141006ede] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:25:40.011963 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-73e22af9-e6c8-481d-899c-cc4ea6bd9c1b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:40.012451 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-73e22af9-e6c8-481d-899c-cc4ea6bd9c1b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:40.017885 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-73e22af9-e6c8-481d-899c-cc4ea6bd9c1b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:40.018354 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-73e22af9-e6c8-481d-899c-cc4ea6bd9c1b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:41.114919 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-73e22af9-e6c8-481d-899c-cc4ea6bd9c1b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:25:41.157900 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-73e22af9-e6c8-481d-899c-cc4ea6bd9c1b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede" status: 200 len: 1244 microversion: 2.1 time: 1.188324 Jul 26 07:25:41.165148 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 22/43] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:25:39 2022] GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede => generated 1244 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:25:41.772966 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-cd5230ec-e601-4eb5-8667-4ca66b18b57e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-897668458", "imageRef": "b9589773-813f-42af-846a-43bcf9d4d002", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:25:41.971852 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.network.neutron [None req-cd5230ec-e601-4eb5-8667-4ca66b18b57e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] validate_networks() for [('ddc42cf1-1b0a-4f4c-8ce7-024cddb60ad4', None, None, None, None, None)] {{(pid=117715) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 07:25:42.175758 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c3a5dd42-2578-4ea8-830e-1306e128a83f tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1070347702", "imageRef": "b9589773-813f-42af-846a-43bcf9d4d002", "flavorRef": "452", "networks": [{"uuid": "f4d1f13d-b7b3-49ee-8e97-b860cec918d8"}]}} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:25:42.361233 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.network.neutron [None req-c3a5dd42-2578-4ea8-830e-1306e128a83f tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] validate_networks() for [('f4d1f13d-b7b3-49ee-8e97-b860cec918d8', None, None, None, None, None)] {{(pid=117716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 07:25:45.258329 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-cd5230ec-e601-4eb5-8667-4ca66b18b57e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Flavor limits 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 07:25:45.259123 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-cd5230ec-e601-4eb5-8667-4ca66b18b57e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Image limits 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 07:25:45.259710 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-cd5230ec-e601-4eb5-8667-4ca66b18b57e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Flavor pref 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 07:25:45.260245 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-cd5230ec-e601-4eb5-8667-4ca66b18b57e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Image pref 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 07:25:45.260751 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-cd5230ec-e601-4eb5-8667-4ca66b18b57e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 07:25:45.295432 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cd5230ec-e601-4eb5-8667-4ca66b18b57e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:45.296169 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cd5230ec-e601-4eb5-8667-4ca66b18b57e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:45.298809 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cd5230ec-e601-4eb5-8667-4ca66b18b57e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:45.304102 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cd5230ec-e601-4eb5-8667-4ca66b18b57e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:45.400554 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.quota [None req-cd5230ec-e601-4eb5-8667-4ca66b18b57e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Getting quotas for project 02e545f0c2784698a35cd8dcb1b02395. Resources: {'instances', 'cores', 'ram'} {{(pid=117715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 07:25:45.410468 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.quota [None req-cd5230ec-e601-4eb5-8667-4ca66b18b57e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Getting quotas for user 886151888fc84ccf890d609ba62da9e1 and project 02e545f0c2784698a35cd8dcb1b02395. Resources: {'instances', 'cores', 'ram'} {{(pid=117715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 07:25:45.443104 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-cd5230ec-e601-4eb5-8667-4ca66b18b57e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Going to run 1 instances... {{(pid=117715) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 07:25:45.452906 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-cd5230ec-e601-4eb5-8667-4ca66b18b57e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9589773-813f-42af-846a-43bcf9d4d002',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 07:25:45.637199 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-cd5230ec-e601-4eb5-8667-4ca66b18b57e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.824905 Jul 26 07:25:45.645406 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 22/44] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Jul 26 07:25:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 4828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 07:25:45.645406 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3608a7c4-aaac-4c5d-9c91-a49fec5cc7ac tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:45.665579 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3608a7c4-aaac-4c5d-9c91-a49fec5cc7ac tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: c0b50e8b-a23c-4aa8-826e-3e2141006ede] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:25:45.692148 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3608a7c4-aaac-4c5d-9c91-a49fec5cc7ac tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:45.692846 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3608a7c4-aaac-4c5d-9c91-a49fec5cc7ac tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:45.693929 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3608a7c4-aaac-4c5d-9c91-a49fec5cc7ac tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:45.696628 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3608a7c4-aaac-4c5d-9c91-a49fec5cc7ac tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:46.360281 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3608a7c4-aaac-4c5d-9c91-a49fec5cc7ac tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:25:46.407988 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3608a7c4-aaac-4c5d-9c91-a49fec5cc7ac tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede" status: 200 len: 1298 microversion: 2.1 time: 0.764863 Jul 26 07:25:46.410356 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 23/45] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:25:45 2022] GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede => generated 1298 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:25:46.426392 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-03a2ebfd-e1e1-43de-8556-98b20f779185 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:46.428831 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-03a2ebfd-e1e1-43de-8556-98b20f779185 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:25:46.583112 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-c3a5dd42-2578-4ea8-830e-1306e128a83f tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Flavor limits 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 07:25:46.584862 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-c3a5dd42-2578-4ea8-830e-1306e128a83f tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Image limits 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 07:25:46.585784 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-c3a5dd42-2578-4ea8-830e-1306e128a83f tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Flavor pref 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 07:25:46.586434 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-c3a5dd42-2578-4ea8-830e-1306e128a83f tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Image pref 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 07:25:46.586998 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-c3a5dd42-2578-4ea8-830e-1306e128a83f tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 07:25:46.620072 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c3a5dd42-2578-4ea8-830e-1306e128a83f tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:46.622382 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c3a5dd42-2578-4ea8-830e-1306e128a83f tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:46.631211 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c3a5dd42-2578-4ea8-830e-1306e128a83f tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:46.637070 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c3a5dd42-2578-4ea8-830e-1306e128a83f tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:46.771254 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.quota [None req-c3a5dd42-2578-4ea8-830e-1306e128a83f tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Getting quotas for project 500111b9c9ca4d8893e64c488668a491. Resources: {'instances', 'cores', 'ram'} {{(pid=117716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 07:25:46.788417 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.quota [None req-c3a5dd42-2578-4ea8-830e-1306e128a83f tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Getting quotas for user 8fdc64e58cb041f98d9ea4b8c8cd9e60 and project 500111b9c9ca4d8893e64c488668a491. Resources: {'instances', 'cores', 'ram'} {{(pid=117716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 07:25:46.864638 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c3a5dd42-2578-4ea8-830e-1306e128a83f tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Going to run 1 instances... {{(pid=117716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 07:25:46.872807 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c3a5dd42-2578-4ea8-830e-1306e128a83f tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] [instance: b0c489bd-8ed2-4284-b712-9e5829c3fb66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9589773-813f-42af-846a-43bcf9d4d002',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 07:25:47.176937 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c3a5dd42-2578-4ea8-830e-1306e128a83f tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.302389 Jul 26 07:25:47.177588 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 23/46] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Jul 26 07:25:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 5304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 07:25:47.200622 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-992ef12e-b33d-4d7e-887a-5ff11ac9792e tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:47.202818 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-992ef12e-b33d-4d7e-887a-5ff11ac9792e tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] [instance: b0c489bd-8ed2-4284-b712-9e5829c3fb66] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:25:47.312211 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-03a2ebfd-e1e1-43de-8556-98b20f779185 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:25:47.329654 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-03a2ebfd-e1e1-43de-8556-98b20f779185 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669" status: 200 len: 1221 microversion: 2.1 time: 0.914349 Jul 26 07:25:47.331765 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 24/47] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:25:46 2022] GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669 => generated 1221 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:25:47.431386 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-4d89789d-c39b-4a6d-81da-fb04a902c58a tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:47.436541 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-4d89789d-c39b-4a6d-81da-fb04a902c58a tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: c0b50e8b-a23c-4aa8-826e-3e2141006ede] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:25:47.448587 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4d89789d-c39b-4a6d-81da-fb04a902c58a tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:47.453305 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4d89789d-c39b-4a6d-81da-fb04a902c58a tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:47.456806 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4d89789d-c39b-4a6d-81da-fb04a902c58a tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:47.458668 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4d89789d-c39b-4a6d-81da-fb04a902c58a tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:47.648570 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-992ef12e-b33d-4d7e-887a-5ff11ac9792e tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc64e58cb041f98d9ea4b8c8cd9e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500111b9c9ca4d8893e64c488668a491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:25:47.691408 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-992ef12e-b33d-4d7e-887a-5ff11ac9792e tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66" status: 200 len: 1215 microversion: 2.1 time: 0.502061 Jul 26 07:25:47.692098 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 24/48] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:25:47 2022] GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66 => generated 1215 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:25:47.728361 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2dfa8fc4-1eb9-4bb4-b115-d695f62fd62a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-98524251", "imageRef": "b9589773-813f-42af-846a-43bcf9d4d002", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:25:48.001543 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.network.neutron [None req-2dfa8fc4-1eb9-4bb4-b115-d695f62fd62a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] validate_networks() for [('ddc42cf1-1b0a-4f4c-8ce7-024cddb60ad4', None, None, None, None, None)] {{(pid=117716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 07:25:48.187975 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-4d89789d-c39b-4a6d-81da-fb04a902c58a tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:25:48.206999 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-4d89789d-c39b-4a6d-81da-fb04a902c58a tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede" status: 200 len: 1298 microversion: 2.1 time: 0.779679 Jul 26 07:25:48.229490 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 25/49] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:25:47 2022] GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede => generated 1298 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:25:48.719137 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-325fc0f3-f81c-4575-9051-a8d2544f5e98 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:48.720839 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-325fc0f3-f81c-4575-9051-a8d2544f5e98 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] [instance: b0c489bd-8ed2-4284-b712-9e5829c3fb66] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:25:49.075266 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-325fc0f3-f81c-4575-9051-a8d2544f5e98 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc64e58cb041f98d9ea4b8c8cd9e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500111b9c9ca4d8893e64c488668a491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:25:49.113921 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-325fc0f3-f81c-4575-9051-a8d2544f5e98 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66" status: 200 len: 1215 microversion: 2.1 time: 0.398560 Jul 26 07:25:49.138750 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 26/50] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:25:48 2022] GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66 => generated 1215 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:25:49.234024 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-21947102-a1ed-4a1f-83e4-861a47db4fc8 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:49.234791 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-21947102-a1ed-4a1f-83e4-861a47db4fc8 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: c0b50e8b-a23c-4aa8-826e-3e2141006ede] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:25:49.256089 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-21947102-a1ed-4a1f-83e4-861a47db4fc8 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:49.256463 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-21947102-a1ed-4a1f-83e4-861a47db4fc8 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:49.257312 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-21947102-a1ed-4a1f-83e4-861a47db4fc8 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:49.257787 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-21947102-a1ed-4a1f-83e4-861a47db4fc8 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:50.848205 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-21947102-a1ed-4a1f-83e4-861a47db4fc8 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:25:50.856981 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-21947102-a1ed-4a1f-83e4-861a47db4fc8 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede" status: 200 len: 1365 microversion: 2.1 time: 1.627590 Jul 26 07:25:50.865702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 27/51] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:25:49 2022] GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede => generated 1365 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:25:50.878915 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c2c50b24-123d-434a-8398-bc0eb913df66 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-635923662", "imageRef": "b9589773-813f-42af-846a-43bcf9d4d002", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3eb2f1c7-e108-4848-b461-2e7a2b4e4128"}], "security_groups": [{"name": "tempest-securitygroup--2075449500"}], "key_name": "tempest-keypair-1391012606", "user_data": "}} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:25:51.620286 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.network.neutron [None req-c2c50b24-123d-434a-8398-bc0eb913df66 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] validate_networks() for [('3eb2f1c7-e108-4848-b461-2e7a2b4e4128', None, None, None, None, None)] {{(pid=117715) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 07:25:53.054893 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-2dfa8fc4-1eb9-4bb4-b115-d695f62fd62a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Flavor limits 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 07:25:53.056070 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-2dfa8fc4-1eb9-4bb4-b115-d695f62fd62a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Image limits 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 07:25:53.057493 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-2dfa8fc4-1eb9-4bb4-b115-d695f62fd62a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Flavor pref 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 07:25:53.058816 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-2dfa8fc4-1eb9-4bb4-b115-d695f62fd62a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Image pref 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 07:25:53.059444 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-2dfa8fc4-1eb9-4bb4-b115-d695f62fd62a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 07:25:53.084047 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2dfa8fc4-1eb9-4bb4-b115-d695f62fd62a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:53.084792 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2dfa8fc4-1eb9-4bb4-b115-d695f62fd62a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:53.088991 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2dfa8fc4-1eb9-4bb4-b115-d695f62fd62a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:53.090214 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2dfa8fc4-1eb9-4bb4-b115-d695f62fd62a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:53.166189 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.quota [None req-2dfa8fc4-1eb9-4bb4-b115-d695f62fd62a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Getting quotas for project 02e545f0c2784698a35cd8dcb1b02395. Resources: {'instances', 'cores', 'ram'} {{(pid=117716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 07:25:53.174539 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.quota [None req-2dfa8fc4-1eb9-4bb4-b115-d695f62fd62a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Getting quotas for user 886151888fc84ccf890d609ba62da9e1 and project 02e545f0c2784698a35cd8dcb1b02395. Resources: {'instances', 'cores', 'ram'} {{(pid=117716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 07:25:53.236795 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2dfa8fc4-1eb9-4bb4-b115-d695f62fd62a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Going to run 1 instances... {{(pid=117716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 07:25:53.239398 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2dfa8fc4-1eb9-4bb4-b115-d695f62fd62a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9589773-813f-42af-846a-43bcf9d4d002',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 07:25:53.357070 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-c2c50b24-123d-434a-8398-bc0eb913df66 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Flavor limits 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 07:25:53.357848 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-c2c50b24-123d-434a-8398-bc0eb913df66 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Image limits 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 07:25:53.361227 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-c2c50b24-123d-434a-8398-bc0eb913df66 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Flavor pref 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 07:25:53.361882 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-c2c50b24-123d-434a-8398-bc0eb913df66 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Image pref 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 07:25:53.362144 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-c2c50b24-123d-434a-8398-bc0eb913df66 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 07:25:53.370821 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=7 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:25:53.381880 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell0:SELECT=25 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:25:53.401046 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2dfa8fc4-1eb9-4bb4-b115-d695f62fd62a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.707822 Jul 26 07:25:53.402382 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c2c50b24-123d-434a-8398-bc0eb913df66 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:53.404997 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c2c50b24-123d-434a-8398-bc0eb913df66 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:53.405973 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c2c50b24-123d-434a-8398-bc0eb913df66 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:53.406425 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c2c50b24-123d-434a-8398-bc0eb913df66 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:53.408229 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 25/52] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Jul 26 07:25:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 5715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 07:25:53.413396 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6223a446-6bc2-4681-ad79-c1b3651e735d tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:53.419668 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6223a446-6bc2-4681-ad79-c1b3651e735d tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] [instance: b0c489bd-8ed2-4284-b712-9e5829c3fb66] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:25:53.450880 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6223a446-6bc2-4681-ad79-c1b3651e735d tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:53.451699 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6223a446-6bc2-4681-ad79-c1b3651e735d tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:53.452749 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6223a446-6bc2-4681-ad79-c1b3651e735d tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:53.453410 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6223a446-6bc2-4681-ad79-c1b3651e735d tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:53.541325 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.quota [None req-c2c50b24-123d-434a-8398-bc0eb913df66 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Getting quotas for project 0874292e3f8f4db98adc2b9672f840c4. Resources: {'instances', 'cores', 'ram'} {{(pid=117715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 07:25:53.570674 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.quota [None req-c2c50b24-123d-434a-8398-bc0eb913df66 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Getting quotas for user 08c4ec6a688c4608aa75aaf046933eec and project 0874292e3f8f4db98adc2b9672f840c4. Resources: {'instances', 'cores', 'ram'} {{(pid=117715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 07:25:53.617481 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c2c50b24-123d-434a-8398-bc0eb913df66 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Going to run 1 instances... {{(pid=117715) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 07:25:53.620078 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c2c50b24-123d-434a-8398-bc0eb913df66 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9589773-813f-42af-846a-43bcf9d4d002',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 07:25:53.710760 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c2c50b24-123d-434a-8398-bc0eb913df66 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.843561 Jul 26 07:25:53.713482 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 28/53] 10.222.0.39 () {62 vars in 1188 bytes} [Tue Jul 26 07:25:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 2847 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 07:25:53.724102 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b71cc1af-18c7-4ab1-b519-365ad74c5954 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:53.727742 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b71cc1af-18c7-4ab1-b519-365ad74c5954 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: c0b50e8b-a23c-4aa8-826e-3e2141006ede] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:25:53.743976 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b71cc1af-18c7-4ab1-b519-365ad74c5954 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:53.745374 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b71cc1af-18c7-4ab1-b519-365ad74c5954 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:53.746770 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b71cc1af-18c7-4ab1-b519-365ad74c5954 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:53.747262 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b71cc1af-18c7-4ab1-b519-365ad74c5954 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:54.019057 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6223a446-6bc2-4681-ad79-c1b3651e735d tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc64e58cb041f98d9ea4b8c8cd9e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500111b9c9ca4d8893e64c488668a491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:25:54.034311 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6223a446-6bc2-4681-ad79-c1b3651e735d tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66" status: 200 len: 1273 microversion: 2.1 time: 0.622489 Jul 26 07:25:54.070487 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 26/54] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:25:53 2022] GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66 => generated 1273 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:25:54.088146 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ea5d6abe-998c-4b30-8cd9-a25ee422447e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:54.088765 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ea5d6abe-998c-4b30-8cd9-a25ee422447e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:25:54.927864 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ea5d6abe-998c-4b30-8cd9-a25ee422447e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:25:54.950487 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ea5d6abe-998c-4b30-8cd9-a25ee422447e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1220 microversion: 2.1 time: 0.873001 Jul 26 07:25:54.953845 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 27/55] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:25:54 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1220 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:25:54.964370 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f9a60de3-e6b6-4491-9af4-faf23a8d4f53 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:54.973502 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-f9a60de3-e6b6-4491-9af4-faf23a8d4f53 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:25:55.015369 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f9a60de3-e6b6-4491-9af4-faf23a8d4f53 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:55.016272 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f9a60de3-e6b6-4491-9af4-faf23a8d4f53 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:55.017488 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f9a60de3-e6b6-4491-9af4-faf23a8d4f53 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:55.020403 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f9a60de3-e6b6-4491-9af4-faf23a8d4f53 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:55.178697 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-b71cc1af-18c7-4ab1-b519-365ad74c5954 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:25:55.206351 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b71cc1af-18c7-4ab1-b519-365ad74c5954 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede" status: 200 len: 1365 microversion: 2.1 time: 1.487485 Jul 26 07:25:55.207089 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 29/56] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:25:53 2022] GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede => generated 1365 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:25:55.248033 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-68da2c34-8f71-4101-bd68-a0719e079127 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:55.253966 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-68da2c34-8f71-4101-bd68-a0719e079127 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] [instance: b0c489bd-8ed2-4284-b712-9e5829c3fb66] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:25:55.282434 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-68da2c34-8f71-4101-bd68-a0719e079127 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:55.287076 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-68da2c34-8f71-4101-bd68-a0719e079127 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:55.288712 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-68da2c34-8f71-4101-bd68-a0719e079127 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:55.292515 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-68da2c34-8f71-4101-bd68-a0719e079127 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:55.385377 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-f9a60de3-e6b6-4491-9af4-faf23a8d4f53 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:25:55.399358 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-f9a60de3-e6b6-4491-9af4-faf23a8d4f53 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:25:55.403922 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-f9a60de3-e6b6-4491-9af4-faf23a8d4f53 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:25:55.410537 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f9a60de3-e6b6-4491-9af4-faf23a8d4f53 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1285 microversion: 2.20 time: 0.450740 Jul 26 07:25:55.411570 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 28/57] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:25:54 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1285 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:25:55.565585 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-68da2c34-8f71-4101-bd68-a0719e079127 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc64e58cb041f98d9ea4b8c8cd9e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500111b9c9ca4d8893e64c488668a491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:25:55.585320 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-68da2c34-8f71-4101-bd68-a0719e079127 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66" status: 200 len: 1273 microversion: 2.1 time: 0.362325 Jul 26 07:25:55.589286 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 30/58] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:25:55 2022] GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66 => generated 1273 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:25:55.973119 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-560aa3df-5275-493a-8596-b0a617d27df1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:55.973764 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-560aa3df-5275-493a-8596-b0a617d27df1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:25:55.984403 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-560aa3df-5275-493a-8596-b0a617d27df1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:55.986950 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-560aa3df-5275-493a-8596-b0a617d27df1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:55.989114 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-560aa3df-5275-493a-8596-b0a617d27df1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:55.995520 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-560aa3df-5275-493a-8596-b0a617d27df1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:56.227793 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-560aa3df-5275-493a-8596-b0a617d27df1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:25:56.249291 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-560aa3df-5275-493a-8596-b0a617d27df1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1280 microversion: 2.1 time: 0.267906 Jul 26 07:25:56.252870 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 29/59] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:25:55 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1280 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:25:56.274243 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6b2803cb-c59d-4041-85c7-c9aaf06dee34 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:56.274871 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6b2803cb-c59d-4041-85c7-c9aaf06dee34 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: c0b50e8b-a23c-4aa8-826e-3e2141006ede] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:25:56.330651 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6b2803cb-c59d-4041-85c7-c9aaf06dee34 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:56.331128 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6b2803cb-c59d-4041-85c7-c9aaf06dee34 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:56.331900 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6b2803cb-c59d-4041-85c7-c9aaf06dee34 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:56.332344 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6b2803cb-c59d-4041-85c7-c9aaf06dee34 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:56.398381 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-cdb0552e-cf05-4142-b5d9-a4f76a61fe89 req-e099e595-ae8d-4b68-8ad4-24d123d5f200 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0b50e8b-a23c-4aa8-826e-3e2141006ede", "tag": "f69a186f-e6f8-40ec-a78d-a7da3701a72b"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:25:56.447917 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-cdb0552e-cf05-4142-b5d9-a4f76a61fe89 req-e099e595-ae8d-4b68-8ad4-24d123d5f200 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:56.448373 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-cdb0552e-cf05-4142-b5d9-a4f76a61fe89 req-e099e595-ae8d-4b68-8ad4-24d123d5f200 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:56.563094 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-cdb0552e-cf05-4142-b5d9-a4f76a61fe89 req-e099e595-ae8d-4b68-8ad4-24d123d5f200 service nova] Creating event network-changed:f69a186f-e6f8-40ec-a78d-a7da3701a72b for instance c0b50e8b-a23c-4aa8-826e-3e2141006ede on hv-cinder-85083 Jul 26 07:25:56.563094 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-cdb0552e-cf05-4142-b5d9-a4f76a61fe89 req-e099e595-ae8d-4b68-8ad4-24d123d5f200 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117715) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 07:25:56.567941 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8dba16d7-d059-41fc-a169-730b9a03e594 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:56.568446 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8dba16d7-d059-41fc-a169-730b9a03e594 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:56.572433 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8dba16d7-d059-41fc-a169-730b9a03e594 None None] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:56.575456 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8dba16d7-d059-41fc-a169-730b9a03e594 None None] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:56.618188 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.compute.rpcapi [None req-8dba16d7-d059-41fc-a169-730b9a03e594 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 26 07:25:56.620101 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8dba16d7-d059-41fc-a169-730b9a03e594 None None] Releasing lock "compute-rpcapi-router" {{(pid=117715) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 07:25:56.662468 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8dba16d7-d059-41fc-a169-730b9a03e594 None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.656900 Jul 26 07:25:56.663095 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 31/60] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 07:25:56.681308 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8bf3eb64-cd88-407d-95fb-dedc2b77a01e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:56.694262 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8bf3eb64-cd88-407d-95fb-dedc2b77a01e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:25:56.709465 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8bf3eb64-cd88-407d-95fb-dedc2b77a01e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:56.718175 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8bf3eb64-cd88-407d-95fb-dedc2b77a01e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:56.719713 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8bf3eb64-cd88-407d-95fb-dedc2b77a01e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:56.720322 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8bf3eb64-cd88-407d-95fb-dedc2b77a01e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:57.741614 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8bf3eb64-cd88-407d-95fb-dedc2b77a01e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:25:57.760934 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8bf3eb64-cd88-407d-95fb-dedc2b77a01e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:25:57.763618 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8bf3eb64-cd88-407d-95fb-dedc2b77a01e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:25:57.767085 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8bf3eb64-cd88-407d-95fb-dedc2b77a01e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1341 microversion: 2.20 time: 1.102338 Jul 26 07:25:57.786842 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 32/61] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:25:56 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1341 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:25:57.799457 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-091fdc28-f4e5-4b73-b0a4-4cf0e34bcdfc tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:57.801117 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-091fdc28-f4e5-4b73-b0a4-4cf0e34bcdfc tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] [instance: b0c489bd-8ed2-4284-b712-9e5829c3fb66] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:25:57.811944 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-091fdc28-f4e5-4b73-b0a4-4cf0e34bcdfc tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:57.813035 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-091fdc28-f4e5-4b73-b0a4-4cf0e34bcdfc tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:57.815627 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-091fdc28-f4e5-4b73-b0a4-4cf0e34bcdfc tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:57.819741 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-091fdc28-f4e5-4b73-b0a4-4cf0e34bcdfc tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:58.662195 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6b2803cb-c59d-4041-85c7-c9aaf06dee34 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:25:58.679553 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6b2803cb-c59d-4041-85c7-c9aaf06dee34 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede" status: 200 len: 1365 microversion: 2.1 time: 2.425482 Jul 26 07:25:58.683713 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 30/62] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:25:56 2022] GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede => generated 1365 bytes in 2430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:25:58.712353 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-99f39d52-efbd-4a36-94cb-4fdb31eea8dc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:58.715619 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-99f39d52-efbd-4a36-94cb-4fdb31eea8dc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:25:58.732267 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-99f39d52-efbd-4a36-94cb-4fdb31eea8dc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:58.733006 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-99f39d52-efbd-4a36-94cb-4fdb31eea8dc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:58.734017 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-99f39d52-efbd-4a36-94cb-4fdb31eea8dc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:58.738378 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-99f39d52-efbd-4a36-94cb-4fdb31eea8dc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:59.077320 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-091fdc28-f4e5-4b73-b0a4-4cf0e34bcdfc tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc64e58cb041f98d9ea4b8c8cd9e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500111b9c9ca4d8893e64c488668a491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:25:59.098238 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-091fdc28-f4e5-4b73-b0a4-4cf0e34bcdfc tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66" status: 200 len: 1315 microversion: 2.1 time: 1.305678 Jul 26 07:25:59.100552 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 33/63] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:25:57 2022] GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66 => generated 1315 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:25:59.118993 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-dac4a68f-3ecd-4357-9836-444d56623e99 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:59.120934 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-dac4a68f-3ecd-4357-9836-444d56623e99 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:25:59.141123 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dac4a68f-3ecd-4357-9836-444d56623e99 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:59.143199 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dac4a68f-3ecd-4357-9836-444d56623e99 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:59.145764 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dac4a68f-3ecd-4357-9836-444d56623e99 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:59.147618 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dac4a68f-3ecd-4357-9836-444d56623e99 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:59.269725 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-99f39d52-efbd-4a36-94cb-4fdb31eea8dc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:25:59.279256 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-99f39d52-efbd-4a36-94cb-4fdb31eea8dc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1278 microversion: 2.1 time: 0.580352 Jul 26 07:25:59.280014 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 31/64] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:25:58 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1278 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:25:59.377527 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-dac4a68f-3ecd-4357-9836-444d56623e99 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:25:59.395053 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-dac4a68f-3ecd-4357-9836-444d56623e99 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:25:59.396984 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-dac4a68f-3ecd-4357-9836-444d56623e99 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:25:59.399786 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-dac4a68f-3ecd-4357-9836-444d56623e99 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1339 microversion: 2.20 time: 0.296292 Jul 26 07:25:59.400572 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 34/65] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:25:59 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1339 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:25:59.705078 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f8ce278f-4cf6-4d52-925a-85d09e2311d7 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:25:59.706374 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-f8ce278f-4cf6-4d52-925a-85d09e2311d7 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: c0b50e8b-a23c-4aa8-826e-3e2141006ede] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:25:59.723254 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f8ce278f-4cf6-4d52-925a-85d09e2311d7 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:59.723884 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f8ce278f-4cf6-4d52-925a-85d09e2311d7 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:25:59.724861 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f8ce278f-4cf6-4d52-925a-85d09e2311d7 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:25:59.725444 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f8ce278f-4cf6-4d52-925a-85d09e2311d7 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:00.122762 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-147ea6d6-25ad-4879-86c0-f4bda701e732 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:00.123452 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-147ea6d6-25ad-4879-86c0-f4bda701e732 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] [instance: b0c489bd-8ed2-4284-b712-9e5829c3fb66] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:00.133649 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-147ea6d6-25ad-4879-86c0-f4bda701e732 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:00.135660 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-147ea6d6-25ad-4879-86c0-f4bda701e732 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:00.140607 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-147ea6d6-25ad-4879-86c0-f4bda701e732 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:00.143097 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-147ea6d6-25ad-4879-86c0-f4bda701e732 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:00.613947 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-f8ce278f-4cf6-4d52-925a-85d09e2311d7 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:00.626221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f8ce278f-4cf6-4d52-925a-85d09e2311d7 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede" status: 200 len: 1365 microversion: 2.1 time: 0.923252 Jul 26 07:26:00.627551 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 32/66] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:25:59 2022] GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede => generated 1365 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:00.658773 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-1b39ad6e-2ceb-4cbb-af56-4878bfea54d6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:00.661806 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-1b39ad6e-2ceb-4cbb-af56-4878bfea54d6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:00.680096 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1b39ad6e-2ceb-4cbb-af56-4878bfea54d6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:00.680574 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1b39ad6e-2ceb-4cbb-af56-4878bfea54d6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:00.681393 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1b39ad6e-2ceb-4cbb-af56-4878bfea54d6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:00.681887 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1b39ad6e-2ceb-4cbb-af56-4878bfea54d6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:00.874133 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-147ea6d6-25ad-4879-86c0-f4bda701e732 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc64e58cb041f98d9ea4b8c8cd9e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500111b9c9ca4d8893e64c488668a491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:00.882323 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-147ea6d6-25ad-4879-86c0-f4bda701e732 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66" status: 200 len: 1315 microversion: 2.1 time: 0.763647 Jul 26 07:26:00.883337 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 35/67] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:00 2022] GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66 => generated 1315 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:00.888755 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-86c04f04-0a71-400a-a0e2-769ab0c41c97 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:00.889433 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-86c04f04-0a71-400a-a0e2-769ab0c41c97 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:00.895662 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-86c04f04-0a71-400a-a0e2-769ab0c41c97 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:00.896336 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-86c04f04-0a71-400a-a0e2-769ab0c41c97 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:00.897253 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-86c04f04-0a71-400a-a0e2-769ab0c41c97 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:00.897971 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-86c04f04-0a71-400a-a0e2-769ab0c41c97 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:00.991717 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-86c04f04-0a71-400a-a0e2-769ab0c41c97 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:01.001943 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-86c04f04-0a71-400a-a0e2-769ab0c41c97 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:01.003897 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-86c04f04-0a71-400a-a0e2-769ab0c41c97 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:01.005271 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-86c04f04-0a71-400a-a0e2-769ab0c41c97 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1339 microversion: 2.20 time: 0.120858 Jul 26 07:26:01.006515 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 36/68] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:26:00 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1339 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:26:01.231736 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-1b39ad6e-2ceb-4cbb-af56-4878bfea54d6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:01.243854 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-1b39ad6e-2ceb-4cbb-af56-4878bfea54d6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1320 microversion: 2.1 time: 0.608063 Jul 26 07:26:01.250711 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 33/69] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:00 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1320 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:01.396837 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-03a5c406-4d5d-4561-b4c5-32e4cd2e4661 req-623da872-b164-4297-8c9d-acf108bf5af6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80da1213-270f-4afc-87f8-345874caa669", "tag": "a592fd67-f5f8-4a93-bb6f-f2ff436180bf"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:26:01.416110 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-03a5c406-4d5d-4561-b4c5-32e4cd2e4661 req-623da872-b164-4297-8c9d-acf108bf5af6 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:01.418485 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-03a5c406-4d5d-4561-b4c5-32e4cd2e4661 req-623da872-b164-4297-8c9d-acf108bf5af6 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:01.446994 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-03a5c406-4d5d-4561-b4c5-32e4cd2e4661 req-623da872-b164-4297-8c9d-acf108bf5af6 service nova] Creating event network-changed:a592fd67-f5f8-4a93-bb6f-f2ff436180bf for instance 80da1213-270f-4afc-87f8-345874caa669 on hv-cinder-85083 Jul 26 07:26:01.458767 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-03a5c406-4d5d-4561-b4c5-32e4cd2e4661 req-623da872-b164-4297-8c9d-acf108bf5af6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.293462 Jul 26 07:26:01.459560 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 37/70] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 07:26:01.659299 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b6628b52-60ee-4173-a41b-7bebbe31a4be tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:01.659299 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-b6628b52-60ee-4173-a41b-7bebbe31a4be tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: c0b50e8b-a23c-4aa8-826e-3e2141006ede] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:01.672749 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b6628b52-60ee-4173-a41b-7bebbe31a4be tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:01.673316 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b6628b52-60ee-4173-a41b-7bebbe31a4be tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:01.675175 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b6628b52-60ee-4173-a41b-7bebbe31a4be tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:01.677170 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b6628b52-60ee-4173-a41b-7bebbe31a4be tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:01.905068 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-bff70a6e-e4b8-48b3-81b1-59017612d096 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:01.906085 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-bff70a6e-e4b8-48b3-81b1-59017612d096 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] [instance: b0c489bd-8ed2-4284-b712-9e5829c3fb66] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:01.928048 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bff70a6e-e4b8-48b3-81b1-59017612d096 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:01.928510 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bff70a6e-e4b8-48b3-81b1-59017612d096 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:01.929302 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bff70a6e-e4b8-48b3-81b1-59017612d096 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:01.929726 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bff70a6e-e4b8-48b3-81b1-59017612d096 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:02.609779 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-bff70a6e-e4b8-48b3-81b1-59017612d096 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc64e58cb041f98d9ea4b8c8cd9e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500111b9c9ca4d8893e64c488668a491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:02.622322 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-bff70a6e-e4b8-48b3-81b1-59017612d096 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66" status: 200 len: 1315 microversion: 2.1 time: 0.721277 Jul 26 07:26:02.623265 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 38/71] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:01 2022] GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66 => generated 1315 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:26:02.633820 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-2d8a56b4-67a7-4708-8734-1df6f62fe5b4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:02.634421 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2d8a56b4-67a7-4708-8734-1df6f62fe5b4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:02.659577 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2d8a56b4-67a7-4708-8734-1df6f62fe5b4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:02.660232 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2d8a56b4-67a7-4708-8734-1df6f62fe5b4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:02.661194 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2d8a56b4-67a7-4708-8734-1df6f62fe5b4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:02.662074 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2d8a56b4-67a7-4708-8734-1df6f62fe5b4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:02.738993 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-b6628b52-60ee-4173-a41b-7bebbe31a4be tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:02.746197 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=57 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:26:02.749939 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b6628b52-60ee-4173-a41b-7bebbe31a4be tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede" status: 200 len: 1365 microversion: 2.1 time: 1.096843 Jul 26 07:26:02.750521 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 34/72] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:01 2022] GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede => generated 1365 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:02.756504 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-25a2da2d-a6e9-4208-a2f0-dfb082ba1182 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:02.757265 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-25a2da2d-a6e9-4208-a2f0-dfb082ba1182 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:02.764084 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=7 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:26:02.766055 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-25a2da2d-a6e9-4208-a2f0-dfb082ba1182 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:02.766672 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-25a2da2d-a6e9-4208-a2f0-dfb082ba1182 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:02.767735 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-25a2da2d-a6e9-4208-a2f0-dfb082ba1182 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:02.768266 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-25a2da2d-a6e9-4208-a2f0-dfb082ba1182 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:03.029569 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2d8a56b4-67a7-4708-8734-1df6f62fe5b4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:03.032680 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=83 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:26:03.064549 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2d8a56b4-67a7-4708-8734-1df6f62fe5b4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:03.114999 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2d8a56b4-67a7-4708-8734-1df6f62fe5b4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:03.116201 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-2d8a56b4-67a7-4708-8734-1df6f62fe5b4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1407 microversion: 2.20 time: 0.491940 Jul 26 07:26:03.116778 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 39/73] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:26:02 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1407 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:26:03.121721 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell0:SELECT=4 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:26:03.536078 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-42cc7de3-42ae-4265-b152-a1981a48e668 req-207d1cc9-7d90-4d05-b59a-879a194c2de0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e85830f-4d1d-4386-89f0-dbe72ad75089", "tag": "527d5b48-4c6b-40c4-95e8-b8d39da61a3d"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:26:03.582970 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-42cc7de3-42ae-4265-b152-a1981a48e668 req-207d1cc9-7d90-4d05-b59a-879a194c2de0 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:03.583419 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-42cc7de3-42ae-4265-b152-a1981a48e668 req-207d1cc9-7d90-4d05-b59a-879a194c2de0 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:03.612143 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell0:SELECT=5 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:26:03.657875 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-42cc7de3-42ae-4265-b152-a1981a48e668 req-207d1cc9-7d90-4d05-b59a-879a194c2de0 service nova] Creating event network-changed:527d5b48-4c6b-40c4-95e8-b8d39da61a3d for instance 9e85830f-4d1d-4386-89f0-dbe72ad75089 on hv-cinder-85083 Jul 26 07:26:03.667830 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-42cc7de3-42ae-4265-b152-a1981a48e668 req-207d1cc9-7d90-4d05-b59a-879a194c2de0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145753 Jul 26 07:26:03.668455 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 40/74] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 07:26:03.694499 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-70690ed2-5781-4e16-8ca0-42640a23c0b8 req-f6175c24-9169-4896-97a9-6ca7dcccd4a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c489bd-8ed2-4284-b712-9e5829c3fb66", "tag": "05c14532-a11a-489d-a874-d92188546d35"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:26:03.740376 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-70690ed2-5781-4e16-8ca0-42640a23c0b8 req-f6175c24-9169-4896-97a9-6ca7dcccd4a5 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:03.743474 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-70690ed2-5781-4e16-8ca0-42640a23c0b8 req-f6175c24-9169-4896-97a9-6ca7dcccd4a5 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:03.798201 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-70690ed2-5781-4e16-8ca0-42640a23c0b8 req-f6175c24-9169-4896-97a9-6ca7dcccd4a5 service nova] Creating event network-changed:05c14532-a11a-489d-a874-d92188546d35 for instance b0c489bd-8ed2-4284-b712-9e5829c3fb66 on hv-cinder-85083 Jul 26 07:26:03.813135 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-70690ed2-5781-4e16-8ca0-42640a23c0b8 req-f6175c24-9169-4896-97a9-6ca7dcccd4a5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141207 Jul 26 07:26:03.815263 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 41/75] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:26:03.822196 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-18de71fa-dc5c-4674-a532-cb7574850f58 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:03.823161 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-18de71fa-dc5c-4674-a532-cb7574850f58 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] [instance: b0c489bd-8ed2-4284-b712-9e5829c3fb66] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:03.831114 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-18de71fa-dc5c-4674-a532-cb7574850f58 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:03.832195 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-18de71fa-dc5c-4674-a532-cb7574850f58 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:03.833133 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-18de71fa-dc5c-4674-a532-cb7574850f58 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:03.833711 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-18de71fa-dc5c-4674-a532-cb7574850f58 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:04.188516 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-18de71fa-dc5c-4674-a532-cb7574850f58 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc64e58cb041f98d9ea4b8c8cd9e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500111b9c9ca4d8893e64c488668a491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:04.198231 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-18de71fa-dc5c-4674-a532-cb7574850f58 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66" status: 200 len: 1315 microversion: 2.1 time: 0.381492 Jul 26 07:26:04.206378 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 42/76] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:03 2022] GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66 => generated 1315 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:04.223585 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7f8e7ec3-6d74-4196-9dda-7739204a6893 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:04.228155 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7f8e7ec3-6d74-4196-9dda-7739204a6893 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: c0b50e8b-a23c-4aa8-826e-3e2141006ede] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:04.251991 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7f8e7ec3-6d74-4196-9dda-7739204a6893 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:04.252904 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7f8e7ec3-6d74-4196-9dda-7739204a6893 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:04.253871 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7f8e7ec3-6d74-4196-9dda-7739204a6893 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:04.254653 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7f8e7ec3-6d74-4196-9dda-7739204a6893 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:04.255004 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-25a2da2d-a6e9-4208-a2f0-dfb082ba1182 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:04.289702 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-25a2da2d-a6e9-4208-a2f0-dfb082ba1182 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1320 microversion: 2.1 time: 1.537905 Jul 26 07:26:04.299452 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 35/77] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:02 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1320 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:04.319885 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-13c67958-507c-4d0e-b956-da4eef329b71 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:04.323264 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-13c67958-507c-4d0e-b956-da4eef329b71 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:04.345024 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-13c67958-507c-4d0e-b956-da4eef329b71 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:04.345974 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-13c67958-507c-4d0e-b956-da4eef329b71 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:04.350189 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-13c67958-507c-4d0e-b956-da4eef329b71 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:04.350882 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-13c67958-507c-4d0e-b956-da4eef329b71 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:04.768870 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7f8e7ec3-6d74-4196-9dda-7739204a6893 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:04.793144 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7f8e7ec3-6d74-4196-9dda-7739204a6893 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede" status: 200 len: 1365 microversion: 2.1 time: 0.582979 Jul 26 07:26:04.803288 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 43/78] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:04 2022] GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede => generated 1365 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:04.964470 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-13c67958-507c-4d0e-b956-da4eef329b71 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:05.018612 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell0:SELECT=20 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:26:05.035605 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-13c67958-507c-4d0e-b956-da4eef329b71 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:05.037103 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-13c67958-507c-4d0e-b956-da4eef329b71 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:05.038333 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-13c67958-507c-4d0e-b956-da4eef329b71 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1407 microversion: 2.20 time: 0.737207 Jul 26 07:26:05.039050 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 36/79] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:26:04 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1407 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:26:05.234370 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-59600c9c-105f-435e-8b66-c47e2563357e tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:05.235332 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-59600c9c-105f-435e-8b66-c47e2563357e tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] [instance: b0c489bd-8ed2-4284-b712-9e5829c3fb66] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:05.254987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-59600c9c-105f-435e-8b66-c47e2563357e tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:05.257931 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-59600c9c-105f-435e-8b66-c47e2563357e tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:05.258959 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-59600c9c-105f-435e-8b66-c47e2563357e tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:05.261246 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-59600c9c-105f-435e-8b66-c47e2563357e tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:05.326692 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7d3064b3-37e4-46ec-ba34-fc53c55b5347 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:05.327987 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7d3064b3-37e4-46ec-ba34-fc53c55b5347 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:05.339023 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7d3064b3-37e4-46ec-ba34-fc53c55b5347 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:05.341086 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7d3064b3-37e4-46ec-ba34-fc53c55b5347 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:05.343898 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7d3064b3-37e4-46ec-ba34-fc53c55b5347 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:05.345713 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7d3064b3-37e4-46ec-ba34-fc53c55b5347 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:05.667182 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-59600c9c-105f-435e-8b66-c47e2563357e tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc64e58cb041f98d9ea4b8c8cd9e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500111b9c9ca4d8893e64c488668a491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:05.675034 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-59600c9c-105f-435e-8b66-c47e2563357e tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66" status: 200 len: 1315 microversion: 2.1 time: 0.448615 Jul 26 07:26:05.675624 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 44/80] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:05 2022] GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66 => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:05.817784 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-817417a4-b886-4276-a663-74f18409f38d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:05.830295 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-817417a4-b886-4276-a663-74f18409f38d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: c0b50e8b-a23c-4aa8-826e-3e2141006ede] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:05.860990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-817417a4-b886-4276-a663-74f18409f38d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:05.861393 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-817417a4-b886-4276-a663-74f18409f38d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:05.873961 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-817417a4-b886-4276-a663-74f18409f38d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:05.876043 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-817417a4-b886-4276-a663-74f18409f38d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:06.006410 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7d3064b3-37e4-46ec-ba34-fc53c55b5347 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:06.021322 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7d3064b3-37e4-46ec-ba34-fc53c55b5347 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1320 microversion: 2.1 time: 0.698384 Jul 26 07:26:06.023803 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 37/81] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:05 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1320 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:06.029102 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-7b9dd821-430a-4ad8-a2d5-75b1dcd0b9dc req-2b56ad8c-b952-4b8b-82b0-b992b73fd255 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "990571a8-aa04-4aac-921c-cf071eca1dd0", "tag": "06f98651-1a4f-4f3c-a886-1d5aad025305"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:26:06.050307 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-7b9dd821-430a-4ad8-a2d5-75b1dcd0b9dc req-2b56ad8c-b952-4b8b-82b0-b992b73fd255 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:06.051020 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-7b9dd821-430a-4ad8-a2d5-75b1dcd0b9dc req-2b56ad8c-b952-4b8b-82b0-b992b73fd255 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:06.074842 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-7b9dd821-430a-4ad8-a2d5-75b1dcd0b9dc req-2b56ad8c-b952-4b8b-82b0-b992b73fd255 service nova] Creating event network-changed:06f98651-1a4f-4f3c-a886-1d5aad025305 for instance 990571a8-aa04-4aac-921c-cf071eca1dd0 on hv-cinder-85083 Jul 26 07:26:06.075659 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-7b9dd821-430a-4ad8-a2d5-75b1dcd0b9dc req-2b56ad8c-b952-4b8b-82b0-b992b73fd255 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117716) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 07:26:06.077374 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fd651738-687a-4b75-83ee-92d661cc2335 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:06.077986 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fd651738-687a-4b75-83ee-92d661cc2335 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:06.079094 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fd651738-687a-4b75-83ee-92d661cc2335 None None] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:06.079747 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fd651738-687a-4b75-83ee-92d661cc2335 None None] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:06.092308 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.compute.rpcapi [None req-fd651738-687a-4b75-83ee-92d661cc2335 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 26 07:26:06.093285 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fd651738-687a-4b75-83ee-92d661cc2335 None None] Releasing lock "compute-rpcapi-router" {{(pid=117716) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 07:26:06.120031 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-fd651738-687a-4b75-83ee-92d661cc2335 None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094384 Jul 26 07:26:06.120733 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 38/82] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:26:06.129553 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-1b469ad4-bd22-47ea-9439-85fb8e2dc8ae tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:06.131630 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-1b469ad4-bd22-47ea-9439-85fb8e2dc8ae tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:06.135265 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-817417a4-b886-4276-a663-74f18409f38d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:06.139279 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1b469ad4-bd22-47ea-9439-85fb8e2dc8ae tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:06.140168 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1b469ad4-bd22-47ea-9439-85fb8e2dc8ae tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:06.141335 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1b469ad4-bd22-47ea-9439-85fb8e2dc8ae tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:06.141974 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1b469ad4-bd22-47ea-9439-85fb8e2dc8ae tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:06.163545 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-817417a4-b886-4276-a663-74f18409f38d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede" status: 200 len: 1365 microversion: 2.1 time: 0.352327 Jul 26 07:26:06.179551 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 45/83] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:05 2022] GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede => generated 1365 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:06.514922 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-4a7d2403-0a14-4c81-b43e-861cc54d72f9 req-3a729336-2a73-4105-ad5e-df36bf8d86e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0b50e8b-a23c-4aa8-826e-3e2141006ede", "name": "network-vif-plugged", "status": "completed", "tag": "f69a186f-e6f8-40ec-a78d-a7da3701a72b"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:26:06.529113 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-4a7d2403-0a14-4c81-b43e-861cc54d72f9 req-3a729336-2a73-4105-ad5e-df36bf8d86e9 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:06.529113 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-4a7d2403-0a14-4c81-b43e-861cc54d72f9 req-3a729336-2a73-4105-ad5e-df36bf8d86e9 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:06.547915 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-4a7d2403-0a14-4c81-b43e-861cc54d72f9 req-3a729336-2a73-4105-ad5e-df36bf8d86e9 service nova] Creating event network-vif-plugged:f69a186f-e6f8-40ec-a78d-a7da3701a72b for instance c0b50e8b-a23c-4aa8-826e-3e2141006ede on hv-cinder-85083 Jul 26 07:26:06.564413 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-4a7d2403-0a14-4c81-b43e-861cc54d72f9 req-3a729336-2a73-4105-ad5e-df36bf8d86e9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156552 Jul 26 07:26:06.565647 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 46/84] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 07:26:06.697659 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell0:SELECT=8 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:26:06.707459 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-2d2ada01-00e4-4d3f-88a0-23de03daafb3 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:06.710650 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2d2ada01-00e4-4d3f-88a0-23de03daafb3 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] [instance: b0c489bd-8ed2-4284-b712-9e5829c3fb66] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:06.727818 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2d2ada01-00e4-4d3f-88a0-23de03daafb3 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:06.730126 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2d2ada01-00e4-4d3f-88a0-23de03daafb3 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:06.732483 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2d2ada01-00e4-4d3f-88a0-23de03daafb3 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:06.734816 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2d2ada01-00e4-4d3f-88a0-23de03daafb3 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:06.899776 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-1b469ad4-bd22-47ea-9439-85fb8e2dc8ae tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:06.912538 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-1b469ad4-bd22-47ea-9439-85fb8e2dc8ae tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:06.915886 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-1b469ad4-bd22-47ea-9439-85fb8e2dc8ae tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:06.917075 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-1b469ad4-bd22-47ea-9439-85fb8e2dc8ae tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1407 microversion: 2.20 time: 0.794816 Jul 26 07:26:06.917652 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 39/85] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:26:06 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1407 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:26:07.020531 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2d2ada01-00e4-4d3f-88a0-23de03daafb3 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc64e58cb041f98d9ea4b8c8cd9e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500111b9c9ca4d8893e64c488668a491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:07.034222 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-2d2ada01-00e4-4d3f-88a0-23de03daafb3 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66" status: 200 len: 1315 microversion: 2.1 time: 0.339975 Jul 26 07:26:07.050561 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 47/86] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:06 2022] GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66 => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:07.055292 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-5f82f0d5-ec42-4414-bc0d-d906e76f3264 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:07.058161 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-5f82f0d5-ec42-4414-bc0d-d906e76f3264 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:07.074168 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5f82f0d5-ec42-4414-bc0d-d906e76f3264 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:07.076423 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5f82f0d5-ec42-4414-bc0d-d906e76f3264 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:07.079038 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5f82f0d5-ec42-4414-bc0d-d906e76f3264 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:07.079883 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5f82f0d5-ec42-4414-bc0d-d906e76f3264 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:07.186828 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-18073d30-9d55-4ae8-ae18-38d4a2a33c4f tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:07.187512 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-18073d30-9d55-4ae8-ae18-38d4a2a33c4f tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: c0b50e8b-a23c-4aa8-826e-3e2141006ede] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:07.201226 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-18073d30-9d55-4ae8-ae18-38d4a2a33c4f tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:07.202648 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-18073d30-9d55-4ae8-ae18-38d4a2a33c4f tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:07.208247 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-18073d30-9d55-4ae8-ae18-38d4a2a33c4f tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:07.209406 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-18073d30-9d55-4ae8-ae18-38d4a2a33c4f tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:07.694101 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-18073d30-9d55-4ae8-ae18-38d4a2a33c4f tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:07.702678 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-18073d30-9d55-4ae8-ae18-38d4a2a33c4f tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede" status: 200 len: 1365 microversion: 2.1 time: 0.522104 Jul 26 07:26:07.718256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 48/87] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:07 2022] GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede => generated 1365 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:07.947089 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-2e040df4-214d-4f8e-8be0-b0f963257829 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:07.948236 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2e040df4-214d-4f8e-8be0-b0f963257829 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:07.960075 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2e040df4-214d-4f8e-8be0-b0f963257829 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:07.960459 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2e040df4-214d-4f8e-8be0-b0f963257829 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:07.961243 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2e040df4-214d-4f8e-8be0-b0f963257829 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:07.961919 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2e040df4-214d-4f8e-8be0-b0f963257829 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:08.047473 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-5f82f0d5-ec42-4414-bc0d-d906e76f3264 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:08.060499 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-5f82f0d5-ec42-4414-bc0d-d906e76f3264 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1320 microversion: 2.1 time: 1.015840 Jul 26 07:26:08.064292 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 40/88] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:07 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1320 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:08.071448 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-37b4439f-ed4e-4de6-8eb2-7041621de9e5 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:08.075253 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-37b4439f-ed4e-4de6-8eb2-7041621de9e5 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] [instance: b0c489bd-8ed2-4284-b712-9e5829c3fb66] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:08.093702 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-37b4439f-ed4e-4de6-8eb2-7041621de9e5 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:08.096762 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-37b4439f-ed4e-4de6-8eb2-7041621de9e5 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:08.097634 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-37b4439f-ed4e-4de6-8eb2-7041621de9e5 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:08.098134 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-37b4439f-ed4e-4de6-8eb2-7041621de9e5 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:08.244828 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2e040df4-214d-4f8e-8be0-b0f963257829 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:08.255963 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2e040df4-214d-4f8e-8be0-b0f963257829 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:08.257523 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2e040df4-214d-4f8e-8be0-b0f963257829 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:08.264918 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-2e040df4-214d-4f8e-8be0-b0f963257829 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1407 microversion: 2.20 time: 0.321914 Jul 26 07:26:08.279467 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 49/89] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:26:07 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1407 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:26:08.730014 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-56da67e7-a792-4417-a746-0c57bb637b9b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:08.730990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-56da67e7-a792-4417-a746-0c57bb637b9b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: c0b50e8b-a23c-4aa8-826e-3e2141006ede] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:08.741047 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-56da67e7-a792-4417-a746-0c57bb637b9b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:08.741811 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-56da67e7-a792-4417-a746-0c57bb637b9b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:08.743690 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-56da67e7-a792-4417-a746-0c57bb637b9b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:08.756638 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-56da67e7-a792-4417-a746-0c57bb637b9b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:08.772538 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-37b4439f-ed4e-4de6-8eb2-7041621de9e5 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc64e58cb041f98d9ea4b8c8cd9e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500111b9c9ca4d8893e64c488668a491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:08.794491 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-37b4439f-ed4e-4de6-8eb2-7041621de9e5 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66" status: 200 len: 1315 microversion: 2.1 time: 0.728482 Jul 26 07:26:08.795119 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 41/90] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:08 2022] GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66 => generated 1315 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:08.978289 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-56da67e7-a792-4417-a746-0c57bb637b9b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:08.986574 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-56da67e7-a792-4417-a746-0c57bb637b9b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede" status: 200 len: 1365 microversion: 2.1 time: 0.260939 Jul 26 07:26:08.987364 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 50/91] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:08 2022] GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede => generated 1365 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:26:09.082402 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-5b0fa1da-7828-4084-be61-3a8ab2fa0a3e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:09.083017 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-5b0fa1da-7828-4084-be61-3a8ab2fa0a3e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:09.089496 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5b0fa1da-7828-4084-be61-3a8ab2fa0a3e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:09.090010 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5b0fa1da-7828-4084-be61-3a8ab2fa0a3e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:09.090947 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5b0fa1da-7828-4084-be61-3a8ab2fa0a3e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:09.091533 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5b0fa1da-7828-4084-be61-3a8ab2fa0a3e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:09.288917 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-87f058a8-013b-47aa-8a5b-fc07f4e89963 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:09.289446 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-87f058a8-013b-47aa-8a5b-fc07f4e89963 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:09.295759 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-87f058a8-013b-47aa-8a5b-fc07f4e89963 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:09.296480 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-87f058a8-013b-47aa-8a5b-fc07f4e89963 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:09.297588 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-87f058a8-013b-47aa-8a5b-fc07f4e89963 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:09.298332 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-87f058a8-013b-47aa-8a5b-fc07f4e89963 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:09.460173 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-87f058a8-013b-47aa-8a5b-fc07f4e89963 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:09.470985 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-87f058a8-013b-47aa-8a5b-fc07f4e89963 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:09.476081 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-87f058a8-013b-47aa-8a5b-fc07f4e89963 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:09.478539 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-87f058a8-013b-47aa-8a5b-fc07f4e89963 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1407 microversion: 2.20 time: 0.193865 Jul 26 07:26:09.481469 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 51/92] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:26:09 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:26:09.698515 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-1308dd81-53bf-493d-8687-bab531210183 req-cdf1fc6e-64a4-4262-a96a-1961a8f0435e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c489bd-8ed2-4284-b712-9e5829c3fb66", "name": "network-vif-plugged", "status": "completed", "tag": "05c14532-a11a-489d-a874-d92188546d35"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:26:09.720362 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-1308dd81-53bf-493d-8687-bab531210183 req-cdf1fc6e-64a4-4262-a96a-1961a8f0435e service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:09.722248 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-1308dd81-53bf-493d-8687-bab531210183 req-cdf1fc6e-64a4-4262-a96a-1961a8f0435e service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:09.724550 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-5b0fa1da-7828-4084-be61-3a8ab2fa0a3e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:09.743979 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-5b0fa1da-7828-4084-be61-3a8ab2fa0a3e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1320 microversion: 2.1 time: 0.665316 Jul 26 07:26:09.751780 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 42/93] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:09 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1320 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:09.752305 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-1308dd81-53bf-493d-8687-bab531210183 req-cdf1fc6e-64a4-4262-a96a-1961a8f0435e service nova] Creating event network-vif-plugged:05c14532-a11a-489d-a874-d92188546d35 for instance b0c489bd-8ed2-4284-b712-9e5829c3fb66 on hv-cinder-85083 Jul 26 07:26:09.766491 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-1308dd81-53bf-493d-8687-bab531210183 req-cdf1fc6e-64a4-4262-a96a-1961a8f0435e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073201 Jul 26 07:26:09.767107 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 52/94] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:26:09.816270 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-3a6a7ae0-765d-4e9e-9391-83b6f86a584a tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:09.816885 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-3a6a7ae0-765d-4e9e-9391-83b6f86a584a tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] [instance: b0c489bd-8ed2-4284-b712-9e5829c3fb66] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:09.825517 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3a6a7ae0-765d-4e9e-9391-83b6f86a584a tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:09.826002 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3a6a7ae0-765d-4e9e-9391-83b6f86a584a tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:09.826866 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3a6a7ae0-765d-4e9e-9391-83b6f86a584a tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:09.827324 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3a6a7ae0-765d-4e9e-9391-83b6f86a584a tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:10.009289 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-1438ffc4-f900-4583-9ad5-25c590d7d151 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:10.010190 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-1438ffc4-f900-4583-9ad5-25c590d7d151 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: c0b50e8b-a23c-4aa8-826e-3e2141006ede] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:10.027664 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1438ffc4-f900-4583-9ad5-25c590d7d151 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:10.028118 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1438ffc4-f900-4583-9ad5-25c590d7d151 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:10.028896 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1438ffc4-f900-4583-9ad5-25c590d7d151 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:10.029544 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1438ffc4-f900-4583-9ad5-25c590d7d151 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:10.153542 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-3a6a7ae0-765d-4e9e-9391-83b6f86a584a tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc64e58cb041f98d9ea4b8c8cd9e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500111b9c9ca4d8893e64c488668a491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:10.176709 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-3a6a7ae0-765d-4e9e-9391-83b6f86a584a tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66" status: 200 len: 1315 microversion: 2.1 time: 0.360549 Jul 26 07:26:10.190940 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 43/95] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:09 2022] GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66 => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:10.258545 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-1438ffc4-f900-4583-9ad5-25c590d7d151 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:10.270866 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-1438ffc4-f900-4583-9ad5-25c590d7d151 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede" status: 200 len: 1365 microversion: 2.1 time: 0.265112 Jul 26 07:26:10.271502 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 53/96] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:10 2022] GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede => generated 1365 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:10.507097 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7ef65beb-5fce-474c-ac6f-b4c5ac8da647 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:10.507786 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7ef65beb-5fce-474c-ac6f-b4c5ac8da647 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:10.519253 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7ef65beb-5fce-474c-ac6f-b4c5ac8da647 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:10.519809 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7ef65beb-5fce-474c-ac6f-b4c5ac8da647 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:10.521235 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7ef65beb-5fce-474c-ac6f-b4c5ac8da647 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:10.521681 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7ef65beb-5fce-474c-ac6f-b4c5ac8da647 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:10.669007 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7ef65beb-5fce-474c-ac6f-b4c5ac8da647 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:10.684250 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7ef65beb-5fce-474c-ac6f-b4c5ac8da647 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:10.685889 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7ef65beb-5fce-474c-ac6f-b4c5ac8da647 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:10.687224 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7ef65beb-5fce-474c-ac6f-b4c5ac8da647 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1407 microversion: 2.20 time: 0.184265 Jul 26 07:26:10.687943 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 44/97] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:26:10 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:26:10.776823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6faa2c86-6391-442b-b52f-d7638c507e17 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:10.778557 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-6faa2c86-6391-442b-b52f-d7638c507e17 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:10.786783 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6faa2c86-6391-442b-b52f-d7638c507e17 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:10.787480 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6faa2c86-6391-442b-b52f-d7638c507e17 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:10.788433 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6faa2c86-6391-442b-b52f-d7638c507e17 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:10.788862 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6faa2c86-6391-442b-b52f-d7638c507e17 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:11.108671 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-6faa2c86-6391-442b-b52f-d7638c507e17 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:11.118381 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6faa2c86-6391-442b-b52f-d7638c507e17 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1320 microversion: 2.1 time: 0.345827 Jul 26 07:26:11.132644 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 54/98] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:10 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1320 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:11.199423 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0377fec2-b1cc-4898-bd05-8b3a8f0b1e8f tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:11.200781 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0377fec2-b1cc-4898-bd05-8b3a8f0b1e8f tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] [instance: b0c489bd-8ed2-4284-b712-9e5829c3fb66] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:11.209006 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0377fec2-b1cc-4898-bd05-8b3a8f0b1e8f tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:11.209433 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0377fec2-b1cc-4898-bd05-8b3a8f0b1e8f tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:11.210388 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0377fec2-b1cc-4898-bd05-8b3a8f0b1e8f tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:11.211242 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0377fec2-b1cc-4898-bd05-8b3a8f0b1e8f tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:11.292199 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-4c68d08a-0c1d-456d-8764-3422a093eaa1 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:11.293170 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-4c68d08a-0c1d-456d-8764-3422a093eaa1 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: c0b50e8b-a23c-4aa8-826e-3e2141006ede] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:11.300176 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4c68d08a-0c1d-456d-8764-3422a093eaa1 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:11.300864 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4c68d08a-0c1d-456d-8764-3422a093eaa1 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:11.301820 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4c68d08a-0c1d-456d-8764-3422a093eaa1 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:11.302255 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4c68d08a-0c1d-456d-8764-3422a093eaa1 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:11.439064 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0377fec2-b1cc-4898-bd05-8b3a8f0b1e8f tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc64e58cb041f98d9ea4b8c8cd9e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500111b9c9ca4d8893e64c488668a491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:11.452097 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0377fec2-b1cc-4898-bd05-8b3a8f0b1e8f tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66" status: 200 len: 1315 microversion: 2.1 time: 0.255816 Jul 26 07:26:11.466731 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 45/99] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:11 2022] GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:11.492793 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-4c68d08a-0c1d-456d-8764-3422a093eaa1 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:11.500901 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-4c68d08a-0c1d-456d-8764-3422a093eaa1 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede" status: 200 len: 1555 microversion: 2.1 time: 0.212579 Jul 26 07:26:11.501479 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 55/100] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:11 2022] GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede => generated 1555 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:26:11.531123 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-91897ff3-2958-41f8-b5fa-034a9bd88378 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:11.531781 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-91897ff3-2958-41f8-b5fa-034a9bd88378 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: c0b50e8b-a23c-4aa8-826e-3e2141006ede] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:11.540584 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-91897ff3-2958-41f8-b5fa-034a9bd88378 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:11.547301 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-91897ff3-2958-41f8-b5fa-034a9bd88378 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:11.548258 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-91897ff3-2958-41f8-b5fa-034a9bd88378 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:11.548707 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-91897ff3-2958-41f8-b5fa-034a9bd88378 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:11.710978 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ef921833-4fc2-4b41-9511-2558a0e9ccbf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:11.711779 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ef921833-4fc2-4b41-9511-2558a0e9ccbf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:11.727168 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef921833-4fc2-4b41-9511-2558a0e9ccbf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:11.727607 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef921833-4fc2-4b41-9511-2558a0e9ccbf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:11.728389 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef921833-4fc2-4b41-9511-2558a0e9ccbf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:11.733984 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef921833-4fc2-4b41-9511-2558a0e9ccbf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:11.809548 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-91897ff3-2958-41f8-b5fa-034a9bd88378 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.291089 Jul 26 07:26:11.818484 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 46/101] 10.222.0.39 () {58 vars in 1275 bytes} [Tue Jul 26 07:26:11 2022] GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede/os-interface => generated 284 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:26:11.824555 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-08a6d461-8d9b-4f0d-b1d6-9dd90f435244 req-4ec4d858-cb2f-486c-a28f-804f4e9f2865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e85830f-4d1d-4386-89f0-dbe72ad75089", "name": "network-vif-plugged", "status": "completed", "tag": "527d5b48-4c6b-40c4-95e8-b8d39da61a3d"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:26:11.841658 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-08a6d461-8d9b-4f0d-b1d6-9dd90f435244 req-4ec4d858-cb2f-486c-a28f-804f4e9f2865 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:11.842185 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-08a6d461-8d9b-4f0d-b1d6-9dd90f435244 req-4ec4d858-cb2f-486c-a28f-804f4e9f2865 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:11.869011 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-08a6d461-8d9b-4f0d-b1d6-9dd90f435244 req-4ec4d858-cb2f-486c-a28f-804f4e9f2865 service nova] Creating event network-vif-plugged:527d5b48-4c6b-40c4-95e8-b8d39da61a3d for instance 9e85830f-4d1d-4386-89f0-dbe72ad75089 on hv-cinder-85083 Jul 26 07:26:11.882945 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-08a6d461-8d9b-4f0d-b1d6-9dd90f435244 req-4ec4d858-cb2f-486c-a28f-804f4e9f2865 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061990 Jul 26 07:26:11.887012 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 47/102] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:26:12.142856 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0408e5e4-25eb-471f-b558-51f63942da4a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:12.144097 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0408e5e4-25eb-471f-b558-51f63942da4a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:12.158899 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0408e5e4-25eb-471f-b558-51f63942da4a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:12.161286 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0408e5e4-25eb-471f-b558-51f63942da4a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:12.162217 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0408e5e4-25eb-471f-b558-51f63942da4a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:12.162656 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0408e5e4-25eb-471f-b558-51f63942da4a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:12.452307 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0408e5e4-25eb-471f-b558-51f63942da4a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:12.463757 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0408e5e4-25eb-471f-b558-51f63942da4a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1320 microversion: 2.1 time: 0.326031 Jul 26 07:26:12.464670 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 48/103] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:12 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1320 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:26:12.498000 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-20e68008-fdaf-4dbb-a9b5-2d17f8b9f067 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:12.501774 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-20e68008-fdaf-4dbb-a9b5-2d17f8b9f067 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] [instance: b0c489bd-8ed2-4284-b712-9e5829c3fb66] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:12.524130 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-20e68008-fdaf-4dbb-a9b5-2d17f8b9f067 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:12.526906 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-20e68008-fdaf-4dbb-a9b5-2d17f8b9f067 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:12.554294 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-20e68008-fdaf-4dbb-a9b5-2d17f8b9f067 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:12.554830 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-20e68008-fdaf-4dbb-a9b5-2d17f8b9f067 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:12.693938 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ef921833-4fc2-4b41-9511-2558a0e9ccbf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:12.704209 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ef921833-4fc2-4b41-9511-2558a0e9ccbf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:12.716570 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ef921833-4fc2-4b41-9511-2558a0e9ccbf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:12.718067 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ef921833-4fc2-4b41-9511-2558a0e9ccbf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1407 microversion: 2.20 time: 1.012272 Jul 26 07:26:12.721212 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 56/104] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:26:11 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1407 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 07:26:12.822772 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-20e68008-fdaf-4dbb-a9b5-2d17f8b9f067 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc64e58cb041f98d9ea4b8c8cd9e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500111b9c9ca4d8893e64c488668a491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:12.832537 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-20e68008-fdaf-4dbb-a9b5-2d17f8b9f067 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66" status: 200 len: 1502 microversion: 2.1 time: 0.359779 Jul 26 07:26:12.835093 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 49/105] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:12 2022] GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66 => generated 1502 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:13.485873 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-5dd952cb-6a42-4f47-9d67-02ee6eb85ba1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:13.486744 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-5dd952cb-6a42-4f47-9d67-02ee6eb85ba1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:13.496807 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5dd952cb-6a42-4f47-9d67-02ee6eb85ba1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:13.497255 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5dd952cb-6a42-4f47-9d67-02ee6eb85ba1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:13.498108 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5dd952cb-6a42-4f47-9d67-02ee6eb85ba1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:13.498538 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5dd952cb-6a42-4f47-9d67-02ee6eb85ba1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:13.747694 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2f66566e-eda0-42c2-a814-f6b65a3e2153 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:13.748878 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2f66566e-eda0-42c2-a814-f6b65a3e2153 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:13.761083 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2f66566e-eda0-42c2-a814-f6b65a3e2153 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:13.762882 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2f66566e-eda0-42c2-a814-f6b65a3e2153 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:13.763843 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2f66566e-eda0-42c2-a814-f6b65a3e2153 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:13.765301 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2f66566e-eda0-42c2-a814-f6b65a3e2153 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:13.781605 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-5dd952cb-6a42-4f47-9d67-02ee6eb85ba1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:13.796157 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-5dd952cb-6a42-4f47-9d67-02ee6eb85ba1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1320 microversion: 2.1 time: 0.314640 Jul 26 07:26:13.802180 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 57/106] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:13 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1320 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:14.006055 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2f66566e-eda0-42c2-a814-f6b65a3e2153 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:14.018382 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-a42556eb-b049-4084-bcab-a16ce6970dc2 req-8a5684ae-4e35-4f44-8a54-c5b7efb71cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0b50e8b-a23c-4aa8-826e-3e2141006ede", "tag": "f69a186f-e6f8-40ec-a78d-a7da3701a72b"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:26:14.028271 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2f66566e-eda0-42c2-a814-f6b65a3e2153 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:14.029874 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2f66566e-eda0-42c2-a814-f6b65a3e2153 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:14.039581 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2f66566e-eda0-42c2-a814-f6b65a3e2153 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1407 microversion: 2.20 time: 0.297401 Jul 26 07:26:14.041697 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-a42556eb-b049-4084-bcab-a16ce6970dc2 req-8a5684ae-4e35-4f44-8a54-c5b7efb71cb6 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:14.042185 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-a42556eb-b049-4084-bcab-a16ce6970dc2 req-8a5684ae-4e35-4f44-8a54-c5b7efb71cb6 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:14.071950 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-a42556eb-b049-4084-bcab-a16ce6970dc2 req-8a5684ae-4e35-4f44-8a54-c5b7efb71cb6 service nova] Creating event network-changed:f69a186f-e6f8-40ec-a78d-a7da3701a72b for instance c0b50e8b-a23c-4aa8-826e-3e2141006ede on hv-cinder-85083 Jul 26 07:26:14.077110 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 50/107] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:26:13 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1407 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 07:26:14.084281 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-a42556eb-b049-4084-bcab-a16ce6970dc2 req-8a5684ae-4e35-4f44-8a54-c5b7efb71cb6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069721 Jul 26 07:26:14.085281 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 58/108] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 07:26:14.517220 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a6754669-3b6c-45cd-8535-6c6ed304cb88 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "473da390-2ab5-4eaa-9261-25d607aedb04"}} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:26:14.520445 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a6754669-3b6c-45cd-8535-6c6ed304cb88 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] [instance: b0c489bd-8ed2-4284-b712-9e5829c3fb66] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:14.527805 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a6754669-3b6c-45cd-8535-6c6ed304cb88 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:14.529123 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a6754669-3b6c-45cd-8535-6c6ed304cb88 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:14.530484 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a6754669-3b6c-45cd-8535-6c6ed304cb88 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:14.531094 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a6754669-3b6c-45cd-8535-6c6ed304cb88 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:14.627180 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-3dc86fae-7886-40ec-a607-13266ab94e9d req-3d7e6dd8-60f3-4c44-b83b-1b06794cf11e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "990571a8-aa04-4aac-921c-cf071eca1dd0", "name": "network-vif-plugged", "status": "completed", "tag": "06f98651-1a4f-4f3c-a886-1d5aad025305"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:26:14.667420 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-3dc86fae-7886-40ec-a607-13266ab94e9d req-3d7e6dd8-60f3-4c44-b83b-1b06794cf11e service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:14.670024 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-3dc86fae-7886-40ec-a607-13266ab94e9d req-3d7e6dd8-60f3-4c44-b83b-1b06794cf11e service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:14.710846 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-3dc86fae-7886-40ec-a607-13266ab94e9d req-3d7e6dd8-60f3-4c44-b83b-1b06794cf11e service nova] Creating event network-vif-plugged:06f98651-1a4f-4f3c-a886-1d5aad025305 for instance 990571a8-aa04-4aac-921c-cf071eca1dd0 on hv-cinder-85083 Jul 26 07:26:14.718319 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-3dc86fae-7886-40ec-a607-13266ab94e9d req-3d7e6dd8-60f3-4c44-b83b-1b06794cf11e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097448 Jul 26 07:26:14.720099 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 59/109] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:26:14.824998 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-1b513152-a1bd-4b12-8284-f03d3ba445d1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:14.825533 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-1b513152-a1bd-4b12-8284-f03d3ba445d1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:14.850738 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1b513152-a1bd-4b12-8284-f03d3ba445d1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:14.860910 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1b513152-a1bd-4b12-8284-f03d3ba445d1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:14.872385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1b513152-a1bd-4b12-8284-f03d3ba445d1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:14.873253 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1b513152-a1bd-4b12-8284-f03d3ba445d1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:14.933639 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:26:15.136471 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:26:15.176564 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a6754669-3b6c-45cd-8535-6c6ed304cb88 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] 10.222.0.39 "POST /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.663197 Jul 26 07:26:15.179672 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 51/110] 10.222.0.39 () {60 vars in 1323 bytes} [Tue Jul 26 07:26:14 2022] POST /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66/os-volume_attachments => generated 194 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:26:15.196861 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d96d28d2-1d1c-4995-a46b-c5e650a2f714 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:15.204655 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d96d28d2-1d1c-4995-a46b-c5e650a2f714 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:15.230806 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d96d28d2-1d1c-4995-a46b-c5e650a2f714 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:15.234414 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d96d28d2-1d1c-4995-a46b-c5e650a2f714 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:15.239276 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d96d28d2-1d1c-4995-a46b-c5e650a2f714 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:15.239945 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d96d28d2-1d1c-4995-a46b-c5e650a2f714 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:15.284385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-1b513152-a1bd-4b12-8284-f03d3ba445d1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:15.296761 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-1b513152-a1bd-4b12-8284-f03d3ba445d1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1514 microversion: 2.1 time: 0.476333 Jul 26 07:26:15.297758 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 60/111] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:14 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1514 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:26:15.323015 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c79eb88a-b664-475f-a0cd-f3d8a3901b80 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:26:15.325905 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c79eb88a-b664-475f-a0cd-f3d8a3901b80 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:15.341929 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c79eb88a-b664-475f-a0cd-f3d8a3901b80 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:15.342678 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c79eb88a-b664-475f-a0cd-f3d8a3901b80 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:15.344490 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c79eb88a-b664-475f-a0cd-f3d8a3901b80 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:15.344490 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c79eb88a-b664-475f-a0cd-f3d8a3901b80 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:15.533830 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.objects.instance [None req-c79eb88a-b664-475f-a0cd-f3d8a3901b80 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lazy-loading 'flavor' on Instance uuid 9e85830f-4d1d-4386-89f0-dbe72ad75089 {{(pid=117715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 07:26:15.704970 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d96d28d2-1d1c-4995-a46b-c5e650a2f714 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:15.736030 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d96d28d2-1d1c-4995-a46b-c5e650a2f714 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:15.739161 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d96d28d2-1d1c-4995-a46b-c5e650a2f714 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:15.741614 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d96d28d2-1d1c-4995-a46b-c5e650a2f714 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1407 microversion: 2.20 time: 0.559702 Jul 26 07:26:15.744517 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 52/112] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:26:15 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1407 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:26:15.868774 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c79eb88a-b664-475f-a0cd-f3d8a3901b80 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "POST /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089/action" status: 200 len: 32 microversion: 2.1 time: 0.549954 Jul 26 07:26:15.869862 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 61/113] 10.222.0.39 () {60 vars in 1278 bytes} [Tue Jul 26 07:26:15 2022] POST /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089/action => generated 32 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 07:26:15.883376 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0db5b60f-97e3-41e0-ac8a-31c6345f8508 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:15.884760 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0db5b60f-97e3-41e0-ac8a-31c6345f8508 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:15.895446 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0db5b60f-97e3-41e0-ac8a-31c6345f8508 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:15.898874 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0db5b60f-97e3-41e0-ac8a-31c6345f8508 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:15.899846 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0db5b60f-97e3-41e0-ac8a-31c6345f8508 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:15.900481 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0db5b60f-97e3-41e0-ac8a-31c6345f8508 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:16.090272 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell0:SELECT=2 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:26:16.233729 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0db5b60f-97e3-41e0-ac8a-31c6345f8508 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:16.243785 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0db5b60f-97e3-41e0-ac8a-31c6345f8508 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.368562 Jul 26 07:26:16.253178 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 53/114] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:15 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:16.746540 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-3c2cbff6-0758-46fc-b6c0-3121ddf26263 req-4a5198bd-632d-4b91-836e-ae89ac1e773c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80da1213-270f-4afc-87f8-345874caa669", "name": "network-vif-plugged", "status": "completed", "tag": "a592fd67-f5f8-4a93-bb6f-f2ff436180bf"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:26:16.770069 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ce5c32d5-62e6-4c49-9883-70eff8d0a333 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:16.770687 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ce5c32d5-62e6-4c49-9883-70eff8d0a333 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:16.777158 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-3c2cbff6-0758-46fc-b6c0-3121ddf26263 req-4a5198bd-632d-4b91-836e-ae89ac1e773c service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:16.777606 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-3c2cbff6-0758-46fc-b6c0-3121ddf26263 req-4a5198bd-632d-4b91-836e-ae89ac1e773c service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:16.785044 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ce5c32d5-62e6-4c49-9883-70eff8d0a333 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:16.785493 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ce5c32d5-62e6-4c49-9883-70eff8d0a333 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:16.786292 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ce5c32d5-62e6-4c49-9883-70eff8d0a333 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:16.786722 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ce5c32d5-62e6-4c49-9883-70eff8d0a333 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:16.791215 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-3c2cbff6-0758-46fc-b6c0-3121ddf26263 req-4a5198bd-632d-4b91-836e-ae89ac1e773c service nova] Creating event network-vif-plugged:a592fd67-f5f8-4a93-bb6f-f2ff436180bf for instance 80da1213-270f-4afc-87f8-345874caa669 on hv-cinder-85083 Jul 26 07:26:16.797396 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-3c2cbff6-0758-46fc-b6c0-3121ddf26263 req-4a5198bd-632d-4b91-836e-ae89ac1e773c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058828 Jul 26 07:26:16.798286 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 62/115] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 07:26:16.943106 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ce5c32d5-62e6-4c49-9883-70eff8d0a333 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:16.954299 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ce5c32d5-62e6-4c49-9883-70eff8d0a333 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:16.956115 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ce5c32d5-62e6-4c49-9883-70eff8d0a333 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:16.957277 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ce5c32d5-62e6-4c49-9883-70eff8d0a333 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1407 microversion: 2.20 time: 0.191040 Jul 26 07:26:16.957869 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 54/116] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:26:16 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:26:17.266134 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a3df3617-8d30-40fd-aba2-1cdf888099da tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:17.266836 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a3df3617-8d30-40fd-aba2-1cdf888099da tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:17.273785 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a3df3617-8d30-40fd-aba2-1cdf888099da tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:17.274252 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a3df3617-8d30-40fd-aba2-1cdf888099da tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:17.275036 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a3df3617-8d30-40fd-aba2-1cdf888099da tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:17.275568 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a3df3617-8d30-40fd-aba2-1cdf888099da tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:17.474622 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-a3df3617-8d30-40fd-aba2-1cdf888099da tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:17.483680 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a3df3617-8d30-40fd-aba2-1cdf888099da tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.221962 Jul 26 07:26:17.486884 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 63/117] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:17 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:26:17.988822 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6d2ffa92-bd6a-4701-bbdd-03a301d2a563 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:17.988822 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6d2ffa92-bd6a-4701-bbdd-03a301d2a563 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:17.999542 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6d2ffa92-bd6a-4701-bbdd-03a301d2a563 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:18.000037 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6d2ffa92-bd6a-4701-bbdd-03a301d2a563 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:18.000877 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6d2ffa92-bd6a-4701-bbdd-03a301d2a563 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:18.001945 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6d2ffa92-bd6a-4701-bbdd-03a301d2a563 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:18.480869 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6d2ffa92-bd6a-4701-bbdd-03a301d2a563 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:18.489868 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6d2ffa92-bd6a-4701-bbdd-03a301d2a563 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:18.493532 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6d2ffa92-bd6a-4701-bbdd-03a301d2a563 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:18.498771 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6d2ffa92-bd6a-4701-bbdd-03a301d2a563 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1600 microversion: 2.20 time: 0.522395 Jul 26 07:26:18.499355 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 55/118] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:26:17 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1600 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:26:18.515170 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8d070525-786e-436d-850b-1da770003177 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:18.516178 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8d070525-786e-436d-850b-1da770003177 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:18.526966 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8d070525-786e-436d-850b-1da770003177 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:18.528511 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8d070525-786e-436d-850b-1da770003177 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:18.529411 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8d070525-786e-436d-850b-1da770003177 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:18.529893 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8d070525-786e-436d-850b-1da770003177 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:18.543841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d6a1aa17-6fac-4368-b7c1-ce32096991bd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:18.545413 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d6a1aa17-6fac-4368-b7c1-ce32096991bd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:18.553615 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d6a1aa17-6fac-4368-b7c1-ce32096991bd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:18.554190 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d6a1aa17-6fac-4368-b7c1-ce32096991bd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:18.555166 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d6a1aa17-6fac-4368-b7c1-ce32096991bd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:18.555766 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d6a1aa17-6fac-4368-b7c1-ce32096991bd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:18.686456 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d6a1aa17-6fac-4368-b7c1-ce32096991bd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.164321 Jul 26 07:26:18.687051 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 56/119] 10.222.0.39 () {60 vars in 1316 bytes} [Tue Jul 26 07:26:18 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-interface => generated 285 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:26:18.716478 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8d070525-786e-436d-850b-1da770003177 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:18.730147 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8d070525-786e-436d-850b-1da770003177 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.221334 Jul 26 07:26:18.731788 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 64/120] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:18 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:26:19.752990 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9db52a9a-211d-4c66-b455-5a5e06c8f210 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:19.754389 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-9db52a9a-211d-4c66-b455-5a5e06c8f210 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:19.761252 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9db52a9a-211d-4c66-b455-5a5e06c8f210 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:19.763217 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9db52a9a-211d-4c66-b455-5a5e06c8f210 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:19.764286 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9db52a9a-211d-4c66-b455-5a5e06c8f210 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:19.764989 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9db52a9a-211d-4c66-b455-5a5e06c8f210 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:20.022614 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-9db52a9a-211d-4c66-b455-5a5e06c8f210 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:20.040268 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-9db52a9a-211d-4c66-b455-5a5e06c8f210 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.291526 Jul 26 07:26:20.051254 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 57/121] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:19 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:20.478061 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-d0be99a0-87a4-4abd-b124-526e29ae3cea req-9a766eeb-f768-4596-b830-62f081341367 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "990571a8-aa04-4aac-921c-cf071eca1dd0", "tag": "06f98651-1a4f-4f3c-a886-1d5aad025305"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:26:20.489379 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-d0be99a0-87a4-4abd-b124-526e29ae3cea req-9a766eeb-f768-4596-b830-62f081341367 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:20.489855 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-d0be99a0-87a4-4abd-b124-526e29ae3cea req-9a766eeb-f768-4596-b830-62f081341367 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:20.505605 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-d0be99a0-87a4-4abd-b124-526e29ae3cea req-9a766eeb-f768-4596-b830-62f081341367 service nova] Creating event network-changed:06f98651-1a4f-4f3c-a886-1d5aad025305 for instance 990571a8-aa04-4aac-921c-cf071eca1dd0 on hv-cinder-85083 Jul 26 07:26:20.512023 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-d0be99a0-87a4-4abd-b124-526e29ae3cea req-9a766eeb-f768-4596-b830-62f081341367 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037855 Jul 26 07:26:20.516592 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 65/122] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:26:21.063433 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-062d4117-f284-44a2-859a-1b14ff5dbc47 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:21.064061 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-062d4117-f284-44a2-859a-1b14ff5dbc47 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:21.074539 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-062d4117-f284-44a2-859a-1b14ff5dbc47 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:21.079304 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-062d4117-f284-44a2-859a-1b14ff5dbc47 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:21.080377 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-062d4117-f284-44a2-859a-1b14ff5dbc47 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:21.080972 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-062d4117-f284-44a2-859a-1b14ff5dbc47 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:21.321853 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-062d4117-f284-44a2-859a-1b14ff5dbc47 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:21.332352 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-062d4117-f284-44a2-859a-1b14ff5dbc47 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.273654 Jul 26 07:26:21.347111 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 58/123] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:21 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:22.355363 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ddf3eace-9dd9-4109-96d9-725e9d3b396f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:22.356262 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ddf3eace-9dd9-4109-96d9-725e9d3b396f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:22.363071 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ddf3eace-9dd9-4109-96d9-725e9d3b396f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:22.363725 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ddf3eace-9dd9-4109-96d9-725e9d3b396f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:22.364839 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ddf3eace-9dd9-4109-96d9-725e9d3b396f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:22.365211 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ddf3eace-9dd9-4109-96d9-725e9d3b396f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:22.569147 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ddf3eace-9dd9-4109-96d9-725e9d3b396f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:22.578804 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ddf3eace-9dd9-4109-96d9-725e9d3b396f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.227636 Jul 26 07:26:22.588024 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 66/124] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:22 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:23.599755 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-53704494-a581-4580-9fce-03f4edf4cd7c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:23.600522 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-53704494-a581-4580-9fce-03f4edf4cd7c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:23.607619 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-53704494-a581-4580-9fce-03f4edf4cd7c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:23.607877 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-53704494-a581-4580-9fce-03f4edf4cd7c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:23.608709 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-53704494-a581-4580-9fce-03f4edf4cd7c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:23.609148 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-53704494-a581-4580-9fce-03f4edf4cd7c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:23.742098 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-53704494-a581-4580-9fce-03f4edf4cd7c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:23.752628 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-53704494-a581-4580-9fce-03f4edf4cd7c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.156691 Jul 26 07:26:23.753266 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 59/125] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:23 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:24.774908 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-69424d7d-95a8-44f8-b1d5-ea04654812d6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:24.775557 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-69424d7d-95a8-44f8-b1d5-ea04654812d6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:24.778879 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:26:24.784577 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-69424d7d-95a8-44f8-b1d5-ea04654812d6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:24.785638 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-69424d7d-95a8-44f8-b1d5-ea04654812d6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:24.786640 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-69424d7d-95a8-44f8-b1d5-ea04654812d6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:24.787600 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-69424d7d-95a8-44f8-b1d5-ea04654812d6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:24.925039 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-69424d7d-95a8-44f8-b1d5-ea04654812d6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:24.932456 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-69424d7d-95a8-44f8-b1d5-ea04654812d6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.162283 Jul 26 07:26:24.933020 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 67/126] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:24 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:25.953904 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9ac17aef-d254-4ceb-93a7-1f2a036ee99f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:25.955308 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-9ac17aef-d254-4ceb-93a7-1f2a036ee99f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:25.963361 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9ac17aef-d254-4ceb-93a7-1f2a036ee99f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:25.964221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9ac17aef-d254-4ceb-93a7-1f2a036ee99f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:25.965254 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9ac17aef-d254-4ceb-93a7-1f2a036ee99f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:25.965698 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9ac17aef-d254-4ceb-93a7-1f2a036ee99f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:26.137309 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-9ac17aef-d254-4ceb-93a7-1f2a036ee99f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:26.146848 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-9ac17aef-d254-4ceb-93a7-1f2a036ee99f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.197748 Jul 26 07:26:26.147669 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 60/127] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:25 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:26.926934 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-0876c366-9373-4f54-85b2-48b37248ffe4 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:26.928173 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-0876c366-9373-4f54-85b2-48b37248ffe4 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] [instance: b0c489bd-8ed2-4284-b712-9e5829c3fb66] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:26.935325 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0876c366-9373-4f54-85b2-48b37248ffe4 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:26.935996 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0876c366-9373-4f54-85b2-48b37248ffe4 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:26.937005 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0876c366-9373-4f54-85b2-48b37248ffe4 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:26.937644 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0876c366-9373-4f54-85b2-48b37248ffe4 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:26.963942 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-0876c366-9373-4f54-85b2-48b37248ffe4 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] [instance: b0c489bd-8ed2-4284-b712-9e5829c3fb66] Going to try to terminate instance {{(pid=117715) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 07:26:27.055337 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-0876c366-9373-4f54-85b2-48b37248ffe4 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66" status: 204 len: 0 microversion: 2.1 time: 0.133243 Jul 26 07:26:27.055987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 68/128] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Jul 26 07:26:26 2022] DELETE /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 07:26:27.064648 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-4f0f5b6a-35af-491f-a8be-70a37dec6dae tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:27.065263 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-4f0f5b6a-35af-491f-a8be-70a37dec6dae tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] [instance: b0c489bd-8ed2-4284-b712-9e5829c3fb66] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:27.071928 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4f0f5b6a-35af-491f-a8be-70a37dec6dae tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:27.072375 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4f0f5b6a-35af-491f-a8be-70a37dec6dae tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:27.073490 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4f0f5b6a-35af-491f-a8be-70a37dec6dae tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:27.074104 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4f0f5b6a-35af-491f-a8be-70a37dec6dae tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:27.168592 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-15099d7f-7311-494d-984d-283612cf88a9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:27.169297 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-15099d7f-7311-494d-984d-283612cf88a9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:27.175569 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-15099d7f-7311-494d-984d-283612cf88a9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:27.176121 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-15099d7f-7311-494d-984d-283612cf88a9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:27.176891 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-15099d7f-7311-494d-984d-283612cf88a9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:27.177610 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-15099d7f-7311-494d-984d-283612cf88a9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:27.207489 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-4f0f5b6a-35af-491f-a8be-70a37dec6dae tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc64e58cb041f98d9ea4b8c8cd9e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500111b9c9ca4d8893e64c488668a491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:27.217143 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-4f0f5b6a-35af-491f-a8be-70a37dec6dae tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66" status: 200 len: 1554 microversion: 2.1 time: 0.156247 Jul 26 07:26:27.218151 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 61/129] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:27 2022] GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:27.315671 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-15099d7f-7311-494d-984d-283612cf88a9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:27.323851 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-15099d7f-7311-494d-984d-283612cf88a9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.159205 Jul 26 07:26:27.324049 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 69/130] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:27 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:28.242139 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6957ec6f-fa6b-497c-9cdc-e40af7822849 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:28.242736 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6957ec6f-fa6b-497c-9cdc-e40af7822849 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] [instance: b0c489bd-8ed2-4284-b712-9e5829c3fb66] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:28.251298 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6957ec6f-fa6b-497c-9cdc-e40af7822849 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:28.251743 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6957ec6f-fa6b-497c-9cdc-e40af7822849 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:28.252505 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6957ec6f-fa6b-497c-9cdc-e40af7822849 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:28.252947 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6957ec6f-fa6b-497c-9cdc-e40af7822849 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:28.347114 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7c8fa9df-915e-4c02-85ff-d7d330fab5c5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:28.347767 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7c8fa9df-915e-4c02-85ff-d7d330fab5c5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:28.355127 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7c8fa9df-915e-4c02-85ff-d7d330fab5c5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:28.355609 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7c8fa9df-915e-4c02-85ff-d7d330fab5c5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:28.356458 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7c8fa9df-915e-4c02-85ff-d7d330fab5c5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:28.357137 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7c8fa9df-915e-4c02-85ff-d7d330fab5c5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:28.396804 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6957ec6f-fa6b-497c-9cdc-e40af7822849 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc64e58cb041f98d9ea4b8c8cd9e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500111b9c9ca4d8893e64c488668a491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:28.405594 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6957ec6f-fa6b-497c-9cdc-e40af7822849 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66" status: 200 len: 1554 microversion: 2.1 time: 0.169317 Jul 26 07:26:28.406186 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 62/131] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:28 2022] GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66 => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:28.493458 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7c8fa9df-915e-4c02-85ff-d7d330fab5c5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:28.501417 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7c8fa9df-915e-4c02-85ff-d7d330fab5c5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.161881 Jul 26 07:26:28.502028 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 70/132] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:28 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:29.435025 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-dddd66ae-5410-4018-9bac-f3631cd1de45 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:29.436588 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-dddd66ae-5410-4018-9bac-f3631cd1de45 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] [instance: b0c489bd-8ed2-4284-b712-9e5829c3fb66] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:29.451793 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dddd66ae-5410-4018-9bac-f3631cd1de45 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:29.452459 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dddd66ae-5410-4018-9bac-f3631cd1de45 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:29.453327 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dddd66ae-5410-4018-9bac-f3631cd1de45 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:29.453824 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dddd66ae-5410-4018-9bac-f3631cd1de45 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:29.523390 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-4e9d717f-db10-4542-8a02-9ff9dd85ba65 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:29.524123 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-4e9d717f-db10-4542-8a02-9ff9dd85ba65 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:29.532069 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4e9d717f-db10-4542-8a02-9ff9dd85ba65 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:29.532648 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4e9d717f-db10-4542-8a02-9ff9dd85ba65 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:29.533655 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4e9d717f-db10-4542-8a02-9ff9dd85ba65 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:29.534201 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4e9d717f-db10-4542-8a02-9ff9dd85ba65 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:29.585903 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-dddd66ae-5410-4018-9bac-f3631cd1de45 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc64e58cb041f98d9ea4b8c8cd9e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500111b9c9ca4d8893e64c488668a491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:29.594648 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-dddd66ae-5410-4018-9bac-f3631cd1de45 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66" status: 200 len: 1554 microversion: 2.1 time: 0.169692 Jul 26 07:26:29.595504 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 63/133] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:29 2022] GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66 => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:29.664030 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-4e9d717f-db10-4542-8a02-9ff9dd85ba65 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:29.672139 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-4e9d717f-db10-4542-8a02-9ff9dd85ba65 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.153517 Jul 26 07:26:29.672743 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 71/134] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:29 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:30.616289 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-5a258fa7-2a79-43aa-a479-fc3acf3ae9bf tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:30.616997 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-5a258fa7-2a79-43aa-a479-fc3acf3ae9bf tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] [instance: b0c489bd-8ed2-4284-b712-9e5829c3fb66] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:30.623744 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5a258fa7-2a79-43aa-a479-fc3acf3ae9bf tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:30.624440 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5a258fa7-2a79-43aa-a479-fc3acf3ae9bf tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:30.625315 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5a258fa7-2a79-43aa-a479-fc3acf3ae9bf tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:30.625837 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5a258fa7-2a79-43aa-a479-fc3acf3ae9bf tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:30.693284 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8f8c44a3-0073-498e-825f-637b22370ed6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:30.694627 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8f8c44a3-0073-498e-825f-637b22370ed6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:30.702245 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8f8c44a3-0073-498e-825f-637b22370ed6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:30.703069 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8f8c44a3-0073-498e-825f-637b22370ed6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:30.704029 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8f8c44a3-0073-498e-825f-637b22370ed6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:30.704638 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8f8c44a3-0073-498e-825f-637b22370ed6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:30.816987 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-5a258fa7-2a79-43aa-a479-fc3acf3ae9bf tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc64e58cb041f98d9ea4b8c8cd9e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500111b9c9ca4d8893e64c488668a491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:30.828819 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-5a258fa7-2a79-43aa-a479-fc3acf3ae9bf tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66" status: 200 len: 1554 microversion: 2.1 time: 0.216142 Jul 26 07:26:30.834846 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 64/135] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:30 2022] GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66 => generated 1554 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:30.932172 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8f8c44a3-0073-498e-825f-637b22370ed6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:30.941947 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8f8c44a3-0073-498e-825f-637b22370ed6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.252894 Jul 26 07:26:30.943269 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 72/136] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:30 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:31.851502 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-063b3eec-d996-475f-82c5-f8a8944ff0e6 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:31.852127 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-063b3eec-d996-475f-82c5-f8a8944ff0e6 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] [instance: b0c489bd-8ed2-4284-b712-9e5829c3fb66] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:31.859026 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-063b3eec-d996-475f-82c5-f8a8944ff0e6 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:31.859638 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-063b3eec-d996-475f-82c5-f8a8944ff0e6 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:31.860512 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-063b3eec-d996-475f-82c5-f8a8944ff0e6 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:31.861029 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-063b3eec-d996-475f-82c5-f8a8944ff0e6 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:31.966201 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6da2eaab-a441-4d4f-bcf8-c196307fbc3c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:31.967688 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-6da2eaab-a441-4d4f-bcf8-c196307fbc3c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:31.977323 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6da2eaab-a441-4d4f-bcf8-c196307fbc3c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:31.978045 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6da2eaab-a441-4d4f-bcf8-c196307fbc3c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:31.978966 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6da2eaab-a441-4d4f-bcf8-c196307fbc3c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:31.979711 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6da2eaab-a441-4d4f-bcf8-c196307fbc3c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:32.001078 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-063b3eec-d996-475f-82c5-f8a8944ff0e6 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc64e58cb041f98d9ea4b8c8cd9e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500111b9c9ca4d8893e64c488668a491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:32.011398 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-063b3eec-d996-475f-82c5-f8a8944ff0e6 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66" status: 200 len: 1554 microversion: 2.1 time: 0.163820 Jul 26 07:26:32.030602 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 65/137] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:31 2022] GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66 => generated 1554 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:32.163322 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-6da2eaab-a441-4d4f-bcf8-c196307fbc3c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:32.171161 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6da2eaab-a441-4d4f-bcf8-c196307fbc3c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.210258 Jul 26 07:26:32.171741 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 73/138] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:31 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:26:33.040770 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-947cb0e2-0543-4058-960b-02659c9e0a51 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:33.041565 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-947cb0e2-0543-4058-960b-02659c9e0a51 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] [instance: b0c489bd-8ed2-4284-b712-9e5829c3fb66] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:33.045997 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=62 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:26:33.049615 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-947cb0e2-0543-4058-960b-02659c9e0a51 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:33.051396 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-947cb0e2-0543-4058-960b-02659c9e0a51 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:33.051396 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-947cb0e2-0543-4058-960b-02659c9e0a51 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:33.051396 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-947cb0e2-0543-4058-960b-02659c9e0a51 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:33.189059 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-947cb0e2-0543-4058-960b-02659c9e0a51 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc64e58cb041f98d9ea4b8c8cd9e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500111b9c9ca4d8893e64c488668a491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:33.192500 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-de8c9cc8-05bd-4e6f-86e0-4dee4f9462ce tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:33.193183 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-de8c9cc8-05bd-4e6f-86e0-4dee4f9462ce tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:33.199150 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-de8c9cc8-05bd-4e6f-86e0-4dee4f9462ce tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:33.199330 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-947cb0e2-0543-4058-960b-02659c9e0a51 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66" status: 200 len: 1554 microversion: 2.1 time: 0.164002 Jul 26 07:26:33.199586 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-de8c9cc8-05bd-4e6f-86e0-4dee4f9462ce tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:33.200229 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 66/139] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:33 2022] GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:33.200333 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-de8c9cc8-05bd-4e6f-86e0-4dee4f9462ce tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:33.200757 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-de8c9cc8-05bd-4e6f-86e0-4dee4f9462ce tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:33.338224 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-de8c9cc8-05bd-4e6f-86e0-4dee4f9462ce tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:33.340620 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:26:33.347526 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-de8c9cc8-05bd-4e6f-86e0-4dee4f9462ce tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.158957 Jul 26 07:26:33.348107 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 74/140] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:33 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:34.221772 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0212098f-44ad-4fba-9e8e-1e4e25f450d2 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:34.222426 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0212098f-44ad-4fba-9e8e-1e4e25f450d2 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] [instance: b0c489bd-8ed2-4284-b712-9e5829c3fb66] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:34.229188 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0212098f-44ad-4fba-9e8e-1e4e25f450d2 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:34.229636 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0212098f-44ad-4fba-9e8e-1e4e25f450d2 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:34.230426 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0212098f-44ad-4fba-9e8e-1e4e25f450d2 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:34.230859 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0212098f-44ad-4fba-9e8e-1e4e25f450d2 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:34.368146 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e9d35280-a67f-4246-b382-abe18854fd3e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:34.368649 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0212098f-44ad-4fba-9e8e-1e4e25f450d2 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc64e58cb041f98d9ea4b8c8cd9e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500111b9c9ca4d8893e64c488668a491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:34.368866 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e9d35280-a67f-4246-b382-abe18854fd3e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:34.377255 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e9d35280-a67f-4246-b382-abe18854fd3e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:34.377829 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0212098f-44ad-4fba-9e8e-1e4e25f450d2 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66" status: 200 len: 1554 microversion: 2.1 time: 0.160653 Jul 26 07:26:34.378228 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e9d35280-a67f-4246-b382-abe18854fd3e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:34.378409 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 67/141] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:34 2022] GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:34.389782 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e9d35280-a67f-4246-b382-abe18854fd3e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:34.389782 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e9d35280-a67f-4246-b382-abe18854fd3e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:34.528283 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-e9d35280-a67f-4246-b382-abe18854fd3e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:34.536109 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e9d35280-a67f-4246-b382-abe18854fd3e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.172372 Jul 26 07:26:34.536691 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 75/142] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:34 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:35.400470 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-cfc7e74b-0b30-4d62-8dc7-e65ff2a13675 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:35.401073 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-cfc7e74b-0b30-4d62-8dc7-e65ff2a13675 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] [instance: b0c489bd-8ed2-4284-b712-9e5829c3fb66] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:35.407926 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cfc7e74b-0b30-4d62-8dc7-e65ff2a13675 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:35.408370 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cfc7e74b-0b30-4d62-8dc7-e65ff2a13675 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:35.409133 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cfc7e74b-0b30-4d62-8dc7-e65ff2a13675 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:35.409558 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cfc7e74b-0b30-4d62-8dc7-e65ff2a13675 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:35.428774 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:26:35.558043 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-81c7ccbe-3d7f-414f-add3-8312012085e7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:35.558656 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-81c7ccbe-3d7f-414f-add3-8312012085e7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:35.565274 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-81c7ccbe-3d7f-414f-add3-8312012085e7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:35.566187 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-81c7ccbe-3d7f-414f-add3-8312012085e7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:35.567166 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-81c7ccbe-3d7f-414f-add3-8312012085e7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:35.567593 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-81c7ccbe-3d7f-414f-add3-8312012085e7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:35.668567 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-cfc7e74b-0b30-4d62-8dc7-e65ff2a13675 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc64e58cb041f98d9ea4b8c8cd9e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500111b9c9ca4d8893e64c488668a491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:35.679272 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-cfc7e74b-0b30-4d62-8dc7-e65ff2a13675 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66" status: 200 len: 1554 microversion: 2.1 time: 0.282574 Jul 26 07:26:35.695198 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 68/143] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:35 2022] GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66 => generated 1554 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:35.762748 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-81c7ccbe-3d7f-414f-add3-8312012085e7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:35.774223 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-81c7ccbe-3d7f-414f-add3-8312012085e7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.218490 Jul 26 07:26:35.778346 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 76/144] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:35 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:26:36.079274 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-d9168ba0-cf14-49a8-9ae3-4849e3bd18d1 req-cdd388dd-c4ca-4163-a4ae-c24dcdb0dbdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c489bd-8ed2-4284-b712-9e5829c3fb66", "name": "network-vif-deleted", "tag": "05c14532-a11a-489d-a874-d92188546d35"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:26:36.100051 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-d9168ba0-cf14-49a8-9ae3-4849e3bd18d1 req-cdd388dd-c4ca-4163-a4ae-c24dcdb0dbdf service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:36.100810 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-d9168ba0-cf14-49a8-9ae3-4849e3bd18d1 req-cdd388dd-c4ca-4163-a4ae-c24dcdb0dbdf service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:36.153724 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-d9168ba0-cf14-49a8-9ae3-4849e3bd18d1 req-cdd388dd-c4ca-4163-a4ae-c24dcdb0dbdf service nova] Creating event network-vif-deleted:05c14532-a11a-489d-a874-d92188546d35 for instance b0c489bd-8ed2-4284-b712-9e5829c3fb66 on hv-cinder-85083 Jul 26 07:26:36.166808 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-d9168ba0-cf14-49a8-9ae3-4849e3bd18d1 req-cdd388dd-c4ca-4163-a4ae-c24dcdb0dbdf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091770 Jul 26 07:26:36.167474 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 69/145] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 07:26:36.701035 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9e6509bc-79c5-4e56-aae3-a3dc63e55428 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:36.702005 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-9e6509bc-79c5-4e56-aae3-a3dc63e55428 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] [instance: b0c489bd-8ed2-4284-b712-9e5829c3fb66] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:36.711163 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9e6509bc-79c5-4e56-aae3-a3dc63e55428 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:36.712026 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9e6509bc-79c5-4e56-aae3-a3dc63e55428 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:36.713214 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9e6509bc-79c5-4e56-aae3-a3dc63e55428 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:36.713946 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9e6509bc-79c5-4e56-aae3-a3dc63e55428 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:36.779358 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9e6509bc-79c5-4e56-aae3-a3dc63e55428 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:36.779799 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9e6509bc-79c5-4e56-aae3-a3dc63e55428 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:36.780247 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.objects.instance [None req-9e6509bc-79c5-4e56-aae3-a3dc63e55428 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lazy-loading 'fault' on Instance uuid b0c489bd-8ed2-4284-b712-9e5829c3fb66 {{(pid=117715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 07:26:36.818555 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-97ff0adf-d5b3-4815-866b-ea69f435fbf5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:36.819422 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-97ff0adf-d5b3-4815-866b-ea69f435fbf5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:36.840691 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-97ff0adf-d5b3-4815-866b-ea69f435fbf5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:36.841139 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-97ff0adf-d5b3-4815-866b-ea69f435fbf5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:36.842144 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-97ff0adf-d5b3-4815-866b-ea69f435fbf5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:36.842721 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-97ff0adf-d5b3-4815-866b-ea69f435fbf5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:36.860308 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-9e6509bc-79c5-4e56-aae3-a3dc63e55428 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc64e58cb041f98d9ea4b8c8cd9e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500111b9c9ca4d8893e64c488668a491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:36.868612 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-9e6509bc-79c5-4e56-aae3-a3dc63e55428 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66" status: 200 len: 1351 microversion: 2.1 time: 0.171889 Jul 26 07:26:36.869261 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 77/146] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:36 2022] GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66 => generated 1351 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:36.978679 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-97ff0adf-d5b3-4815-866b-ea69f435fbf5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:36.986480 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-97ff0adf-d5b3-4815-866b-ea69f435fbf5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.193467 Jul 26 07:26:36.987044 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 70/147] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:36 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:37.894276 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-fe82af5e-91d5-41a2-93d7-5c14823bbd31 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:37.894936 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-fe82af5e-91d5-41a2-93d7-5c14823bbd31 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] [instance: b0c489bd-8ed2-4284-b712-9e5829c3fb66] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:37.901990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fe82af5e-91d5-41a2-93d7-5c14823bbd31 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:37.902431 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fe82af5e-91d5-41a2-93d7-5c14823bbd31 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:37.903195 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fe82af5e-91d5-41a2-93d7-5c14823bbd31 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:37.903631 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fe82af5e-91d5-41a2-93d7-5c14823bbd31 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:37.936421 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fe82af5e-91d5-41a2-93d7-5c14823bbd31 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:37.936941 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fe82af5e-91d5-41a2-93d7-5c14823bbd31 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:37.937407 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.objects.instance [None req-fe82af5e-91d5-41a2-93d7-5c14823bbd31 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lazy-loading 'fault' on Instance uuid b0c489bd-8ed2-4284-b712-9e5829c3fb66 {{(pid=117715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 07:26:37.985137 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-fe82af5e-91d5-41a2-93d7-5c14823bbd31 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc64e58cb041f98d9ea4b8c8cd9e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500111b9c9ca4d8893e64c488668a491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:37.993201 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-fe82af5e-91d5-41a2-93d7-5c14823bbd31 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66" status: 200 len: 1351 microversion: 2.1 time: 0.106446 Jul 26 07:26:37.993769 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 78/148] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:37 2022] GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66 => generated 1351 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:38.007389 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f8987680-cd79-4e55-9d8d-9b495c694082 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:38.007989 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-f8987680-cd79-4e55-9d8d-9b495c694082 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:38.014799 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f8987680-cd79-4e55-9d8d-9b495c694082 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:38.015261 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f8987680-cd79-4e55-9d8d-9b495c694082 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:38.016028 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f8987680-cd79-4e55-9d8d-9b495c694082 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:38.016454 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f8987680-cd79-4e55-9d8d-9b495c694082 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:38.154327 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-f8987680-cd79-4e55-9d8d-9b495c694082 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:38.166309 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f8987680-cd79-4e55-9d8d-9b495c694082 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.162501 Jul 26 07:26:38.167171 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 71/149] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:38 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:39.015279 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-99e51787-1859-4dbd-acaf-e3c3194be131 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:39.015843 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-99e51787-1859-4dbd-acaf-e3c3194be131 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] [instance: b0c489bd-8ed2-4284-b712-9e5829c3fb66] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:39.022163 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-99e51787-1859-4dbd-acaf-e3c3194be131 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:39.022636 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-99e51787-1859-4dbd-acaf-e3c3194be131 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:39.023357 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-99e51787-1859-4dbd-acaf-e3c3194be131 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:39.023785 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-99e51787-1859-4dbd-acaf-e3c3194be131 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:39.058887 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-99e51787-1859-4dbd-acaf-e3c3194be131 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:39.059321 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-99e51787-1859-4dbd-acaf-e3c3194be131 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:39.059778 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.objects.instance [None req-99e51787-1859-4dbd-acaf-e3c3194be131 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lazy-loading 'fault' on Instance uuid b0c489bd-8ed2-4284-b712-9e5829c3fb66 {{(pid=117715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 07:26:39.104193 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-99e51787-1859-4dbd-acaf-e3c3194be131 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc64e58cb041f98d9ea4b8c8cd9e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500111b9c9ca4d8893e64c488668a491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:39.112342 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-99e51787-1859-4dbd-acaf-e3c3194be131 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66" status: 200 len: 1351 microversion: 2.1 time: 0.101676 Jul 26 07:26:39.112914 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 79/150] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:39 2022] GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66 => generated 1351 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:39.188288 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-780f2220-1f7a-4519-b152-9d55fb17b027 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:39.188950 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-780f2220-1f7a-4519-b152-9d55fb17b027 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:39.195983 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-780f2220-1f7a-4519-b152-9d55fb17b027 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:39.196414 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-780f2220-1f7a-4519-b152-9d55fb17b027 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:39.197173 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-780f2220-1f7a-4519-b152-9d55fb17b027 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:39.197598 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-780f2220-1f7a-4519-b152-9d55fb17b027 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:39.339069 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-780f2220-1f7a-4519-b152-9d55fb17b027 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:39.350314 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-780f2220-1f7a-4519-b152-9d55fb17b027 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.166119 Jul 26 07:26:39.350899 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 72/151] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:39 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:40.137274 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b83530f5-8883-439c-82ec-670d79f560b7 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:40.137912 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b83530f5-8883-439c-82ec-670d79f560b7 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] [instance: b0c489bd-8ed2-4284-b712-9e5829c3fb66] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:40.147147 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b83530f5-8883-439c-82ec-670d79f560b7 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:40.147808 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b83530f5-8883-439c-82ec-670d79f560b7 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:40.149022 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b83530f5-8883-439c-82ec-670d79f560b7 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:40.149492 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b83530f5-8883-439c-82ec-670d79f560b7 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:40.165835 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.wsgi [None req-b83530f5-8883-439c-82ec-670d79f560b7 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] HTTP exception thrown: Instance b0c489bd-8ed2-4284-b712-9e5829c3fb66 could not be found. Jul 26 07:26:40.170464 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b83530f5-8883-439c-82ec-670d79f560b7 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Request method failure captured: Jul 26 07:26:40.170464 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: request: GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66 HTTP/1.1 Jul 26 07:26:40.170464 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept: application/json Jul 26 07:26:40.170464 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept-Encoding: identity Jul 26 07:26:40.170464 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Connection: close Jul 26 07:26:40.170464 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Length: 0 Jul 26 07:26:40.170464 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Type: application/json Jul 26 07:26:40.170464 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Host: 10.222.0.39 Jul 26 07:26:40.170464 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Openstack-System-Scope: None Jul 26 07:26:40.170464 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: User-Agent: python-urllib3/1.26.10 Jul 26 07:26:40.170464 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Auth-Token: gAAAAABi35b1u-SYDBN0F7f7ojFxRU_EaG7imwQaJwQnvfW43P3Gz_7vMd0g-WSA3TQ5r2mME_XnNkNzZ7BXJ7N74Ttn2gAJlBBK2WMN4_6nVhCs_Y47pia_ZOuuBJQHHk9gHnZTcbcS7As9GbiXN5_T0DJuyAgQVT4k3jnudOUyDq59p07oITQ Jul 26 07:26:40.170464 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Id: None Jul 26 07:26:40.170464 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Name: None Jul 26 07:26:40.170464 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Identity-Status: Confirmed Jul 26 07:26:40.170464 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Is-Admin-Project: True Jul 26 07:26:40.170464 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Id: default Jul 26 07:26:40.170464 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Name: Default Jul 26 07:26:40.170464 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Id: 500111b9c9ca4d8893e64c488668a491 Jul 26 07:26:40.170464 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Name: tempest-DeleteServersTestJSON-1190453395 Jul 26 07:26:40.170464 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Role: member,reader Jul 26 07:26:40.170464 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Roles: member,reader Jul 26 07:26:40.171893 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/500111b9c9ca4d8893e64c488668a491"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_500111b9c9ca4d8893e64c488668a491"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/500111b9c9ca4d8893e64c488668a491"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/500111b9c9ca4d8893e64c488668a491"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:26:40.171893 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant: tempest-DeleteServersTestJSON-1190453395 Jul 26 07:26:40.171893 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Id: 500111b9c9ca4d8893e64c488668a491 Jul 26 07:26:40.171893 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Name: tempest-DeleteServersTestJSON-1190453395 Jul 26 07:26:40.171893 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User: tempest-DeleteServersTestJSON-1190453395-project Jul 26 07:26:40.171893 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Id: default Jul 26 07:26:40.171893 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Name: Default Jul 26 07:26:40.171893 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Id: 8fdc64e58cb041f98d9ea4b8c8cd9e60 Jul 26 07:26:40.171893 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Name: tempest-DeleteServersTestJSON-1190453395-project Jul 26 07:26:40.171893 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: method: > Jul 26 07:26:40.171893 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: exception: Instance b0c489bd-8ed2-4284-b712-9e5829c3fb66 could not be found. Jul 26 07:26:40.171893 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: action_args: {'id': 'b0c489bd-8ed2-4284-b712-9e5829c3fb66'} Jul 26 07:26:40.173916 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:26:40.173916 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:26:40.173916 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 07:26:40.173916 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 07:26:40.173916 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 07:26:40.173916 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 07:26:40.173916 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 07:26:40.173916 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 07:26:40.173916 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 07:26:40.173916 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 07:26:40.173916 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0c489bd-8ed2-4284-b712-9e5829c3fb66 could not be found. Jul 26 07:26:40.173916 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:26:40.173916 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:26:40.173916 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:26:40.173916 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:26:40.173916 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:26:40.173916 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:26:40.173916 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:26:40.173916 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:26:40.173916 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:26:40.175265 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:26:40.175265 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 07:26:40.175265 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 07:26:40.175265 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 07:26:40.175265 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 07:26:40.175265 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 07:26:40.175265 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:26:40.175265 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0c489bd-8ed2-4284-b712-9e5829c3fb66 could not be found. Jul 26 07:26:40.175265 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:26:40.175265 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:26:40.175265 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:26:40.175265 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:26:40.175265 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:26:40.175265 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:26:40.175265 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:26:40.175265 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:26:40.175265 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0c489bd-8ed2-4284-b712-9e5829c3fb66 could not be found. Jul 26 07:26:40.175265 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:26:40.176420 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b83530f5-8883-439c-82ec-670d79f560b7 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Returning 404 to user: Instance b0c489bd-8ed2-4284-b712-9e5829c3fb66 could not be found. {{(pid=117715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:26:40.176420 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b83530f5-8883-439c-82ec-670d79f560b7 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66" status: 404 len: 111 microversion: 2.1 time: 0.041964 Jul 26 07:26:40.176420 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 80/152] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:40 2022] GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 07:26:40.294000 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-cad4e402-1f66-41c9-8c13-2d0d18be93c4 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:40.296233 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-cad4e402-1f66-41c9-8c13-2d0d18be93c4 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] [instance: b0c489bd-8ed2-4284-b712-9e5829c3fb66] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:40.303180 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cad4e402-1f66-41c9-8c13-2d0d18be93c4 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:40.303645 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cad4e402-1f66-41c9-8c13-2d0d18be93c4 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:40.304879 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cad4e402-1f66-41c9-8c13-2d0d18be93c4 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:40.304879 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cad4e402-1f66-41c9-8c13-2d0d18be93c4 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:40.318169 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.wsgi [None req-cad4e402-1f66-41c9-8c13-2d0d18be93c4 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] HTTP exception thrown: Instance b0c489bd-8ed2-4284-b712-9e5829c3fb66 could not be found. Jul 26 07:26:40.322239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-cad4e402-1f66-41c9-8c13-2d0d18be93c4 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Request method failure captured: Jul 26 07:26:40.322239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: request: GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66/os-volume_attachments HTTP/1.1 Jul 26 07:26:40.322239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept: application/json Jul 26 07:26:40.322239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept-Encoding: identity Jul 26 07:26:40.322239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Connection: close Jul 26 07:26:40.322239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Length: 0 Jul 26 07:26:40.322239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Type: application/json Jul 26 07:26:40.322239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Host: 10.222.0.39 Jul 26 07:26:40.322239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Openstack-System-Scope: None Jul 26 07:26:40.322239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: User-Agent: python-urllib3/1.26.10 Jul 26 07:26:40.322239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Auth-Token: gAAAAABi35b1u-SYDBN0F7f7ojFxRU_EaG7imwQaJwQnvfW43P3Gz_7vMd0g-WSA3TQ5r2mME_XnNkNzZ7BXJ7N74Ttn2gAJlBBK2WMN4_6nVhCs_Y47pia_ZOuuBJQHHk9gHnZTcbcS7As9GbiXN5_T0DJuyAgQVT4k3jnudOUyDq59p07oITQ Jul 26 07:26:40.322239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Id: None Jul 26 07:26:40.322239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Name: None Jul 26 07:26:40.322239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Identity-Status: Confirmed Jul 26 07:26:40.322239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Is-Admin-Project: True Jul 26 07:26:40.322239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Id: default Jul 26 07:26:40.322239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Name: Default Jul 26 07:26:40.322239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Id: 500111b9c9ca4d8893e64c488668a491 Jul 26 07:26:40.322239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Name: tempest-DeleteServersTestJSON-1190453395 Jul 26 07:26:40.322239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Role: member,reader Jul 26 07:26:40.322239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Roles: member,reader Jul 26 07:26:40.323572 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/500111b9c9ca4d8893e64c488668a491"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_500111b9c9ca4d8893e64c488668a491"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/500111b9c9ca4d8893e64c488668a491"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/500111b9c9ca4d8893e64c488668a491"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:26:40.323572 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant: tempest-DeleteServersTestJSON-1190453395 Jul 26 07:26:40.323572 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Id: 500111b9c9ca4d8893e64c488668a491 Jul 26 07:26:40.323572 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Name: tempest-DeleteServersTestJSON-1190453395 Jul 26 07:26:40.323572 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User: tempest-DeleteServersTestJSON-1190453395-project Jul 26 07:26:40.323572 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Id: default Jul 26 07:26:40.323572 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Name: Default Jul 26 07:26:40.323572 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Id: 8fdc64e58cb041f98d9ea4b8c8cd9e60 Jul 26 07:26:40.323572 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Name: tempest-DeleteServersTestJSON-1190453395-project Jul 26 07:26:40.323572 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: method: > Jul 26 07:26:40.323572 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: exception: Instance b0c489bd-8ed2-4284-b712-9e5829c3fb66 could not be found. Jul 26 07:26:40.323572 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: action_args: {'server_id': 'b0c489bd-8ed2-4284-b712-9e5829c3fb66'} Jul 26 07:26:40.327565 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:26:40.327565 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:26:40.327565 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 07:26:40.327565 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 07:26:40.327565 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 07:26:40.327565 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 07:26:40.327565 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 07:26:40.327565 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 07:26:40.327565 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 07:26:40.327565 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 07:26:40.327565 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0c489bd-8ed2-4284-b712-9e5829c3fb66 could not be found. Jul 26 07:26:40.327565 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:26:40.327565 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:26:40.327565 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:26:40.327565 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:26:40.327565 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:26:40.327565 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:26:40.327565 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:26:40.327565 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:26:40.327565 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:26:40.328855 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:26:40.328855 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 07:26:40.328855 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 07:26:40.328855 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 07:26:40.328855 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 07:26:40.328855 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 26 07:26:40.328855 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 26 07:26:40.328855 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 07:26:40.328855 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:26:40.328855 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0c489bd-8ed2-4284-b712-9e5829c3fb66 could not be found. Jul 26 07:26:40.328855 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:26:40.328855 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:26:40.328855 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:26:40.328855 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:26:40.328855 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:26:40.328855 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:26:40.328855 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:26:40.328855 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:26:40.328855 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0c489bd-8ed2-4284-b712-9e5829c3fb66 could not be found. Jul 26 07:26:40.328855 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:26:40.330227 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-cad4e402-1f66-41c9-8c13-2d0d18be93c4 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Returning 404 to user: Instance b0c489bd-8ed2-4284-b712-9e5829c3fb66 could not be found. {{(pid=117716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:26:40.330227 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-cad4e402-1f66-41c9-8c13-2d0d18be93c4 tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033896 Jul 26 07:26:40.330227 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 73/153] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:26:40 2022] GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 07:26:40.382105 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-80fa4149-567b-404c-b127-21ff6a4bed68 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:40.382677 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-80fa4149-567b-404c-b127-21ff6a4bed68 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:40.391899 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-80fa4149-567b-404c-b127-21ff6a4bed68 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:40.392339 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-80fa4149-567b-404c-b127-21ff6a4bed68 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:40.393099 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-80fa4149-567b-404c-b127-21ff6a4bed68 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:40.393524 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-80fa4149-567b-404c-b127-21ff6a4bed68 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:40.546434 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-80fa4149-567b-404c-b127-21ff6a4bed68 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:40.554576 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-80fa4149-567b-404c-b127-21ff6a4bed68 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.187983 Jul 26 07:26:40.555515 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 81/154] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:40 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:41.550603 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-26f3a651-6ed9-4c64-9b1a-8af6fb6fd3cb tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:41.551115 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-26f3a651-6ed9-4c64-9b1a-8af6fb6fd3cb tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] [instance: b0c489bd-8ed2-4284-b712-9e5829c3fb66] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:41.557989 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-26f3a651-6ed9-4c64-9b1a-8af6fb6fd3cb tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:41.558401 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-26f3a651-6ed9-4c64-9b1a-8af6fb6fd3cb tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:41.559198 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-26f3a651-6ed9-4c64-9b1a-8af6fb6fd3cb tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:41.559616 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-26f3a651-6ed9-4c64-9b1a-8af6fb6fd3cb tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:41.573658 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.wsgi [None req-26f3a651-6ed9-4c64-9b1a-8af6fb6fd3cb tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] HTTP exception thrown: Instance b0c489bd-8ed2-4284-b712-9e5829c3fb66 could not be found. Jul 26 07:26:41.575829 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-26f3a651-6ed9-4c64-9b1a-8af6fb6fd3cb tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Request method failure captured: Jul 26 07:26:41.575829 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: request: DELETE /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66 HTTP/1.1 Jul 26 07:26:41.575829 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept: application/json Jul 26 07:26:41.575829 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept-Encoding: identity Jul 26 07:26:41.575829 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Connection: close Jul 26 07:26:41.575829 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Length: 0 Jul 26 07:26:41.575829 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Type: application/json Jul 26 07:26:41.575829 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Host: 10.222.0.39 Jul 26 07:26:41.575829 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Openstack-System-Scope: None Jul 26 07:26:41.575829 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: User-Agent: python-urllib3/1.26.10 Jul 26 07:26:41.575829 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Auth-Token: gAAAAABi35b1u-SYDBN0F7f7ojFxRU_EaG7imwQaJwQnvfW43P3Gz_7vMd0g-WSA3TQ5r2mME_XnNkNzZ7BXJ7N74Ttn2gAJlBBK2WMN4_6nVhCs_Y47pia_ZOuuBJQHHk9gHnZTcbcS7As9GbiXN5_T0DJuyAgQVT4k3jnudOUyDq59p07oITQ Jul 26 07:26:41.575829 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Id: None Jul 26 07:26:41.575829 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Name: None Jul 26 07:26:41.575829 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Identity-Status: Confirmed Jul 26 07:26:41.575829 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Is-Admin-Project: True Jul 26 07:26:41.575829 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Id: default Jul 26 07:26:41.575829 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Name: Default Jul 26 07:26:41.575829 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Id: 500111b9c9ca4d8893e64c488668a491 Jul 26 07:26:41.575829 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Name: tempest-DeleteServersTestJSON-1190453395 Jul 26 07:26:41.575829 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Role: member,reader Jul 26 07:26:41.575829 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Roles: member,reader Jul 26 07:26:41.577234 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/500111b9c9ca4d8893e64c488668a491"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_500111b9c9ca4d8893e64c488668a491"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/500111b9c9ca4d8893e64c488668a491"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/500111b9c9ca4d8893e64c488668a491"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:26:41.577234 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant: tempest-DeleteServersTestJSON-1190453395 Jul 26 07:26:41.577234 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Id: 500111b9c9ca4d8893e64c488668a491 Jul 26 07:26:41.577234 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Name: tempest-DeleteServersTestJSON-1190453395 Jul 26 07:26:41.577234 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User: tempest-DeleteServersTestJSON-1190453395-project Jul 26 07:26:41.577234 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Id: default Jul 26 07:26:41.577234 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Name: Default Jul 26 07:26:41.577234 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Id: 8fdc64e58cb041f98d9ea4b8c8cd9e60 Jul 26 07:26:41.577234 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Name: tempest-DeleteServersTestJSON-1190453395-project Jul 26 07:26:41.577234 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: method: > Jul 26 07:26:41.577234 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: exception: Instance b0c489bd-8ed2-4284-b712-9e5829c3fb66 could not be found. Jul 26 07:26:41.577234 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: action_args: {'id': 'b0c489bd-8ed2-4284-b712-9e5829c3fb66'} Jul 26 07:26:41.578015 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:26:41.578015 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:26:41.578015 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 07:26:41.578015 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 07:26:41.578015 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 07:26:41.578015 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 07:26:41.578015 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 07:26:41.578015 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 07:26:41.578015 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 07:26:41.578015 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 07:26:41.578015 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0c489bd-8ed2-4284-b712-9e5829c3fb66 could not be found. Jul 26 07:26:41.578015 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:26:41.578015 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:26:41.578015 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:26:41.578015 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:26:41.578015 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:26:41.578015 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:26:41.578015 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:26:41.578015 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:26:41.578015 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:26:41.579244 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:26:41.579244 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 07:26:41.579244 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 07:26:41.579244 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 07:26:41.579244 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 07:26:41.579244 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 07:26:41.579244 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 07:26:41.579244 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 07:26:41.579244 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:26:41.579244 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0c489bd-8ed2-4284-b712-9e5829c3fb66 could not be found. Jul 26 07:26:41.579244 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:26:41.579244 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:26:41.579244 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:26:41.579244 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:26:41.579244 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:26:41.579244 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:26:41.579244 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:26:41.579244 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:26:41.579244 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0c489bd-8ed2-4284-b712-9e5829c3fb66 could not be found. Jul 26 07:26:41.579244 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:26:41.580484 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8b63c526-8280-4799-8732-1e26eb354126 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:41.580908 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-26f3a651-6ed9-4c64-9b1a-8af6fb6fd3cb tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Returning 404 to user: Instance b0c489bd-8ed2-4284-b712-9e5829c3fb66 could not be found. {{(pid=117716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:26:41.581093 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8b63c526-8280-4799-8732-1e26eb354126 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:41.581177 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-26f3a651-6ed9-4c64-9b1a-8af6fb6fd3cb tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66" status: 404 len: 111 microversion: 2.1 time: 0.030563 Jul 26 07:26:41.581177 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 74/155] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Jul 26 07:26:41 2022] DELETE /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 07:26:41.584563 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8b63c526-8280-4799-8732-1e26eb354126 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:41.585008 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8b63c526-8280-4799-8732-1e26eb354126 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:41.585773 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8b63c526-8280-4799-8732-1e26eb354126 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:41.586296 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-5dc98c41-0bed-48bf-a732-0fe4c3be874d tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:41.586459 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8b63c526-8280-4799-8732-1e26eb354126 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:41.586906 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-5dc98c41-0bed-48bf-a732-0fe4c3be874d tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] [instance: b0c489bd-8ed2-4284-b712-9e5829c3fb66] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:41.593305 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5dc98c41-0bed-48bf-a732-0fe4c3be874d tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:41.594101 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5dc98c41-0bed-48bf-a732-0fe4c3be874d tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:41.594854 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5dc98c41-0bed-48bf-a732-0fe4c3be874d tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:41.595280 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5dc98c41-0bed-48bf-a732-0fe4c3be874d tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:41.609206 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.wsgi [None req-5dc98c41-0bed-48bf-a732-0fe4c3be874d tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] HTTP exception thrown: Instance b0c489bd-8ed2-4284-b712-9e5829c3fb66 could not be found. Jul 26 07:26:41.610933 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-5dc98c41-0bed-48bf-a732-0fe4c3be874d tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Request method failure captured: Jul 26 07:26:41.610933 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: request: GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66 HTTP/1.1 Jul 26 07:26:41.610933 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept: application/json Jul 26 07:26:41.610933 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept-Encoding: identity Jul 26 07:26:41.610933 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Connection: close Jul 26 07:26:41.610933 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Length: 0 Jul 26 07:26:41.610933 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Type: application/json Jul 26 07:26:41.610933 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Host: 10.222.0.39 Jul 26 07:26:41.610933 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Openstack-System-Scope: None Jul 26 07:26:41.610933 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: User-Agent: python-urllib3/1.26.10 Jul 26 07:26:41.610933 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Auth-Token: gAAAAABi35b1u-SYDBN0F7f7ojFxRU_EaG7imwQaJwQnvfW43P3Gz_7vMd0g-WSA3TQ5r2mME_XnNkNzZ7BXJ7N74Ttn2gAJlBBK2WMN4_6nVhCs_Y47pia_ZOuuBJQHHk9gHnZTcbcS7As9GbiXN5_T0DJuyAgQVT4k3jnudOUyDq59p07oITQ Jul 26 07:26:41.610933 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Id: None Jul 26 07:26:41.610933 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Name: None Jul 26 07:26:41.610933 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Identity-Status: Confirmed Jul 26 07:26:41.610933 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Is-Admin-Project: True Jul 26 07:26:41.610933 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Id: default Jul 26 07:26:41.610933 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Name: Default Jul 26 07:26:41.610933 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Id: 500111b9c9ca4d8893e64c488668a491 Jul 26 07:26:41.610933 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Name: tempest-DeleteServersTestJSON-1190453395 Jul 26 07:26:41.610933 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Role: member,reader Jul 26 07:26:41.610933 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Roles: member,reader Jul 26 07:26:41.612294 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/500111b9c9ca4d8893e64c488668a491"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_500111b9c9ca4d8893e64c488668a491"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/500111b9c9ca4d8893e64c488668a491"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/500111b9c9ca4d8893e64c488668a491"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:26:41.612294 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant: tempest-DeleteServersTestJSON-1190453395 Jul 26 07:26:41.612294 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Id: 500111b9c9ca4d8893e64c488668a491 Jul 26 07:26:41.612294 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Name: tempest-DeleteServersTestJSON-1190453395 Jul 26 07:26:41.612294 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User: tempest-DeleteServersTestJSON-1190453395-project Jul 26 07:26:41.612294 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Id: default Jul 26 07:26:41.612294 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Name: Default Jul 26 07:26:41.612294 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Id: 8fdc64e58cb041f98d9ea4b8c8cd9e60 Jul 26 07:26:41.612294 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Name: tempest-DeleteServersTestJSON-1190453395-project Jul 26 07:26:41.612294 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: method: > Jul 26 07:26:41.612294 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: exception: Instance b0c489bd-8ed2-4284-b712-9e5829c3fb66 could not be found. Jul 26 07:26:41.612294 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: action_args: {'id': 'b0c489bd-8ed2-4284-b712-9e5829c3fb66'} Jul 26 07:26:41.613087 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:26:41.613087 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:26:41.613087 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 07:26:41.613087 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 07:26:41.613087 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 07:26:41.613087 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 07:26:41.613087 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 07:26:41.613087 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 07:26:41.613087 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 07:26:41.613087 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 07:26:41.613087 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0c489bd-8ed2-4284-b712-9e5829c3fb66 could not be found. Jul 26 07:26:41.613087 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:26:41.613087 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:26:41.613087 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:26:41.613087 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:26:41.613087 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:26:41.613087 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:26:41.613087 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:26:41.613087 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:26:41.613087 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:26:41.614221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:26:41.614221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 07:26:41.614221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 07:26:41.614221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 07:26:41.614221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 07:26:41.614221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 07:26:41.614221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:26:41.614221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0c489bd-8ed2-4284-b712-9e5829c3fb66 could not be found. Jul 26 07:26:41.614221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:26:41.614221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:26:41.614221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:26:41.614221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:26:41.614221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:26:41.614221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:26:41.614221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:26:41.614221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:26:41.614221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0c489bd-8ed2-4284-b712-9e5829c3fb66 could not be found. Jul 26 07:26:41.614221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:26:41.615158 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-5dc98c41-0bed-48bf-a732-0fe4c3be874d tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] Returning 404 to user: Instance b0c489bd-8ed2-4284-b712-9e5829c3fb66 could not be found. {{(pid=117716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:26:41.615158 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-5dc98c41-0bed-48bf-a732-0fe4c3be874d tempest-DeleteServersTestJSON-1190453395 tempest-DeleteServersTestJSON-1190453395-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66" status: 404 len: 111 microversion: 2.1 time: 0.030152 Jul 26 07:26:41.615158 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 75/156] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:41 2022] GET /compute/v2.1/servers/b0c489bd-8ed2-4284-b712-9e5829c3fb66 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 07:26:41.800923 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8b63c526-8280-4799-8732-1e26eb354126 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:41.810527 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8b63c526-8280-4799-8732-1e26eb354126 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.238302 Jul 26 07:26:41.811103 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 82/157] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:41 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:42.833643 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a14c5404-4089-4f03-9593-e6103b825868 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:42.834445 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a14c5404-4089-4f03-9593-e6103b825868 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:42.857651 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a14c5404-4089-4f03-9593-e6103b825868 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:42.859829 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a14c5404-4089-4f03-9593-e6103b825868 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:42.861187 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a14c5404-4089-4f03-9593-e6103b825868 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:42.863140 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a14c5404-4089-4f03-9593-e6103b825868 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:43.090975 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a14c5404-4089-4f03-9593-e6103b825868 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:43.105928 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a14c5404-4089-4f03-9593-e6103b825868 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.276970 Jul 26 07:26:43.110186 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 76/158] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:42 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:44.132676 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-65f734d0-3ac0-4dbf-801e-74ff8cddb2f5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:44.133433 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-65f734d0-3ac0-4dbf-801e-74ff8cddb2f5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:44.141797 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-65f734d0-3ac0-4dbf-801e-74ff8cddb2f5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:44.142686 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-65f734d0-3ac0-4dbf-801e-74ff8cddb2f5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:44.144350 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-65f734d0-3ac0-4dbf-801e-74ff8cddb2f5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:44.144978 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-65f734d0-3ac0-4dbf-801e-74ff8cddb2f5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:44.411312 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-65f734d0-3ac0-4dbf-801e-74ff8cddb2f5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:44.434796 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-65f734d0-3ac0-4dbf-801e-74ff8cddb2f5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.306473 Jul 26 07:26:44.436446 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 83/159] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:44 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:45.457494 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-39040e11-496f-41e6-be9e-ed1a0d8126d0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:45.458157 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-39040e11-496f-41e6-be9e-ed1a0d8126d0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:45.468541 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-39040e11-496f-41e6-be9e-ed1a0d8126d0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:45.472780 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-39040e11-496f-41e6-be9e-ed1a0d8126d0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:45.475004 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-39040e11-496f-41e6-be9e-ed1a0d8126d0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:45.480491 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-39040e11-496f-41e6-be9e-ed1a0d8126d0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:45.756658 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-39040e11-496f-41e6-be9e-ed1a0d8126d0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:45.766993 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-39040e11-496f-41e6-be9e-ed1a0d8126d0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.313940 Jul 26 07:26:45.768267 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 77/160] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:45 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:46.798125 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-78a9a419-b244-42f4-b5d1-7c79bc2b2d64 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:46.799758 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-78a9a419-b244-42f4-b5d1-7c79bc2b2d64 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:46.817682 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-78a9a419-b244-42f4-b5d1-7c79bc2b2d64 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:46.818412 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-78a9a419-b244-42f4-b5d1-7c79bc2b2d64 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:46.819972 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-78a9a419-b244-42f4-b5d1-7c79bc2b2d64 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:46.820848 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-78a9a419-b244-42f4-b5d1-7c79bc2b2d64 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:47.009965 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-78a9a419-b244-42f4-b5d1-7c79bc2b2d64 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:47.021866 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-78a9a419-b244-42f4-b5d1-7c79bc2b2d64 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.228006 Jul 26 07:26:47.028992 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 84/161] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:46 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:26:48.045266 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-94515da9-51a9-458a-930a-22339c21f80b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:48.046141 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-94515da9-51a9-458a-930a-22339c21f80b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:48.053043 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-94515da9-51a9-458a-930a-22339c21f80b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:48.053499 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-94515da9-51a9-458a-930a-22339c21f80b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:48.054448 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-94515da9-51a9-458a-930a-22339c21f80b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:48.054850 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-94515da9-51a9-458a-930a-22339c21f80b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:48.208724 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-94515da9-51a9-458a-930a-22339c21f80b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:48.217687 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-94515da9-51a9-458a-930a-22339c21f80b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.177833 Jul 26 07:26:48.219056 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 78/162] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:48 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:49.242311 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c50cb0b7-80c2-4561-8a80-f30524b7dd27 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:49.242853 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c50cb0b7-80c2-4561-8a80-f30524b7dd27 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:49.250051 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c50cb0b7-80c2-4561-8a80-f30524b7dd27 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:49.250787 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c50cb0b7-80c2-4561-8a80-f30524b7dd27 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:49.251766 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c50cb0b7-80c2-4561-8a80-f30524b7dd27 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:49.252176 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c50cb0b7-80c2-4561-8a80-f30524b7dd27 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:49.388839 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c50cb0b7-80c2-4561-8a80-f30524b7dd27 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:49.397886 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c50cb0b7-80c2-4561-8a80-f30524b7dd27 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.159025 Jul 26 07:26:49.397993 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 85/163] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:49 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:50.424697 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7556b024-f391-45d8-8e85-f17d67f538e3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:50.426908 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7556b024-f391-45d8-8e85-f17d67f538e3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:50.438810 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7556b024-f391-45d8-8e85-f17d67f538e3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:50.440083 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7556b024-f391-45d8-8e85-f17d67f538e3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:50.441788 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7556b024-f391-45d8-8e85-f17d67f538e3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:50.442884 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7556b024-f391-45d8-8e85-f17d67f538e3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:50.688946 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7556b024-f391-45d8-8e85-f17d67f538e3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:50.698016 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7556b024-f391-45d8-8e85-f17d67f538e3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.280792 Jul 26 07:26:50.698793 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 79/164] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:50 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:51.720820 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-323a10d6-bf76-447a-a566-0b588f415f61 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:51.721591 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-323a10d6-bf76-447a-a566-0b588f415f61 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:51.728094 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-323a10d6-bf76-447a-a566-0b588f415f61 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:51.728547 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-323a10d6-bf76-447a-a566-0b588f415f61 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:51.729329 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-323a10d6-bf76-447a-a566-0b588f415f61 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:51.729867 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-323a10d6-bf76-447a-a566-0b588f415f61 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:51.949382 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-323a10d6-bf76-447a-a566-0b588f415f61 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:51.957617 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-323a10d6-bf76-447a-a566-0b588f415f61 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.241185 Jul 26 07:26:51.958506 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 86/165] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:51 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:26:52.983786 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-4bfc489e-c13e-4cf4-958f-64e9743e4418 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:52.984415 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-4bfc489e-c13e-4cf4-958f-64e9743e4418 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:52.991584 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4bfc489e-c13e-4cf4-958f-64e9743e4418 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:52.992036 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4bfc489e-c13e-4cf4-958f-64e9743e4418 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:52.992810 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4bfc489e-c13e-4cf4-958f-64e9743e4418 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:52.993241 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4bfc489e-c13e-4cf4-958f-64e9743e4418 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:53.136618 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-4bfc489e-c13e-4cf4-958f-64e9743e4418 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:53.144522 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-4bfc489e-c13e-4cf4-958f-64e9743e4418 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.164887 Jul 26 07:26:53.145078 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 80/166] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:52 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:53.593506 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-186ad1f1-7c4a-4913-91cd-fe40019c26cf tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-280621278", "imageRef": "b9589773-813f-42af-846a-43bcf9d4d002", "flavorRef": "452"}} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:26:54.166181 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d8eabc5a-58a8-48cb-830b-c49550926ab2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:54.166855 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d8eabc5a-58a8-48cb-830b-c49550926ab2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:54.179712 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d8eabc5a-58a8-48cb-830b-c49550926ab2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:54.180385 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d8eabc5a-58a8-48cb-830b-c49550926ab2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:54.181271 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d8eabc5a-58a8-48cb-830b-c49550926ab2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:54.181826 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d8eabc5a-58a8-48cb-830b-c49550926ab2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:54.327820 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d8eabc5a-58a8-48cb-830b-c49550926ab2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:54.335359 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d8eabc5a-58a8-48cb-830b-c49550926ab2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.173168 Jul 26 07:26:54.335928 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 81/167] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:54 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:55.356584 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b88b9b17-8599-45e7-9b4b-24452ef2099d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:55.357235 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-b88b9b17-8599-45e7-9b4b-24452ef2099d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:55.363947 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b88b9b17-8599-45e7-9b4b-24452ef2099d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:55.364386 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b88b9b17-8599-45e7-9b4b-24452ef2099d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:55.365140 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b88b9b17-8599-45e7-9b4b-24452ef2099d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:55.365563 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b88b9b17-8599-45e7-9b4b-24452ef2099d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:55.516942 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-b88b9b17-8599-45e7-9b4b-24452ef2099d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:55.525579 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b88b9b17-8599-45e7-9b4b-24452ef2099d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.172772 Jul 26 07:26:55.526468 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 82/168] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:55 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:56.548002 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-30691087-78bb-47bb-bcb0-3a70a25308ca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:56.548682 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-30691087-78bb-47bb-bcb0-3a70a25308ca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:56.555809 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-30691087-78bb-47bb-bcb0-3a70a25308ca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:56.556260 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-30691087-78bb-47bb-bcb0-3a70a25308ca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:56.557079 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-30691087-78bb-47bb-bcb0-3a70a25308ca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:56.557515 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-30691087-78bb-47bb-bcb0-3a70a25308ca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:56.716104 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-30691087-78bb-47bb-bcb0-3a70a25308ca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:56.724232 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-30691087-78bb-47bb-bcb0-3a70a25308ca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.180470 Jul 26 07:26:56.724810 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 83/169] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:56 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:26:57.746801 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-3d64e902-70ac-4acf-bcb4-a0cb79816076 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:57.747526 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-3d64e902-70ac-4acf-bcb4-a0cb79816076 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:57.754517 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3d64e902-70ac-4acf-bcb4-a0cb79816076 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:57.754971 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3d64e902-70ac-4acf-bcb4-a0cb79816076 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:57.755754 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3d64e902-70ac-4acf-bcb4-a0cb79816076 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:57.756182 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3d64e902-70ac-4acf-bcb4-a0cb79816076 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:57.895810 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-3d64e902-70ac-4acf-bcb4-a0cb79816076 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:57.903727 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-3d64e902-70ac-4acf-bcb4-a0cb79816076 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.161127 Jul 26 07:26:57.904311 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 84/170] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:57 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:26:58.924766 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2ac36a7a-5485-4034-8014-093e1f3e8244 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:26:58.925380 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2ac36a7a-5485-4034-8014-093e1f3e8244 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:26:58.932087 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2ac36a7a-5485-4034-8014-093e1f3e8244 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:58.932545 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2ac36a7a-5485-4034-8014-093e1f3e8244 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:58.933289 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2ac36a7a-5485-4034-8014-093e1f3e8244 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:26:58.933714 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2ac36a7a-5485-4034-8014-093e1f3e8244 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:26:59.071432 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2ac36a7a-5485-4034-8014-093e1f3e8244 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:26:59.079669 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2ac36a7a-5485-4034-8014-093e1f3e8244 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.158858 Jul 26 07:26:59.080274 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 85/171] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:26:58 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:00.101289 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-e3c4bee7-7f46-4930-8f6c-678cd5a68f79 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:00.101998 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-e3c4bee7-7f46-4930-8f6c-678cd5a68f79 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:00.108813 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e3c4bee7-7f46-4930-8f6c-678cd5a68f79 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:00.109258 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e3c4bee7-7f46-4930-8f6c-678cd5a68f79 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:00.110042 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e3c4bee7-7f46-4930-8f6c-678cd5a68f79 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:00.110470 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e3c4bee7-7f46-4930-8f6c-678cd5a68f79 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:00.246372 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-e3c4bee7-7f46-4930-8f6c-678cd5a68f79 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:00.255304 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-e3c4bee7-7f46-4930-8f6c-678cd5a68f79 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.157380 Jul 26 07:27:00.256156 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 86/172] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:00 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:01.281095 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8be014ed-bf68-48f0-b119-bba47034627b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:01.282408 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8be014ed-bf68-48f0-b119-bba47034627b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:01.289272 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8be014ed-bf68-48f0-b119-bba47034627b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:01.289721 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8be014ed-bf68-48f0-b119-bba47034627b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:01.290554 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8be014ed-bf68-48f0-b119-bba47034627b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:01.290985 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8be014ed-bf68-48f0-b119-bba47034627b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:01.449986 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8be014ed-bf68-48f0-b119-bba47034627b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:01.452456 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:01.459121 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8be014ed-bf68-48f0-b119-bba47034627b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.184581 Jul 26 07:27:01.459695 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 87/173] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:01 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:27:01.954375 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=75 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:02.481415 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d8356c81-4ed6-42ab-b27f-cf31371b00c9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:02.482055 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d8356c81-4ed6-42ab-b27f-cf31371b00c9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:02.488685 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d8356c81-4ed6-42ab-b27f-cf31371b00c9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:02.489112 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d8356c81-4ed6-42ab-b27f-cf31371b00c9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:02.490170 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d8356c81-4ed6-42ab-b27f-cf31371b00c9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:02.490736 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d8356c81-4ed6-42ab-b27f-cf31371b00c9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:02.636700 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d8356c81-4ed6-42ab-b27f-cf31371b00c9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:02.644767 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d8356c81-4ed6-42ab-b27f-cf31371b00c9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.167173 Jul 26 07:27:02.645322 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 88/174] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:02 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:03.604301 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:03.666185 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-e50b35a0-3255-43ff-958f-333fa7a9e44e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:03.666814 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-e50b35a0-3255-43ff-958f-333fa7a9e44e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:03.669295 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=46 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:03.675130 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e50b35a0-3255-43ff-958f-333fa7a9e44e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:03.675581 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e50b35a0-3255-43ff-958f-333fa7a9e44e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:03.676355 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e50b35a0-3255-43ff-958f-333fa7a9e44e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:03.676788 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e50b35a0-3255-43ff-958f-333fa7a9e44e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:03.812541 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-e50b35a0-3255-43ff-958f-333fa7a9e44e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:03.820280 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-e50b35a0-3255-43ff-958f-333fa7a9e44e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.158067 Jul 26 07:27:03.820829 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 89/175] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:03 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:04.840819 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-5ad8c87b-32bc-4cd5-aebd-3d8a6a9f24b2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:04.841604 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-5ad8c87b-32bc-4cd5-aebd-3d8a6a9f24b2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:04.848984 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5ad8c87b-32bc-4cd5-aebd-3d8a6a9f24b2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:04.849429 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5ad8c87b-32bc-4cd5-aebd-3d8a6a9f24b2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:04.850222 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5ad8c87b-32bc-4cd5-aebd-3d8a6a9f24b2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:04.850646 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5ad8c87b-32bc-4cd5-aebd-3d8a6a9f24b2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:04.994549 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-5ad8c87b-32bc-4cd5-aebd-3d8a6a9f24b2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:05.002296 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-5ad8c87b-32bc-4cd5-aebd-3d8a6a9f24b2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.165383 Jul 26 07:27:05.002873 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 90/176] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:04 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:27:05.506706 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.network.neutron [None req-186ad1f1-7c4a-4913-91cd-fe40019c26cf tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] validate_networks() for None {{(pid=117715) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 07:27:05.941169 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-186ad1f1-7c4a-4913-91cd-fe40019c26cf tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Flavor limits 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 07:27:05.941641 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-186ad1f1-7c4a-4913-91cd-fe40019c26cf tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Image limits 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 07:27:05.942138 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-186ad1f1-7c4a-4913-91cd-fe40019c26cf tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Flavor pref 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 07:27:05.942535 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-186ad1f1-7c4a-4913-91cd-fe40019c26cf tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Image pref 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 07:27:05.942956 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-186ad1f1-7c4a-4913-91cd-fe40019c26cf tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 07:27:05.953835 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-186ad1f1-7c4a-4913-91cd-fe40019c26cf tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:05.954278 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-186ad1f1-7c4a-4913-91cd-fe40019c26cf tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:05.955059 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-186ad1f1-7c4a-4913-91cd-fe40019c26cf tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:05.955753 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-186ad1f1-7c4a-4913-91cd-fe40019c26cf tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:05.982157 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.quota [None req-186ad1f1-7c4a-4913-91cd-fe40019c26cf tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Getting quotas for project e29dfb4148ff4076a2e42df6b2460aa5. Resources: {'instances', 'cores', 'ram'} {{(pid=117715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 07:27:05.988350 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.quota [None req-186ad1f1-7c4a-4913-91cd-fe40019c26cf tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Getting quotas for user 150235a48e694c8584f4ac521510c80a and project e29dfb4148ff4076a2e42df6b2460aa5. Resources: {'instances', 'cores', 'ram'} {{(pid=117715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 07:27:06.004170 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-186ad1f1-7c4a-4913-91cd-fe40019c26cf tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Going to run 1 instances... {{(pid=117715) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 07:27:06.006720 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-186ad1f1-7c4a-4913-91cd-fe40019c26cf tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] [instance: 3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9589773-813f-42af-846a-43bcf9d4d002',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 07:27:06.024694 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ec9c4acf-1ecd-4589-8a76-29324ea26f10 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:06.026023 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ec9c4acf-1ecd-4589-8a76-29324ea26f10 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:06.034432 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ec9c4acf-1ecd-4589-8a76-29324ea26f10 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:06.035114 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ec9c4acf-1ecd-4589-8a76-29324ea26f10 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:06.036116 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ec9c4acf-1ecd-4589-8a76-29324ea26f10 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:06.036775 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ec9c4acf-1ecd-4589-8a76-29324ea26f10 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:06.058098 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-186ad1f1-7c4a-4913-91cd-fe40019c26cf tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 12.469249 Jul 26 07:27:06.059106 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 87/177] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Jul 26 07:26:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 12471 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 07:27:06.070458 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-130a7a7d-6726-4eea-b781-b39246fa9af5 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:06.071062 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-130a7a7d-6726-4eea-b781-b39246fa9af5 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] [instance: 3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:06.134599 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-130a7a7d-6726-4eea-b781-b39246fa9af5 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150235a48e694c8584f4ac521510c80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29dfb4148ff4076a2e42df6b2460aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:06.144907 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-130a7a7d-6726-4eea-b781-b39246fa9af5 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] 10.222.0.39 "GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c" status: 200 len: 1214 microversion: 2.1 time: 0.078556 Jul 26 07:27:06.145652 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 88/178] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:06 2022] GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:27:06.285415 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ec9c4acf-1ecd-4589-8a76-29324ea26f10 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:06.307374 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ec9c4acf-1ecd-4589-8a76-29324ea26f10 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.287168 Jul 26 07:27:06.307926 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 91/179] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:06 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:27:07.165776 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3302ec03-dc68-464b-90c8-891cc9d4094b tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:07.166318 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3302ec03-dc68-464b-90c8-891cc9d4094b tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] [instance: 3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:07.173717 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3302ec03-dc68-464b-90c8-891cc9d4094b tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:07.174205 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3302ec03-dc68-464b-90c8-891cc9d4094b tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:07.174998 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3302ec03-dc68-464b-90c8-891cc9d4094b tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:07.175427 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3302ec03-dc68-464b-90c8-891cc9d4094b tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:07.239307 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3302ec03-dc68-464b-90c8-891cc9d4094b tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150235a48e694c8584f4ac521510c80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29dfb4148ff4076a2e42df6b2460aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:07.246991 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3302ec03-dc68-464b-90c8-891cc9d4094b tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] 10.222.0.39 "GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c" status: 200 len: 1266 microversion: 2.1 time: 0.085386 Jul 26 07:27:07.247559 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 89/180] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:07 2022] GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:27:07.328687 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-5449407b-5cfb-422d-bf05-050f8c22edc0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:07.329269 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-5449407b-5cfb-422d-bf05-050f8c22edc0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:07.336521 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5449407b-5cfb-422d-bf05-050f8c22edc0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:07.336995 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5449407b-5cfb-422d-bf05-050f8c22edc0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:07.337777 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5449407b-5cfb-422d-bf05-050f8c22edc0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:07.338284 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5449407b-5cfb-422d-bf05-050f8c22edc0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:07.470166 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-5449407b-5cfb-422d-bf05-050f8c22edc0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:07.478035 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-5449407b-5cfb-422d-bf05-050f8c22edc0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1520 microversion: 2.1 time: 0.153272 Jul 26 07:27:07.478611 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 92/181] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:07 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:08.085548 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9e35b11f-aa8b-4dd9-b6a4-c86a6cf48352 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-790159583", "imageRef": "b9589773-813f-42af-846a-43bcf9d4d002", "flavorRef": "452", "networks": [{"uuid": "b429f2bc-8187-46e0-8801-0af25835d0c5"}]}} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:27:08.139366 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.network.neutron [None req-9e35b11f-aa8b-4dd9-b6a4-c86a6cf48352 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] validate_networks() for [('b429f2bc-8187-46e0-8801-0af25835d0c5', None, None, None, None, None)] {{(pid=117715) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 07:27:08.267275 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6e3acfc4-df7d-4267-be9b-2bdb09459807 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:08.267892 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6e3acfc4-df7d-4267-be9b-2bdb09459807 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] [instance: 3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:08.275007 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6e3acfc4-df7d-4267-be9b-2bdb09459807 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:08.275386 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6e3acfc4-df7d-4267-be9b-2bdb09459807 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:08.276260 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6e3acfc4-df7d-4267-be9b-2bdb09459807 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:08.276614 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6e3acfc4-df7d-4267-be9b-2bdb09459807 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:08.349754 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6e3acfc4-df7d-4267-be9b-2bdb09459807 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150235a48e694c8584f4ac521510c80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29dfb4148ff4076a2e42df6b2460aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:08.360619 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6e3acfc4-df7d-4267-be9b-2bdb09459807 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] 10.222.0.39 "GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c" status: 200 len: 1272 microversion: 2.1 time: 0.096613 Jul 26 07:27:08.361660 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 93/182] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:08 2022] GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c => generated 1272 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:27:08.505773 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b94c9ac3-73ed-4271-8756-462921f0247b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:08.506616 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-b94c9ac3-73ed-4271-8756-462921f0247b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:08.516898 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-9e35b11f-aa8b-4dd9-b6a4-c86a6cf48352 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Flavor limits 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 07:27:08.521374 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b94c9ac3-73ed-4271-8756-462921f0247b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:08.521842 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-9e35b11f-aa8b-4dd9-b6a4-c86a6cf48352 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Image limits 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 07:27:08.522525 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-9e35b11f-aa8b-4dd9-b6a4-c86a6cf48352 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Flavor pref 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 07:27:08.523506 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b94c9ac3-73ed-4271-8756-462921f0247b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:08.523950 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-9e35b11f-aa8b-4dd9-b6a4-c86a6cf48352 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Image pref 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 07:27:08.524828 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b94c9ac3-73ed-4271-8756-462921f0247b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:08.525405 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-9e35b11f-aa8b-4dd9-b6a4-c86a6cf48352 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 07:27:08.528314 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b94c9ac3-73ed-4271-8756-462921f0247b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:08.541043 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9e35b11f-aa8b-4dd9-b6a4-c86a6cf48352 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:08.542196 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9e35b11f-aa8b-4dd9-b6a4-c86a6cf48352 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:08.543660 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9e35b11f-aa8b-4dd9-b6a4-c86a6cf48352 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:08.544308 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9e35b11f-aa8b-4dd9-b6a4-c86a6cf48352 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:08.567217 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.quota [None req-9e35b11f-aa8b-4dd9-b6a4-c86a6cf48352 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Getting quotas for project c9cbf9b8d2e646eb945deb24d55fa0ad. Resources: {'instances', 'cores', 'ram'} {{(pid=117715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 07:27:08.571958 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.quota [None req-9e35b11f-aa8b-4dd9-b6a4-c86a6cf48352 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Getting quotas for user 7a4c3b33511646b59d89dc933827dcb5 and project c9cbf9b8d2e646eb945deb24d55fa0ad. Resources: {'instances', 'cores', 'ram'} {{(pid=117715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 07:27:08.583987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-9e35b11f-aa8b-4dd9-b6a4-c86a6cf48352 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Going to run 1 instances... {{(pid=117715) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 07:27:08.586186 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-9e35b11f-aa8b-4dd9-b6a4-c86a6cf48352 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: 315dc80e-29c8-4ccc-a45d-1eac4c3ba00d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9589773-813f-42af-846a-43bcf9d4d002',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 07:27:08.640824 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-9e35b11f-aa8b-4dd9-b6a4-c86a6cf48352 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.557892 Jul 26 07:27:08.641577 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 90/183] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Jul 26 07:27:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 07:27:08.655517 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-54d6932c-b315-4b8e-a350-1594ef33f7c8 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:08.656505 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-54d6932c-b315-4b8e-a350-1594ef33f7c8 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: 315dc80e-29c8-4ccc-a45d-1eac4c3ba00d] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:08.712887 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-54d6932c-b315-4b8e-a350-1594ef33f7c8 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:08.723721 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-54d6932c-b315-4b8e-a350-1594ef33f7c8 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/315dc80e-29c8-4ccc-a45d-1eac4c3ba00d" status: 200 len: 1213 microversion: 2.1 time: 0.074502 Jul 26 07:27:08.724473 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 91/184] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:08 2022] GET /compute/v2.1/servers/315dc80e-29c8-4ccc-a45d-1eac4c3ba00d => generated 1213 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:08.729789 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-b94c9ac3-73ed-4271-8756-462921f0247b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:08.738547 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b94c9ac3-73ed-4271-8756-462921f0247b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1500 microversion: 2.1 time: 0.241096 Jul 26 07:27:08.739279 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 94/185] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:08 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1500 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:27:08.759239 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-90359d5d-61cf-451a-934e-22ed48f5e7f1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:08.760081 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-90359d5d-61cf-451a-934e-22ed48f5e7f1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:08.766534 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-90359d5d-61cf-451a-934e-22ed48f5e7f1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:08.767652 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-90359d5d-61cf-451a-934e-22ed48f5e7f1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:08.768401 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-90359d5d-61cf-451a-934e-22ed48f5e7f1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:08.768822 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-90359d5d-61cf-451a-934e-22ed48f5e7f1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:08.995078 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-90359d5d-61cf-451a-934e-22ed48f5e7f1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:09.003945 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-90359d5d-61cf-451a-934e-22ed48f5e7f1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669" status: 200 len: 1514 microversion: 2.1 time: 0.248441 Jul 26 07:27:09.004540 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 92/186] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:08 2022] GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669 => generated 1514 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:09.382480 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0e7b6a0a-587b-40b0-afbf-cc400151cb2b tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:09.383546 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0e7b6a0a-587b-40b0-afbf-cc400151cb2b tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] [instance: 3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:09.395746 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0e7b6a0a-587b-40b0-afbf-cc400151cb2b tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:09.396334 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0e7b6a0a-587b-40b0-afbf-cc400151cb2b tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:09.397130 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0e7b6a0a-587b-40b0-afbf-cc400151cb2b tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:09.408118 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0e7b6a0a-587b-40b0-afbf-cc400151cb2b tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:09.696556 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0e7b6a0a-587b-40b0-afbf-cc400151cb2b tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150235a48e694c8584f4ac521510c80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29dfb4148ff4076a2e42df6b2460aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:09.704261 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0e7b6a0a-587b-40b0-afbf-cc400151cb2b tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] 10.222.0.39 "GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c" status: 200 len: 1314 microversion: 2.1 time: 0.325879 Jul 26 07:27:09.704846 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 95/187] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:09 2022] GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:09.744873 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-62b7432e-9a39-46a3-89f8-ddb1ec285f40 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:09.745470 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-62b7432e-9a39-46a3-89f8-ddb1ec285f40 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: 315dc80e-29c8-4ccc-a45d-1eac4c3ba00d] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:09.751788 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-62b7432e-9a39-46a3-89f8-ddb1ec285f40 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:09.752245 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-62b7432e-9a39-46a3-89f8-ddb1ec285f40 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:09.753015 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-62b7432e-9a39-46a3-89f8-ddb1ec285f40 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:09.753446 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-62b7432e-9a39-46a3-89f8-ddb1ec285f40 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:09.799432 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-8f38ecd8-e8b3-460b-8403-ea4639bb0835 req-32a0e7da-a4bf-4231-a4b1-a8bda5f752fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c", "tag": "ff2b2952-d51d-46a8-bc8c-34bec2c5e16e"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:27:09.812820 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-8f38ecd8-e8b3-460b-8403-ea4639bb0835 req-32a0e7da-a4bf-4231-a4b1-a8bda5f752fc service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:09.813101 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-8f38ecd8-e8b3-460b-8403-ea4639bb0835 req-32a0e7da-a4bf-4231-a4b1-a8bda5f752fc service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:09.826167 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-8f38ecd8-e8b3-460b-8403-ea4639bb0835 req-32a0e7da-a4bf-4231-a4b1-a8bda5f752fc service nova] Creating event network-changed:ff2b2952-d51d-46a8-bc8c-34bec2c5e16e for instance 3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c on hv-cinder-85083 Jul 26 07:27:09.831167 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-8f38ecd8-e8b3-460b-8403-ea4639bb0835 req-32a0e7da-a4bf-4231-a4b1-a8bda5f752fc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044890 Jul 26 07:27:09.832140 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 96/188] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:27:09.835660 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-62b7432e-9a39-46a3-89f8-ddb1ec285f40 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:09.844176 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-62b7432e-9a39-46a3-89f8-ddb1ec285f40 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/315dc80e-29c8-4ccc-a45d-1eac4c3ba00d" status: 200 len: 1265 microversion: 2.1 time: 0.102852 Jul 26 07:27:09.845131 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 93/189] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:09 2022] GET /compute/v2.1/servers/315dc80e-29c8-4ccc-a45d-1eac4c3ba00d => generated 1265 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:10.527308 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f1802a80-e8d8-4ffb-b19d-16c3e45212aa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:27:10.529791 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-f1802a80-e8d8-4ffb-b19d-16c3e45212aa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:10.536686 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f1802a80-e8d8-4ffb-b19d-16c3e45212aa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:10.537138 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f1802a80-e8d8-4ffb-b19d-16c3e45212aa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:10.537997 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f1802a80-e8d8-4ffb-b19d-16c3e45212aa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:10.538470 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f1802a80-e8d8-4ffb-b19d-16c3e45212aa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:10.567910 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.objects.instance [None req-f1802a80-e8d8-4ffb-b19d-16c3e45212aa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lazy-loading 'flavor' on Instance uuid 80da1213-270f-4afc-87f8-345874caa669 {{(pid=117716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 07:27:10.695229 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f1802a80-e8d8-4ffb-b19d-16c3e45212aa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "POST /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669/action" status: 200 len: 32 microversion: 2.1 time: 0.173062 Jul 26 07:27:10.696015 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 97/190] 10.222.0.39 () {60 vars in 1278 bytes} [Tue Jul 26 07:27:10 2022] POST /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669/action => generated 32 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 07:27:10.706784 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7c210d52-c287-4a9d-bbb6-50a637b27231 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:10.707166 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7c210d52-c287-4a9d-bbb6-50a637b27231 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:10.715430 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7c210d52-c287-4a9d-bbb6-50a637b27231 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:10.715996 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7c210d52-c287-4a9d-bbb6-50a637b27231 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:10.716659 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7c210d52-c287-4a9d-bbb6-50a637b27231 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:10.717093 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7c210d52-c287-4a9d-bbb6-50a637b27231 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:10.725609 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-5f0f558e-d0c5-4da3-8451-e0437a71a0d1 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:10.726433 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-5f0f558e-d0c5-4da3-8451-e0437a71a0d1 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] [instance: 3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:10.734363 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5f0f558e-d0c5-4da3-8451-e0437a71a0d1 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:10.734805 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5f0f558e-d0c5-4da3-8451-e0437a71a0d1 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:10.735556 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5f0f558e-d0c5-4da3-8451-e0437a71a0d1 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:10.735992 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5f0f558e-d0c5-4da3-8451-e0437a71a0d1 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:10.854198 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7c210d52-c287-4a9d-bbb6-50a637b27231 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:10.862210 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7c210d52-c287-4a9d-bbb6-50a637b27231 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669" status: 200 len: 1520 microversion: 2.1 time: 0.160542 Jul 26 07:27:10.862793 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 94/191] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:10 2022] GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:27:10.867716 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-098c4ede-e8a1-467c-a91d-facc85bab4ba tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:10.868456 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-098c4ede-e8a1-467c-a91d-facc85bab4ba tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: 315dc80e-29c8-4ccc-a45d-1eac4c3ba00d] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:10.874708 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-098c4ede-e8a1-467c-a91d-facc85bab4ba tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:10.875150 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-098c4ede-e8a1-467c-a91d-facc85bab4ba tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:10.875916 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-098c4ede-e8a1-467c-a91d-facc85bab4ba tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:10.876343 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-098c4ede-e8a1-467c-a91d-facc85bab4ba tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:10.943508 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-098c4ede-e8a1-467c-a91d-facc85bab4ba tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:10.952341 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-098c4ede-e8a1-467c-a91d-facc85bab4ba tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/315dc80e-29c8-4ccc-a45d-1eac4c3ba00d" status: 200 len: 1271 microversion: 2.1 time: 0.088048 Jul 26 07:27:10.952886 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 95/192] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:10 2022] GET /compute/v2.1/servers/315dc80e-29c8-4ccc-a45d-1eac4c3ba00d => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:11.085449 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-5f0f558e-d0c5-4da3-8451-e0437a71a0d1 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150235a48e694c8584f4ac521510c80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29dfb4148ff4076a2e42df6b2460aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:11.094245 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-5f0f558e-d0c5-4da3-8451-e0437a71a0d1 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] 10.222.0.39 "GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c" status: 200 len: 1314 microversion: 2.1 time: 0.372446 Jul 26 07:27:11.094768 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 98/193] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:10 2022] GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:11.883396 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-0c317b07-6d77-4314-9f4e-352f80ce6063 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:11.883919 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-0c317b07-6d77-4314-9f4e-352f80ce6063 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:11.890487 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0c317b07-6d77-4314-9f4e-352f80ce6063 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:11.891001 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0c317b07-6d77-4314-9f4e-352f80ce6063 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:11.891758 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0c317b07-6d77-4314-9f4e-352f80ce6063 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:11.892184 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0c317b07-6d77-4314-9f4e-352f80ce6063 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:11.975154 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-446cffec-8a14-45f4-b020-0c3272edc764 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:11.975763 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-446cffec-8a14-45f4-b020-0c3272edc764 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: 315dc80e-29c8-4ccc-a45d-1eac4c3ba00d] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:11.982816 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-446cffec-8a14-45f4-b020-0c3272edc764 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:11.983345 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-446cffec-8a14-45f4-b020-0c3272edc764 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:11.984119 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-446cffec-8a14-45f4-b020-0c3272edc764 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:11.984649 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-446cffec-8a14-45f4-b020-0c3272edc764 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:12.022819 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-0c317b07-6d77-4314-9f4e-352f80ce6063 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:12.031044 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-0c317b07-6d77-4314-9f4e-352f80ce6063 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669" status: 200 len: 1520 microversion: 2.1 time: 0.151603 Jul 26 07:27:12.031882 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 96/194] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:11 2022] GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:12.115073 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b1030fff-dc9d-4388-86f8-22533c3306c7 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:12.115673 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b1030fff-dc9d-4388-86f8-22533c3306c7 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] [instance: 3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:12.119368 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-446cffec-8a14-45f4-b020-0c3272edc764 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:12.121907 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b1030fff-dc9d-4388-86f8-22533c3306c7 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:12.122358 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b1030fff-dc9d-4388-86f8-22533c3306c7 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:12.123105 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b1030fff-dc9d-4388-86f8-22533c3306c7 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:12.123522 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b1030fff-dc9d-4388-86f8-22533c3306c7 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:12.127698 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-446cffec-8a14-45f4-b020-0c3272edc764 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/315dc80e-29c8-4ccc-a45d-1eac4c3ba00d" status: 200 len: 1313 microversion: 2.1 time: 0.156394 Jul 26 07:27:12.128367 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 99/195] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:11 2022] GET /compute/v2.1/servers/315dc80e-29c8-4ccc-a45d-1eac4c3ba00d => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:12.254636 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-b1030fff-dc9d-4388-86f8-22533c3306c7 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150235a48e694c8584f4ac521510c80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29dfb4148ff4076a2e42df6b2460aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:12.262133 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b1030fff-dc9d-4388-86f8-22533c3306c7 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] 10.222.0.39 "GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c" status: 200 len: 1314 microversion: 2.1 time: 0.151003 Jul 26 07:27:12.262709 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 97/196] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:12 2022] GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:27:13.052565 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-aa8d8013-53b2-4686-a8ed-2a803b059eaa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:13.053454 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-aa8d8013-53b2-4686-a8ed-2a803b059eaa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:13.060568 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-aa8d8013-53b2-4686-a8ed-2a803b059eaa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:13.061032 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-aa8d8013-53b2-4686-a8ed-2a803b059eaa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:13.062093 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-aa8d8013-53b2-4686-a8ed-2a803b059eaa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:13.062608 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-aa8d8013-53b2-4686-a8ed-2a803b059eaa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:13.157449 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9d6869a5-41c4-4c7a-abe3-e6a00eaebc63 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:13.158277 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-9d6869a5-41c4-4c7a-abe3-e6a00eaebc63 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: 315dc80e-29c8-4ccc-a45d-1eac4c3ba00d] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:13.164581 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9d6869a5-41c4-4c7a-abe3-e6a00eaebc63 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:13.165128 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9d6869a5-41c4-4c7a-abe3-e6a00eaebc63 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:13.165934 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9d6869a5-41c4-4c7a-abe3-e6a00eaebc63 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:13.166415 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9d6869a5-41c4-4c7a-abe3-e6a00eaebc63 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:13.298512 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-9d6869a5-41c4-4c7a-abe3-e6a00eaebc63 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:13.306408 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-9d6869a5-41c4-4c7a-abe3-e6a00eaebc63 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/315dc80e-29c8-4ccc-a45d-1eac4c3ba00d" status: 200 len: 1313 microversion: 2.1 time: 0.154716 Jul 26 07:27:13.306987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 98/197] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:13 2022] GET /compute/v2.1/servers/315dc80e-29c8-4ccc-a45d-1eac4c3ba00d => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:27:13.311638 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-cbae6e56-e2a2-4f11-9e58-0fa59dc52b5f tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:13.312231 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-cbae6e56-e2a2-4f11-9e58-0fa59dc52b5f tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] [instance: 3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:13.318299 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cbae6e56-e2a2-4f11-9e58-0fa59dc52b5f tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:13.318731 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cbae6e56-e2a2-4f11-9e58-0fa59dc52b5f tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:13.319531 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cbae6e56-e2a2-4f11-9e58-0fa59dc52b5f tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:13.319939 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cbae6e56-e2a2-4f11-9e58-0fa59dc52b5f tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:13.329524 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-aa8d8013-53b2-4686-a8ed-2a803b059eaa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:13.337922 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-aa8d8013-53b2-4686-a8ed-2a803b059eaa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669" status: 200 len: 1520 microversion: 2.1 time: 0.289160 Jul 26 07:27:13.339065 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 100/198] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:13 2022] GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669 => generated 1520 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:13.460002 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-cbae6e56-e2a2-4f11-9e58-0fa59dc52b5f tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150235a48e694c8584f4ac521510c80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29dfb4148ff4076a2e42df6b2460aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:13.469020 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-cbae6e56-e2a2-4f11-9e58-0fa59dc52b5f tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] 10.222.0.39 "GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c" status: 200 len: 1314 microversion: 2.1 time: 0.160618 Jul 26 07:27:13.469837 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 99/199] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:13 2022] GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:13.680063 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-0bb2b7e0-bea3-4504-bd36-a9017fed6026 req-253e8782-96bf-40a6-bb49-83d34a81eea0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "315dc80e-29c8-4ccc-a45d-1eac4c3ba00d", "tag": "021742ce-c417-4166-a80e-c4ba51e4ff2d"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:27:13.694783 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-0bb2b7e0-bea3-4504-bd36-a9017fed6026 req-253e8782-96bf-40a6-bb49-83d34a81eea0 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:13.696947 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-0bb2b7e0-bea3-4504-bd36-a9017fed6026 req-253e8782-96bf-40a6-bb49-83d34a81eea0 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:13.712106 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-0bb2b7e0-bea3-4504-bd36-a9017fed6026 req-253e8782-96bf-40a6-bb49-83d34a81eea0 service nova] Creating event network-changed:021742ce-c417-4166-a80e-c4ba51e4ff2d for instance 315dc80e-29c8-4ccc-a45d-1eac4c3ba00d on hv-cinder-85083 Jul 26 07:27:13.717033 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-0bb2b7e0-bea3-4504-bd36-a9017fed6026 req-253e8782-96bf-40a6-bb49-83d34a81eea0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041452 Jul 26 07:27:13.717898 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 101/200] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:27:14.327629 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-27507921-35d0-422e-a372-3fd4060b0b84 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:14.328243 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-27507921-35d0-422e-a372-3fd4060b0b84 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: 315dc80e-29c8-4ccc-a45d-1eac4c3ba00d] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:14.334930 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-27507921-35d0-422e-a372-3fd4060b0b84 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:14.335459 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-27507921-35d0-422e-a372-3fd4060b0b84 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:14.336306 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-27507921-35d0-422e-a372-3fd4060b0b84 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:14.336804 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-27507921-35d0-422e-a372-3fd4060b0b84 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:14.361122 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ea45d1ee-55a1-486d-a872-f8120ca31ab9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:14.361946 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ea45d1ee-55a1-486d-a872-f8120ca31ab9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:14.368915 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ea45d1ee-55a1-486d-a872-f8120ca31ab9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:14.369440 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ea45d1ee-55a1-486d-a872-f8120ca31ab9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:14.370425 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ea45d1ee-55a1-486d-a872-f8120ca31ab9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:14.371123 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ea45d1ee-55a1-486d-a872-f8120ca31ab9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:14.497733 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-27507921-35d0-422e-a372-3fd4060b0b84 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:14.506497 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-27507921-35d0-422e-a372-3fd4060b0b84 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/315dc80e-29c8-4ccc-a45d-1eac4c3ba00d" status: 200 len: 1313 microversion: 2.1 time: 0.182624 Jul 26 07:27:14.507369 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 100/201] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:14 2022] GET /compute/v2.1/servers/315dc80e-29c8-4ccc-a45d-1eac4c3ba00d => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:14.512595 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f21e59db-e29f-484a-b940-df54e7bc0fee tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:14.513212 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f21e59db-e29f-484a-b940-df54e7bc0fee tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] [instance: 3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:14.521546 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f21e59db-e29f-484a-b940-df54e7bc0fee tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:14.522047 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f21e59db-e29f-484a-b940-df54e7bc0fee tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:14.522881 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f21e59db-e29f-484a-b940-df54e7bc0fee tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:14.523312 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f21e59db-e29f-484a-b940-df54e7bc0fee tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:14.683042 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f21e59db-e29f-484a-b940-df54e7bc0fee tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150235a48e694c8584f4ac521510c80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29dfb4148ff4076a2e42df6b2460aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:14.683286 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ea45d1ee-55a1-486d-a872-f8120ca31ab9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:14.692122 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f21e59db-e29f-484a-b940-df54e7bc0fee tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] 10.222.0.39 "GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c" status: 200 len: 1314 microversion: 2.1 time: 0.183455 Jul 26 07:27:14.692756 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 101/202] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:14 2022] GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:14.695881 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ea45d1ee-55a1-486d-a872-f8120ca31ab9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669" status: 200 len: 1520 microversion: 2.1 time: 0.340193 Jul 26 07:27:14.696989 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 102/203] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:14 2022] GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669 => generated 1520 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:27:15.528560 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-fe1d0420-486c-4121-97cb-acb8b7762d6c tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:15.529149 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-fe1d0420-486c-4121-97cb-acb8b7762d6c tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: 315dc80e-29c8-4ccc-a45d-1eac4c3ba00d] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:15.535673 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fe1d0420-486c-4121-97cb-acb8b7762d6c tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:15.536123 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fe1d0420-486c-4121-97cb-acb8b7762d6c tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:15.536879 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fe1d0420-486c-4121-97cb-acb8b7762d6c tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:15.537306 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fe1d0420-486c-4121-97cb-acb8b7762d6c tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:15.672400 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-fe1d0420-486c-4121-97cb-acb8b7762d6c tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:15.679951 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-fe1d0420-486c-4121-97cb-acb8b7762d6c tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/315dc80e-29c8-4ccc-a45d-1eac4c3ba00d" status: 200 len: 1313 microversion: 2.1 time: 0.155351 Jul 26 07:27:15.680493 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 102/204] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:15 2022] GET /compute/v2.1/servers/315dc80e-29c8-4ccc-a45d-1eac4c3ba00d => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:15.713197 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d4e3980b-ec01-4dd3-8bc7-eabd1bb1b126 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:15.713919 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d4e3980b-ec01-4dd3-8bc7-eabd1bb1b126 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] [instance: 3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:15.719352 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3744a05d-aa6f-4b6a-a95a-9a3d8fe4f806 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:15.719987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3744a05d-aa6f-4b6a-a95a-9a3d8fe4f806 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:15.721324 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d4e3980b-ec01-4dd3-8bc7-eabd1bb1b126 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:15.721813 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d4e3980b-ec01-4dd3-8bc7-eabd1bb1b126 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:15.722629 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d4e3980b-ec01-4dd3-8bc7-eabd1bb1b126 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:15.723047 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d4e3980b-ec01-4dd3-8bc7-eabd1bb1b126 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:15.726268 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3744a05d-aa6f-4b6a-a95a-9a3d8fe4f806 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:15.726714 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3744a05d-aa6f-4b6a-a95a-9a3d8fe4f806 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:15.727468 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3744a05d-aa6f-4b6a-a95a-9a3d8fe4f806 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:15.727920 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3744a05d-aa6f-4b6a-a95a-9a3d8fe4f806 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:15.858307 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3744a05d-aa6f-4b6a-a95a-9a3d8fe4f806 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:15.861653 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d4e3980b-ec01-4dd3-8bc7-eabd1bb1b126 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150235a48e694c8584f4ac521510c80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29dfb4148ff4076a2e42df6b2460aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:15.865826 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:15.866715 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3744a05d-aa6f-4b6a-a95a-9a3d8fe4f806 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669" status: 200 len: 1520 microversion: 2.1 time: 0.151393 Jul 26 07:27:15.867743 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 103/205] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:15 2022] GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:15.872525 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d4e3980b-ec01-4dd3-8bc7-eabd1bb1b126 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] 10.222.0.39 "GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c" status: 200 len: 1314 microversion: 2.1 time: 0.163316 Jul 26 07:27:15.873159 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 103/206] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:15 2022] GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:16.701000 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-4f260647-0275-472b-99ee-46e7b0a1ac43 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:16.701677 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-4f260647-0275-472b-99ee-46e7b0a1ac43 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: 315dc80e-29c8-4ccc-a45d-1eac4c3ba00d] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:16.708655 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4f260647-0275-472b-99ee-46e7b0a1ac43 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:16.709102 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4f260647-0275-472b-99ee-46e7b0a1ac43 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:16.709923 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4f260647-0275-472b-99ee-46e7b0a1ac43 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:16.710369 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4f260647-0275-472b-99ee-46e7b0a1ac43 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:16.843833 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-4f260647-0275-472b-99ee-46e7b0a1ac43 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:16.851573 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-4f260647-0275-472b-99ee-46e7b0a1ac43 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/315dc80e-29c8-4ccc-a45d-1eac4c3ba00d" status: 200 len: 1313 microversion: 2.1 time: 0.154635 Jul 26 07:27:16.852163 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 104/207] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:16 2022] GET /compute/v2.1/servers/315dc80e-29c8-4ccc-a45d-1eac4c3ba00d => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:16.888908 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2acc4dd4-fed2-4e08-8e23-2d63d30955d5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:16.889688 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2acc4dd4-fed2-4e08-8e23-2d63d30955d5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:16.892827 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6fed3c87-c29c-4d74-9e28-2d3ee9249dcd tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:16.893493 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-6fed3c87-c29c-4d74-9e28-2d3ee9249dcd tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] [instance: 3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:16.897527 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2acc4dd4-fed2-4e08-8e23-2d63d30955d5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:16.898006 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2acc4dd4-fed2-4e08-8e23-2d63d30955d5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:16.898774 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2acc4dd4-fed2-4e08-8e23-2d63d30955d5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:16.899206 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2acc4dd4-fed2-4e08-8e23-2d63d30955d5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:16.899772 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6fed3c87-c29c-4d74-9e28-2d3ee9249dcd tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:16.900205 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6fed3c87-c29c-4d74-9e28-2d3ee9249dcd tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:16.900961 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6fed3c87-c29c-4d74-9e28-2d3ee9249dcd tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:16.901385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6fed3c87-c29c-4d74-9e28-2d3ee9249dcd tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:17.034135 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2acc4dd4-fed2-4e08-8e23-2d63d30955d5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:17.035330 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-6fed3c87-c29c-4d74-9e28-2d3ee9249dcd tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150235a48e694c8584f4ac521510c80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29dfb4148ff4076a2e42df6b2460aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:17.043109 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2acc4dd4-fed2-4e08-8e23-2d63d30955d5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669" status: 200 len: 1520 microversion: 2.1 time: 0.158508 Jul 26 07:27:17.043405 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6fed3c87-c29c-4d74-9e28-2d3ee9249dcd tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] 10.222.0.39 "GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c" status: 200 len: 1314 microversion: 2.1 time: 0.154256 Jul 26 07:27:17.043686 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 104/208] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:16 2022] GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:17.043967 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 105/209] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:16 2022] GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:17.438388 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-93a40530-72e6-410e-be55-fb08121e3112 req-f9b10179-a1ba-4e43-bed5-7672224a353f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c", "name": "network-vif-plugged", "status": "completed", "tag": "ff2b2952-d51d-46a8-bc8c-34bec2c5e16e"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:27:17.448919 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-93a40530-72e6-410e-be55-fb08121e3112 req-f9b10179-a1ba-4e43-bed5-7672224a353f service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:17.449216 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-93a40530-72e6-410e-be55-fb08121e3112 req-f9b10179-a1ba-4e43-bed5-7672224a353f service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:17.460676 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-93a40530-72e6-410e-be55-fb08121e3112 req-f9b10179-a1ba-4e43-bed5-7672224a353f service nova] Creating event network-vif-plugged:ff2b2952-d51d-46a8-bc8c-34bec2c5e16e for instance 3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c on hv-cinder-85083 Jul 26 07:27:17.465801 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-93a40530-72e6-410e-be55-fb08121e3112 req-f9b10179-a1ba-4e43-bed5-7672224a353f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031117 Jul 26 07:27:17.466394 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 105/210] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:27:17.873522 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-61ddb432-54ea-4703-83ad-e25692487ed4 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:17.874172 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-61ddb432-54ea-4703-83ad-e25692487ed4 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: 315dc80e-29c8-4ccc-a45d-1eac4c3ba00d] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:17.880885 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-61ddb432-54ea-4703-83ad-e25692487ed4 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:17.881353 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-61ddb432-54ea-4703-83ad-e25692487ed4 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:17.882146 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-61ddb432-54ea-4703-83ad-e25692487ed4 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:17.882572 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-61ddb432-54ea-4703-83ad-e25692487ed4 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:18.016707 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-61ddb432-54ea-4703-83ad-e25692487ed4 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:18.020183 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:18.025030 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-61ddb432-54ea-4703-83ad-e25692487ed4 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/315dc80e-29c8-4ccc-a45d-1eac4c3ba00d" status: 200 len: 1313 microversion: 2.1 time: 0.155542 Jul 26 07:27:18.025676 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 106/211] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:17 2022] GET /compute/v2.1/servers/315dc80e-29c8-4ccc-a45d-1eac4c3ba00d => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:18.064368 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d21113b3-9d58-411d-bb20-cea5b6546550 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:18.064976 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d21113b3-9d58-411d-bb20-cea5b6546550 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] [instance: 3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:18.065822 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-48f28fac-421b-43d3-8b21-01baa22dfa87 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:18.066838 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-48f28fac-421b-43d3-8b21-01baa22dfa87 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:18.071328 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d21113b3-9d58-411d-bb20-cea5b6546550 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:18.071776 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d21113b3-9d58-411d-bb20-cea5b6546550 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:18.072533 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d21113b3-9d58-411d-bb20-cea5b6546550 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:18.072975 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d21113b3-9d58-411d-bb20-cea5b6546550 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:18.073558 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-48f28fac-421b-43d3-8b21-01baa22dfa87 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:18.074059 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-48f28fac-421b-43d3-8b21-01baa22dfa87 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:18.074835 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-48f28fac-421b-43d3-8b21-01baa22dfa87 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:18.075270 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-48f28fac-421b-43d3-8b21-01baa22dfa87 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:18.225781 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-48f28fac-421b-43d3-8b21-01baa22dfa87 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:18.235980 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-48f28fac-421b-43d3-8b21-01baa22dfa87 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669" status: 200 len: 1520 microversion: 2.1 time: 0.175449 Jul 26 07:27:18.236707 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 106/212] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:18 2022] GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:18.485372 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d21113b3-9d58-411d-bb20-cea5b6546550 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150235a48e694c8584f4ac521510c80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29dfb4148ff4076a2e42df6b2460aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:18.493812 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d21113b3-9d58-411d-bb20-cea5b6546550 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] 10.222.0.39 "GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c" status: 200 len: 1314 microversion: 2.1 time: 0.433288 Jul 26 07:27:18.494388 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 107/213] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:18 2022] GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c => generated 1314 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:19.046316 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7c547393-b29c-44a7-96ff-69b1ebc3dd94 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:19.046825 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7c547393-b29c-44a7-96ff-69b1ebc3dd94 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: 315dc80e-29c8-4ccc-a45d-1eac4c3ba00d] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:19.053318 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7c547393-b29c-44a7-96ff-69b1ebc3dd94 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:19.053770 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7c547393-b29c-44a7-96ff-69b1ebc3dd94 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:19.054548 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7c547393-b29c-44a7-96ff-69b1ebc3dd94 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:19.054978 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7c547393-b29c-44a7-96ff-69b1ebc3dd94 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:19.187900 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-cd7c9197-5a55-47a4-b7ef-4b5451f2862d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:19.188434 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-cd7c9197-5a55-47a4-b7ef-4b5451f2862d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:19.191313 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell0:SELECT=4 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:19.192001 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell0:SELECT=16 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:19.194009 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7c547393-b29c-44a7-96ff-69b1ebc3dd94 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:19.196513 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cd7c9197-5a55-47a4-b7ef-4b5451f2862d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:19.196958 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cd7c9197-5a55-47a4-b7ef-4b5451f2862d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:19.197717 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cd7c9197-5a55-47a4-b7ef-4b5451f2862d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:19.198172 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cd7c9197-5a55-47a4-b7ef-4b5451f2862d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:19.202542 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7c547393-b29c-44a7-96ff-69b1ebc3dd94 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/315dc80e-29c8-4ccc-a45d-1eac4c3ba00d" status: 200 len: 1313 microversion: 2.1 time: 0.160260 Jul 26 07:27:19.203149 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 107/214] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:19 2022] GET /compute/v2.1/servers/315dc80e-29c8-4ccc-a45d-1eac4c3ba00d => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:19.222938 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-cd7c9197-5a55-47a4-b7ef-4b5451f2862d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/ips" status: 200 len: 153 microversion: 2.20 time: 0.038954 Jul 26 07:27:19.223674 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 108/215] 10.222.0.39 () {60 vars in 1289 bytes} [Tue Jul 26 07:27:19 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/ips => generated 153 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:27:19.257045 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-aa5b561b-3f52-41dc-a0c2-980eb2c99d53 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:19.257652 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-aa5b561b-3f52-41dc-a0c2-980eb2c99d53 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:19.264010 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-aa5b561b-3f52-41dc-a0c2-980eb2c99d53 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:19.264463 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-aa5b561b-3f52-41dc-a0c2-980eb2c99d53 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:19.265208 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-aa5b561b-3f52-41dc-a0c2-980eb2c99d53 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:19.265666 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-aa5b561b-3f52-41dc-a0c2-980eb2c99d53 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:19.402093 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-aa5b561b-3f52-41dc-a0c2-980eb2c99d53 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:19.410696 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-aa5b561b-3f52-41dc-a0c2-980eb2c99d53 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669" status: 200 len: 1520 microversion: 2.1 time: 0.157461 Jul 26 07:27:19.411196 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 108/216] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:19 2022] GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:27:19.514855 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b697faf3-1a8a-4e21-87ac-ab17693d6f40 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:19.515512 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b697faf3-1a8a-4e21-87ac-ab17693d6f40 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] [instance: 3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:19.522356 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b697faf3-1a8a-4e21-87ac-ab17693d6f40 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:19.522805 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b697faf3-1a8a-4e21-87ac-ab17693d6f40 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:19.523741 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b697faf3-1a8a-4e21-87ac-ab17693d6f40 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:19.524177 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b697faf3-1a8a-4e21-87ac-ab17693d6f40 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:19.668956 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-b697faf3-1a8a-4e21-87ac-ab17693d6f40 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150235a48e694c8584f4ac521510c80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29dfb4148ff4076a2e42df6b2460aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:19.677341 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b697faf3-1a8a-4e21-87ac-ab17693d6f40 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] 10.222.0.39 "GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c" status: 200 len: 1314 microversion: 2.1 time: 0.166636 Jul 26 07:27:19.677929 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 109/217] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:19 2022] GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:20.223560 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d53c7b8c-b541-415c-a40b-d3a07e8ea8ae tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:20.224873 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d53c7b8c-b541-415c-a40b-d3a07e8ea8ae tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: 315dc80e-29c8-4ccc-a45d-1eac4c3ba00d] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:20.232228 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d53c7b8c-b541-415c-a40b-d3a07e8ea8ae tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:20.233023 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d53c7b8c-b541-415c-a40b-d3a07e8ea8ae tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:20.234148 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d53c7b8c-b541-415c-a40b-d3a07e8ea8ae tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:20.234768 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d53c7b8c-b541-415c-a40b-d3a07e8ea8ae tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:20.390761 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d53c7b8c-b541-415c-a40b-d3a07e8ea8ae tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:20.399178 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d53c7b8c-b541-415c-a40b-d3a07e8ea8ae tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/315dc80e-29c8-4ccc-a45d-1eac4c3ba00d" status: 200 len: 1313 microversion: 2.1 time: 0.179928 Jul 26 07:27:20.399981 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 109/218] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:20 2022] GET /compute/v2.1/servers/315dc80e-29c8-4ccc-a45d-1eac4c3ba00d => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:20.434990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-40efc203-5a34-4286-8577-3da93bf6e52b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:20.435651 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-40efc203-5a34-4286-8577-3da93bf6e52b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:20.442234 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-40efc203-5a34-4286-8577-3da93bf6e52b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:20.443016 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-40efc203-5a34-4286-8577-3da93bf6e52b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:20.443931 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-40efc203-5a34-4286-8577-3da93bf6e52b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:20.444417 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-40efc203-5a34-4286-8577-3da93bf6e52b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:20.475451 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-5baff807-c601-4c47-ba72-86a5c35ca382 req-d912da2f-1239-4992-a698-ad2f30fea94a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "315dc80e-29c8-4ccc-a45d-1eac4c3ba00d", "name": "network-vif-plugged", "status": "completed", "tag": "021742ce-c417-4166-a80e-c4ba51e4ff2d"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:27:20.496796 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-5baff807-c601-4c47-ba72-86a5c35ca382 req-d912da2f-1239-4992-a698-ad2f30fea94a service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:20.497669 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-5baff807-c601-4c47-ba72-86a5c35ca382 req-d912da2f-1239-4992-a698-ad2f30fea94a service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:20.527933 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-5baff807-c601-4c47-ba72-86a5c35ca382 req-d912da2f-1239-4992-a698-ad2f30fea94a service nova] Creating event network-vif-plugged:021742ce-c417-4166-a80e-c4ba51e4ff2d for instance 315dc80e-29c8-4ccc-a45d-1eac4c3ba00d on hv-cinder-85083 Jul 26 07:27:20.534575 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-5baff807-c601-4c47-ba72-86a5c35ca382 req-d912da2f-1239-4992-a698-ad2f30fea94a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069985 Jul 26 07:27:20.536416 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 110/219] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:27:20.601928 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-40efc203-5a34-4286-8577-3da93bf6e52b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:20.611288 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-40efc203-5a34-4286-8577-3da93bf6e52b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669" status: 200 len: 1520 microversion: 2.1 time: 0.182675 Jul 26 07:27:20.612023 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 110/220] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:20 2022] GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:20.698604 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-5f39e98e-11d2-4136-aa6d-d498c0383a81 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:20.699424 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-5f39e98e-11d2-4136-aa6d-d498c0383a81 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] [instance: 3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:20.706089 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5f39e98e-11d2-4136-aa6d-d498c0383a81 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:20.706625 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5f39e98e-11d2-4136-aa6d-d498c0383a81 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:20.710349 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5f39e98e-11d2-4136-aa6d-d498c0383a81 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:20.710349 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5f39e98e-11d2-4136-aa6d-d498c0383a81 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:20.907157 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-5f39e98e-11d2-4136-aa6d-d498c0383a81 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150235a48e694c8584f4ac521510c80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29dfb4148ff4076a2e42df6b2460aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:20.917984 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-5f39e98e-11d2-4136-aa6d-d498c0383a81 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] 10.222.0.39 "GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c" status: 200 len: 1464 microversion: 2.1 time: 0.223443 Jul 26 07:27:20.918956 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 111/221] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:20 2022] GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c => generated 1464 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:20.963709 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-94a272c3-ae68-4798-b45a-5e7537f731da tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:20.964018 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-94a272c3-ae68-4798-b45a-5e7537f731da tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] [instance: 3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:20.971345 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-94a272c3-ae68-4798-b45a-5e7537f731da tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:20.971788 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-94a272c3-ae68-4798-b45a-5e7537f731da tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:20.972561 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-94a272c3-ae68-4798-b45a-5e7537f731da tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:20.973046 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-94a272c3-ae68-4798-b45a-5e7537f731da tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:20.999397 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-94a272c3-ae68-4798-b45a-5e7537f731da tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] [instance: 3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c] Going to try to terminate instance {{(pid=117715) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 07:27:21.080479 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-94a272c3-ae68-4798-b45a-5e7537f731da tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c" status: 204 len: 0 microversion: 2.1 time: 0.120745 Jul 26 07:27:21.081041 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 111/222] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Jul 26 07:27:20 2022] DELETE /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 07:27:21.089508 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b2ceacf5-f4c7-438b-8241-f1afd6538fcd tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:21.090167 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-b2ceacf5-f4c7-438b-8241-f1afd6538fcd tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] [instance: 3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:21.096834 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b2ceacf5-f4c7-438b-8241-f1afd6538fcd tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:21.097286 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b2ceacf5-f4c7-438b-8241-f1afd6538fcd tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:21.098084 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b2ceacf5-f4c7-438b-8241-f1afd6538fcd tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:21.098490 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b2ceacf5-f4c7-438b-8241-f1afd6538fcd tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:21.234082 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-b2ceacf5-f4c7-438b-8241-f1afd6538fcd tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150235a48e694c8584f4ac521510c80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29dfb4148ff4076a2e42df6b2460aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:21.242015 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b2ceacf5-f4c7-438b-8241-f1afd6538fcd tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] 10.222.0.39 "GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c" status: 200 len: 1470 microversion: 2.1 time: 0.156352 Jul 26 07:27:21.242618 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 112/223] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:21 2022] GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:21.421131 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-1f325e66-8a30-4dfe-86c6-afff77698040 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:21.421849 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-1f325e66-8a30-4dfe-86c6-afff77698040 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: 315dc80e-29c8-4ccc-a45d-1eac4c3ba00d] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:21.429014 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1f325e66-8a30-4dfe-86c6-afff77698040 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:21.429482 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1f325e66-8a30-4dfe-86c6-afff77698040 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:21.430301 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1f325e66-8a30-4dfe-86c6-afff77698040 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:21.430732 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1f325e66-8a30-4dfe-86c6-afff77698040 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:21.579120 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-1f325e66-8a30-4dfe-86c6-afff77698040 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:21.586917 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-1f325e66-8a30-4dfe-86c6-afff77698040 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/315dc80e-29c8-4ccc-a45d-1eac4c3ba00d" status: 200 len: 1313 microversion: 2.1 time: 0.170283 Jul 26 07:27:21.587551 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 112/224] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:21 2022] GET /compute/v2.1/servers/315dc80e-29c8-4ccc-a45d-1eac4c3ba00d => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:21.632694 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2677fa60-7485-4f95-a201-4e430ced83f7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:21.633428 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2677fa60-7485-4f95-a201-4e430ced83f7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:21.640187 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2677fa60-7485-4f95-a201-4e430ced83f7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:21.640996 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2677fa60-7485-4f95-a201-4e430ced83f7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:21.642120 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2677fa60-7485-4f95-a201-4e430ced83f7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:21.642602 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2677fa60-7485-4f95-a201-4e430ced83f7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:21.737581 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-306c92c5-6068-41bf-9ff9-0706aaea639a tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:21.738660 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-306c92c5-6068-41bf-9ff9-0706aaea639a tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: c0b50e8b-a23c-4aa8-826e-3e2141006ede] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:21.746251 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-306c92c5-6068-41bf-9ff9-0706aaea639a tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:21.746701 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-306c92c5-6068-41bf-9ff9-0706aaea639a tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:21.747480 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-306c92c5-6068-41bf-9ff9-0706aaea639a tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:21.748113 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-306c92c5-6068-41bf-9ff9-0706aaea639a tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:21.772527 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-306c92c5-6068-41bf-9ff9-0706aaea639a tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede/ips" status: 200 len: 149 microversion: 2.1 time: 0.040634 Jul 26 07:27:21.773118 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 113/225] 10.222.0.39 () {58 vars in 1248 bytes} [Tue Jul 26 07:27:21 2022] GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 07:27:21.798559 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2677fa60-7485-4f95-a201-4e430ced83f7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:21.807030 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2677fa60-7485-4f95-a201-4e430ced83f7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669" status: 200 len: 1520 microversion: 2.1 time: 0.178441 Jul 26 07:27:21.807800 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 113/226] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:21 2022] GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:21.834148 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-55a58f9e-b5c2-4778-940d-bddde4b153d1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:27:21.834745 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-55a58f9e-b5c2-4778-940d-bddde4b153d1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:21.843117 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-55a58f9e-b5c2-4778-940d-bddde4b153d1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:21.844184 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-55a58f9e-b5c2-4778-940d-bddde4b153d1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:21.845114 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-55a58f9e-b5c2-4778-940d-bddde4b153d1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:21.845731 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-55a58f9e-b5c2-4778-940d-bddde4b153d1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:21.870997 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.objects.instance [None req-55a58f9e-b5c2-4778-940d-bddde4b153d1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lazy-loading 'flavor' on Instance uuid 990571a8-aa04-4aac-921c-cf071eca1dd0 {{(pid=117715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 07:27:22.133045 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-55a58f9e-b5c2-4778-940d-bddde4b153d1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "POST /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/action" status: 202 len: 0 microversion: 2.20 time: 0.302751 Jul 26 07:27:22.133718 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 114/227] 10.222.0.39 () {62 vars in 1319 bytes} [Tue Jul 26 07:27:21 2022] POST /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 07:27:22.143132 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-5695e342-d5cc-4689-b845-df267a361edd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:22.144042 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-5695e342-d5cc-4689-b845-df267a361edd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:22.150609 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5695e342-d5cc-4689-b845-df267a361edd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:22.151055 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5695e342-d5cc-4689-b845-df267a361edd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:22.151849 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5695e342-d5cc-4689-b845-df267a361edd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:22.152430 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5695e342-d5cc-4689-b845-df267a361edd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:22.265721 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-1024c1f9-f384-49e3-ae67-93f0a7d5731d tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:22.266460 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-1024c1f9-f384-49e3-ae67-93f0a7d5731d tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] [instance: 3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:22.273841 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1024c1f9-f384-49e3-ae67-93f0a7d5731d tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:22.274283 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1024c1f9-f384-49e3-ae67-93f0a7d5731d tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:22.275045 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1024c1f9-f384-49e3-ae67-93f0a7d5731d tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:22.275471 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1024c1f9-f384-49e3-ae67-93f0a7d5731d tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:22.295342 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-5695e342-d5cc-4689-b845-df267a361edd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:22.304608 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-5695e342-d5cc-4689-b845-df267a361edd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:22.306110 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-5695e342-d5cc-4689-b845-df267a361edd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:22.307361 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-5695e342-d5cc-4689-b845-df267a361edd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1725 microversion: 2.20 time: 0.169182 Jul 26 07:27:22.308148 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 114/228] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:27:22 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:27:22.419798 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-1024c1f9-f384-49e3-ae67-93f0a7d5731d tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150235a48e694c8584f4ac521510c80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29dfb4148ff4076a2e42df6b2460aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:22.428259 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-1024c1f9-f384-49e3-ae67-93f0a7d5731d tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] 10.222.0.39 "GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c" status: 200 len: 1470 microversion: 2.1 time: 0.168525 Jul 26 07:27:22.429131 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 115/229] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:22 2022] GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c => generated 1470 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:27:22.609307 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-60a62b5f-19e3-418c-8b20-509a9cb7c84e tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:22.609550 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-60a62b5f-19e3-418c-8b20-509a9cb7c84e tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: 315dc80e-29c8-4ccc-a45d-1eac4c3ba00d] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:22.615921 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-60a62b5f-19e3-418c-8b20-509a9cb7c84e tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:22.616375 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-60a62b5f-19e3-418c-8b20-509a9cb7c84e tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:22.617148 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-60a62b5f-19e3-418c-8b20-509a9cb7c84e tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:22.617580 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-60a62b5f-19e3-418c-8b20-509a9cb7c84e tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:22.753191 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-60a62b5f-19e3-418c-8b20-509a9cb7c84e tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:22.761197 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-60a62b5f-19e3-418c-8b20-509a9cb7c84e tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/315dc80e-29c8-4ccc-a45d-1eac4c3ba00d" status: 200 len: 1313 microversion: 2.1 time: 0.156380 Jul 26 07:27:22.766125 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 115/230] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:22 2022] GET /compute/v2.1/servers/315dc80e-29c8-4ccc-a45d-1eac4c3ba00d => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:22.829391 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-668807ba-19d1-43eb-baaf-6c5b75ef08fd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:22.830017 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-668807ba-19d1-43eb-baaf-6c5b75ef08fd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:22.836398 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-668807ba-19d1-43eb-baaf-6c5b75ef08fd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:22.836842 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-668807ba-19d1-43eb-baaf-6c5b75ef08fd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:22.837595 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-668807ba-19d1-43eb-baaf-6c5b75ef08fd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:22.838060 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-668807ba-19d1-43eb-baaf-6c5b75ef08fd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:23.013128 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-668807ba-19d1-43eb-baaf-6c5b75ef08fd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:23.030035 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-668807ba-19d1-43eb-baaf-6c5b75ef08fd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669" status: 200 len: 1520 microversion: 2.1 time: 0.197202 Jul 26 07:27:23.030035 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 116/231] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:22 2022] GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669 => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:23.244556 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-06e6aa7b-aa1f-4f95-9dfb-743a2550f3d5 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3118ec4-ef49-472f-8c6a-e76ced59cdf9"}} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:27:23.248171 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-06e6aa7b-aa1f-4f95-9dfb-743a2550f3d5 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: c0b50e8b-a23c-4aa8-826e-3e2141006ede] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:23.258899 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-06e6aa7b-aa1f-4f95-9dfb-743a2550f3d5 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:23.260068 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-06e6aa7b-aa1f-4f95-9dfb-743a2550f3d5 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:23.261794 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-06e6aa7b-aa1f-4f95-9dfb-743a2550f3d5 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:23.262420 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-06e6aa7b-aa1f-4f95-9dfb-743a2550f3d5 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:23.331667 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d3c3ebda-9bc0-4504-9bb8-b7047f731d20 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:23.332652 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d3c3ebda-9bc0-4504-9bb8-b7047f731d20 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:23.344069 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d3c3ebda-9bc0-4504-9bb8-b7047f731d20 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:23.344594 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d3c3ebda-9bc0-4504-9bb8-b7047f731d20 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:23.346604 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d3c3ebda-9bc0-4504-9bb8-b7047f731d20 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:23.347569 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d3c3ebda-9bc0-4504-9bb8-b7047f731d20 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:23.522790 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d3c3ebda-9bc0-4504-9bb8-b7047f731d20 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:23.531857 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d3c3ebda-9bc0-4504-9bb8-b7047f731d20 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:23.533344 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d3c3ebda-9bc0-4504-9bb8-b7047f731d20 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:23.534628 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d3c3ebda-9bc0-4504-9bb8-b7047f731d20 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1725 microversion: 2.20 time: 0.207163 Jul 26 07:27:23.535780 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 117/232] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:27:23 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1725 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 07:27:23.540458 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-4c8a16ba-2d6e-41c3-8f86-b7aa9ff32919 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:23.541058 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-4c8a16ba-2d6e-41c3-8f86-b7aa9ff32919 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] [instance: 3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:23.544361 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:23.548041 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4c8a16ba-2d6e-41c3-8f86-b7aa9ff32919 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:23.548477 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4c8a16ba-2d6e-41c3-8f86-b7aa9ff32919 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:23.549242 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4c8a16ba-2d6e-41c3-8f86-b7aa9ff32919 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:23.549850 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4c8a16ba-2d6e-41c3-8f86-b7aa9ff32919 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:23.743560 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-4c8a16ba-2d6e-41c3-8f86-b7aa9ff32919 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150235a48e694c8584f4ac521510c80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29dfb4148ff4076a2e42df6b2460aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:23.752375 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-4c8a16ba-2d6e-41c3-8f86-b7aa9ff32919 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] 10.222.0.39 "GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c" status: 200 len: 1470 microversion: 2.1 time: 0.215411 Jul 26 07:27:23.753077 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 118/233] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:23 2022] GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c => generated 1470 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:23.782052 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-492a1243-6db8-479e-ad25-b5d3323ef339 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:23.782687 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-492a1243-6db8-479e-ad25-b5d3323ef339 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: 315dc80e-29c8-4ccc-a45d-1eac4c3ba00d] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:23.788993 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-492a1243-6db8-479e-ad25-b5d3323ef339 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:23.789434 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-492a1243-6db8-479e-ad25-b5d3323ef339 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:23.790229 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-492a1243-6db8-479e-ad25-b5d3323ef339 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:23.790677 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-492a1243-6db8-479e-ad25-b5d3323ef339 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:23.932322 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-492a1243-6db8-479e-ad25-b5d3323ef339 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:23.940346 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-492a1243-6db8-479e-ad25-b5d3323ef339 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/315dc80e-29c8-4ccc-a45d-1eac4c3ba00d" status: 200 len: 1496 microversion: 2.1 time: 0.162534 Jul 26 07:27:23.940927 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 119/234] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:23 2022] GET /compute/v2.1/servers/315dc80e-29c8-4ccc-a45d-1eac4c3ba00d => generated 1496 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:27:24.045214 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-43fb2729-88d1-4740-997e-f0fc3f116dcb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:24.046024 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-43fb2729-88d1-4740-997e-f0fc3f116dcb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:24.052366 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-43fb2729-88d1-4740-997e-f0fc3f116dcb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:24.052851 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-43fb2729-88d1-4740-997e-f0fc3f116dcb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:24.053563 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-43fb2729-88d1-4740-997e-f0fc3f116dcb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:24.054490 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-43fb2729-88d1-4740-997e-f0fc3f116dcb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:24.074509 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:24.249401 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-43fb2729-88d1-4740-997e-f0fc3f116dcb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:24.257538 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-43fb2729-88d1-4740-997e-f0fc3f116dcb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669" status: 200 len: 1520 microversion: 2.1 time: 0.216868 Jul 26 07:27:24.258407 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 120/235] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:24 2022] GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669 => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:24.562519 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-56563c65-1144-42f0-b141-bff4c0e93694 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:24.563456 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-56563c65-1144-42f0-b141-bff4c0e93694 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:24.571483 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-56563c65-1144-42f0-b141-bff4c0e93694 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:24.571919 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-56563c65-1144-42f0-b141-bff4c0e93694 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:24.572693 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-56563c65-1144-42f0-b141-bff4c0e93694 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:24.573101 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-56563c65-1144-42f0-b141-bff4c0e93694 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:24.717046 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-56563c65-1144-42f0-b141-bff4c0e93694 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:24.727027 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-56563c65-1144-42f0-b141-bff4c0e93694 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:24.729154 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-56563c65-1144-42f0-b141-bff4c0e93694 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:24.730488 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-56563c65-1144-42f0-b141-bff4c0e93694 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1725 microversion: 2.20 time: 0.172125 Jul 26 07:27:24.731018 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 121/236] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:27:24 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:27:24.774458 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ce2040eb-2418-4380-8b00-77537fbf2034 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:24.775074 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ce2040eb-2418-4380-8b00-77537fbf2034 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] [instance: 3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:24.781888 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ce2040eb-2418-4380-8b00-77537fbf2034 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:24.782337 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ce2040eb-2418-4380-8b00-77537fbf2034 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:24.783154 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ce2040eb-2418-4380-8b00-77537fbf2034 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:24.783561 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ce2040eb-2418-4380-8b00-77537fbf2034 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:24.931299 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ce2040eb-2418-4380-8b00-77537fbf2034 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150235a48e694c8584f4ac521510c80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29dfb4148ff4076a2e42df6b2460aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:24.939771 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ce2040eb-2418-4380-8b00-77537fbf2034 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] 10.222.0.39 "GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c" status: 200 len: 1470 microversion: 2.1 time: 0.169172 Jul 26 07:27:24.940432 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 122/237] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:24 2022] GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c => generated 1470 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:25.280034 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-21993fd2-624e-4a76-a583-e61dbca18d27 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:25.280953 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-21993fd2-624e-4a76-a583-e61dbca18d27 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:25.288118 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-21993fd2-624e-4a76-a583-e61dbca18d27 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:25.288548 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-21993fd2-624e-4a76-a583-e61dbca18d27 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:25.289321 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-21993fd2-624e-4a76-a583-e61dbca18d27 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:25.289750 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-21993fd2-624e-4a76-a583-e61dbca18d27 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:25.434365 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-21993fd2-624e-4a76-a583-e61dbca18d27 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:25.442579 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-21993fd2-624e-4a76-a583-e61dbca18d27 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669" status: 200 len: 1520 microversion: 2.1 time: 0.167338 Jul 26 07:27:25.444976 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 123/238] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:25 2022] GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:27:25.754522 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-0fb4e734-77a4-47db-b8b3-f6890f149021 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:25.755129 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-0fb4e734-77a4-47db-b8b3-f6890f149021 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:25.761603 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0fb4e734-77a4-47db-b8b3-f6890f149021 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:25.762079 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0fb4e734-77a4-47db-b8b3-f6890f149021 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:25.762842 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0fb4e734-77a4-47db-b8b3-f6890f149021 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:25.763268 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0fb4e734-77a4-47db-b8b3-f6890f149021 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:25.911551 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-0fb4e734-77a4-47db-b8b3-f6890f149021 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:25.920262 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-0fb4e734-77a4-47db-b8b3-f6890f149021 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:25.921913 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-0fb4e734-77a4-47db-b8b3-f6890f149021 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:25.923399 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-0fb4e734-77a4-47db-b8b3-f6890f149021 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1725 microversion: 2.20 time: 0.172920 Jul 26 07:27:25.924126 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 124/239] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:27:25 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:27:25.962811 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a66d2f52-55cd-461e-afb8-82a2d930e178 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:25.963559 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a66d2f52-55cd-461e-afb8-82a2d930e178 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] [instance: 3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:25.970419 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a66d2f52-55cd-461e-afb8-82a2d930e178 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:25.970871 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a66d2f52-55cd-461e-afb8-82a2d930e178 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:25.971641 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a66d2f52-55cd-461e-afb8-82a2d930e178 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:25.972069 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a66d2f52-55cd-461e-afb8-82a2d930e178 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:26.103337 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-a66d2f52-55cd-461e-afb8-82a2d930e178 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150235a48e694c8584f4ac521510c80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29dfb4148ff4076a2e42df6b2460aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:26.111106 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a66d2f52-55cd-461e-afb8-82a2d930e178 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] 10.222.0.39 "GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c" status: 200 len: 1470 microversion: 2.1 time: 0.153107 Jul 26 07:27:26.111680 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 125/240] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:25 2022] GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:26.466483 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c27a55f5-5dd8-45c7-a4fd-35644d130d5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:26.467096 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c27a55f5-5dd8-45c7-a4fd-35644d130d5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:26.473966 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c27a55f5-5dd8-45c7-a4fd-35644d130d5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:26.474419 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c27a55f5-5dd8-45c7-a4fd-35644d130d5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:26.475185 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c27a55f5-5dd8-45c7-a4fd-35644d130d5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:26.475622 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c27a55f5-5dd8-45c7-a4fd-35644d130d5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:26.628730 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c27a55f5-5dd8-45c7-a4fd-35644d130d5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:26.640057 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c27a55f5-5dd8-45c7-a4fd-35644d130d5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669" status: 200 len: 1520 microversion: 2.1 time: 0.177447 Jul 26 07:27:26.641110 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 126/241] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:26 2022] GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:26.654232 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-6b27e4f6-e10a-4930-ac3e-421466d394d7 req-5e3409c2-cf74-4d19-85cf-2e61a559a9b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c", "name": "network-vif-unplugged", "status": "completed", "tag": "ff2b2952-d51d-46a8-bc8c-34bec2c5e16e"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:27:26.666753 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-6b27e4f6-e10a-4930-ac3e-421466d394d7 req-5e3409c2-cf74-4d19-85cf-2e61a559a9b7 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:26.667209 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-6b27e4f6-e10a-4930-ac3e-421466d394d7 req-5e3409c2-cf74-4d19-85cf-2e61a559a9b7 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:26.681832 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-6b27e4f6-e10a-4930-ac3e-421466d394d7 req-5e3409c2-cf74-4d19-85cf-2e61a559a9b7 service nova] Creating event network-vif-unplugged:ff2b2952-d51d-46a8-bc8c-34bec2c5e16e for instance 3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c on hv-cinder-85083 Jul 26 07:27:26.687904 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-6b27e4f6-e10a-4930-ac3e-421466d394d7 req-5e3409c2-cf74-4d19-85cf-2e61a559a9b7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039165 Jul 26 07:27:26.688532 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 127/242] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 07:27:26.877660 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-06e6aa7b-aa1f-4f95-9dfb-743a2550f3d5 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "POST /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.639525 Jul 26 07:27:26.884000 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 116/243] 10.222.0.39 () {60 vars in 1323 bytes} [Tue Jul 26 07:27:23 2022] POST /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede/os-volume_attachments => generated 194 bytes in 3642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:27:26.949889 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-851e159e-11aa-4148-afac-9b98f67e01f9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:26.950680 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-851e159e-11aa-4148-afac-9b98f67e01f9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:26.958225 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-851e159e-11aa-4148-afac-9b98f67e01f9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:26.958757 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-851e159e-11aa-4148-afac-9b98f67e01f9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:26.959667 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-851e159e-11aa-4148-afac-9b98f67e01f9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:26.960251 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-851e159e-11aa-4148-afac-9b98f67e01f9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:27.134539 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a843d21f-436c-411a-b7a0-391824699563 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:27.135623 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a843d21f-436c-411a-b7a0-391824699563 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] [instance: 3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:27.142630 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a843d21f-436c-411a-b7a0-391824699563 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:27.143376 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a843d21f-436c-411a-b7a0-391824699563 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:27.144750 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a843d21f-436c-411a-b7a0-391824699563 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:27.145285 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a843d21f-436c-411a-b7a0-391824699563 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:27.148715 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-851e159e-11aa-4148-afac-9b98f67e01f9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:27.165527 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-851e159e-11aa-4148-afac-9b98f67e01f9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:27.168726 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-851e159e-11aa-4148-afac-9b98f67e01f9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:27.173278 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-851e159e-11aa-4148-afac-9b98f67e01f9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1725 microversion: 2.20 time: 0.227695 Jul 26 07:27:27.176225 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 128/244] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:27:26 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1725 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:27:27.200531 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ef662fc1-971f-48ff-a199-347b20b0964e tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:27.201177 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ef662fc1-971f-48ff-a199-347b20b0964e tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: 315dc80e-29c8-4ccc-a45d-1eac4c3ba00d] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:27.208867 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef662fc1-971f-48ff-a199-347b20b0964e tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:27.209311 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef662fc1-971f-48ff-a199-347b20b0964e tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:27.210568 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef662fc1-971f-48ff-a199-347b20b0964e tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:27.211082 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef662fc1-971f-48ff-a199-347b20b0964e tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:27.240249 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ef662fc1-971f-48ff-a199-347b20b0964e tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: 315dc80e-29c8-4ccc-a45d-1eac4c3ba00d] Going to try to terminate instance {{(pid=117715) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 07:27:27.326720 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ef662fc1-971f-48ff-a199-347b20b0964e tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "DELETE /compute/v2.1/servers/315dc80e-29c8-4ccc-a45d-1eac4c3ba00d" status: 204 len: 0 microversion: 2.1 time: 0.130583 Jul 26 07:27:27.327544 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 129/245] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Jul 26 07:27:27 2022] DELETE /compute/v2.1/servers/315dc80e-29c8-4ccc-a45d-1eac4c3ba00d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 07:27:27.336700 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-2bfc0ed9-2999-4efc-b8be-df1269184f75 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:27.337391 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2bfc0ed9-2999-4efc-b8be-df1269184f75 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: 315dc80e-29c8-4ccc-a45d-1eac4c3ba00d] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:27.344595 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2bfc0ed9-2999-4efc-b8be-df1269184f75 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:27.345057 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2bfc0ed9-2999-4efc-b8be-df1269184f75 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:27.345974 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2bfc0ed9-2999-4efc-b8be-df1269184f75 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:27.346411 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2bfc0ed9-2999-4efc-b8be-df1269184f75 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:27.376823 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a843d21f-436c-411a-b7a0-391824699563 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150235a48e694c8584f4ac521510c80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29dfb4148ff4076a2e42df6b2460aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:27.385012 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a843d21f-436c-411a-b7a0-391824699563 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] 10.222.0.39 "GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c" status: 200 len: 1470 microversion: 2.1 time: 0.255446 Jul 26 07:27:27.386602 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 117/246] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:27 2022] GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c => generated 1470 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:27:27.502890 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2bfc0ed9-2999-4efc-b8be-df1269184f75 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:27.512037 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-2bfc0ed9-2999-4efc-b8be-df1269184f75 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/315dc80e-29c8-4ccc-a45d-1eac4c3ba00d" status: 200 len: 1502 microversion: 2.1 time: 0.179764 Jul 26 07:27:27.513835 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 130/247] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:27 2022] GET /compute/v2.1/servers/315dc80e-29c8-4ccc-a45d-1eac4c3ba00d => generated 1502 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:27:27.588117 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-944b89b2-ba35-4a58-810b-eb9f280fcef6 req-ae4d807d-fce9-4e8f-812f-0e5704f8e940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c", "name": "network-vif-deleted", "tag": "ff2b2952-d51d-46a8-bc8c-34bec2c5e16e"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:27:27.599618 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-944b89b2-ba35-4a58-810b-eb9f280fcef6 req-ae4d807d-fce9-4e8f-812f-0e5704f8e940 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:27.600271 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-944b89b2-ba35-4a58-810b-eb9f280fcef6 req-ae4d807d-fce9-4e8f-812f-0e5704f8e940 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:27.615293 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-944b89b2-ba35-4a58-810b-eb9f280fcef6 req-ae4d807d-fce9-4e8f-812f-0e5704f8e940 service nova] Creating event network-vif-deleted:ff2b2952-d51d-46a8-bc8c-34bec2c5e16e for instance 3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c on hv-cinder-85083 Jul 26 07:27:27.620263 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-278e44b4-2d9a-402c-9979-d599deb02646 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1658109070", "imageRef": "b9589773-813f-42af-846a-43bcf9d4d002", "flavorRef": "452", "networks": [{"uuid": "3f043156-d4d9-403b-ac18-d8486e3ebf15"}]}} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:27:27.620469 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-944b89b2-ba35-4a58-810b-eb9f280fcef6 req-ae4d807d-fce9-4e8f-812f-0e5704f8e940 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036270 Jul 26 07:27:27.620837 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 118/248] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:27:27.666037 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a35c5e79-026a-4206-a938-94fd7671c321 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:27.666787 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a35c5e79-026a-4206-a938-94fd7671c321 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:27.674046 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a35c5e79-026a-4206-a938-94fd7671c321 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:27.675042 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a35c5e79-026a-4206-a938-94fd7671c321 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:27.676292 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a35c5e79-026a-4206-a938-94fd7671c321 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:27.677114 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a35c5e79-026a-4206-a938-94fd7671c321 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:27.690847 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.network.neutron [None req-278e44b4-2d9a-402c-9979-d599deb02646 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] validate_networks() for [('3f043156-d4d9-403b-ac18-d8486e3ebf15', None, None, None, None, None)] {{(pid=117715) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 07:27:27.861584 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a35c5e79-026a-4206-a938-94fd7671c321 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:27.874396 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a35c5e79-026a-4206-a938-94fd7671c321 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669" status: 200 len: 1520 microversion: 2.1 time: 0.215350 Jul 26 07:27:27.877228 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 119/249] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:27 2022] GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669 => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:27:28.102496 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-278e44b4-2d9a-402c-9979-d599deb02646 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Flavor limits 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 07:27:28.102911 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-278e44b4-2d9a-402c-9979-d599deb02646 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Image limits 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 07:27:28.103385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-278e44b4-2d9a-402c-9979-d599deb02646 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Flavor pref 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 07:27:28.103786 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-278e44b4-2d9a-402c-9979-d599deb02646 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Image pref 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 07:27:28.104190 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-278e44b4-2d9a-402c-9979-d599deb02646 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 07:27:28.113660 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-278e44b4-2d9a-402c-9979-d599deb02646 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:28.114141 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-278e44b4-2d9a-402c-9979-d599deb02646 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:28.114934 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-278e44b4-2d9a-402c-9979-d599deb02646 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:28.115368 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-278e44b4-2d9a-402c-9979-d599deb02646 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:28.132926 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.quota [None req-278e44b4-2d9a-402c-9979-d599deb02646 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Getting quotas for project 6fc12ef80ee841f5af4bc2d56966cadc. Resources: {'instances', 'cores', 'ram'} {{(pid=117715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 07:27:28.137008 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.quota [None req-278e44b4-2d9a-402c-9979-d599deb02646 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Getting quotas for user c394476504af4c1d8bea462a5113cebc and project 6fc12ef80ee841f5af4bc2d56966cadc. Resources: {'instances', 'cores', 'ram'} {{(pid=117715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 07:27:28.149121 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-278e44b4-2d9a-402c-9979-d599deb02646 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Going to run 1 instances... {{(pid=117715) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 07:27:28.151565 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-278e44b4-2d9a-402c-9979-d599deb02646 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 4a6929a0-8c3d-4474-8ffa-b2777251fa48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9589773-813f-42af-846a-43bcf9d4d002',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 07:27:28.196237 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-278e44b4-2d9a-402c-9979-d599deb02646 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.579900 Jul 26 07:27:28.197051 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 131/250] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Jul 26 07:27:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 07:27:28.199577 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8037254f-50b7-4c93-9bf3-a0605af2569a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:28.200309 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8037254f-50b7-4c93-9bf3-a0605af2569a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:28.207280 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8037254f-50b7-4c93-9bf3-a0605af2569a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:28.207727 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-bbc845ae-9318-4886-a248-11e4faba5dd1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:28.207868 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8037254f-50b7-4c93-9bf3-a0605af2569a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:28.208342 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-bbc845ae-9318-4886-a248-11e4faba5dd1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 4a6929a0-8c3d-4474-8ffa-b2777251fa48] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:28.208732 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8037254f-50b7-4c93-9bf3-a0605af2569a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:28.209234 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8037254f-50b7-4c93-9bf3-a0605af2569a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:28.265608 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-bbc845ae-9318-4886-a248-11e4faba5dd1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:28.275429 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-bbc845ae-9318-4886-a248-11e4faba5dd1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48" status: 200 len: 1219 microversion: 2.1 time: 0.070835 Jul 26 07:27:28.277038 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 132/251] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:28 2022] GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48 => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:28.352557 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8037254f-50b7-4c93-9bf3-a0605af2569a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:28.362547 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8037254f-50b7-4c93-9bf3-a0605af2569a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:28.364343 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8037254f-50b7-4c93-9bf3-a0605af2569a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:28.365541 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8037254f-50b7-4c93-9bf3-a0605af2569a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1725 microversion: 2.20 time: 0.170486 Jul 26 07:27:28.366356 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 120/252] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:27:28 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 07:27:28.407999 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-0635e866-fa80-498b-9623-ee1c36ea2b8b tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:28.408769 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-0635e866-fa80-498b-9623-ee1c36ea2b8b tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] [instance: 3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:28.415563 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0635e866-fa80-498b-9623-ee1c36ea2b8b tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:28.416013 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0635e866-fa80-498b-9623-ee1c36ea2b8b tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:28.416767 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0635e866-fa80-498b-9623-ee1c36ea2b8b tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:28.417195 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0635e866-fa80-498b-9623-ee1c36ea2b8b tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:28.484269 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-0635e866-fa80-498b-9623-ee1c36ea2b8b tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150235a48e694c8584f4ac521510c80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29dfb4148ff4076a2e42df6b2460aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:28.492159 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-0635e866-fa80-498b-9623-ee1c36ea2b8b tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] 10.222.0.39 "GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c" status: 200 len: 1428 microversion: 2.1 time: 0.088264 Jul 26 07:27:28.492953 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 133/253] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:28 2022] GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c => generated 1428 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:28.535049 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-4773b6fd-f8d2-4cb5-9bdd-4ce5251dfc1c tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:28.535966 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-4773b6fd-f8d2-4cb5-9bdd-4ce5251dfc1c tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: 315dc80e-29c8-4ccc-a45d-1eac4c3ba00d] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:28.543100 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4773b6fd-f8d2-4cb5-9bdd-4ce5251dfc1c tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:28.543546 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4773b6fd-f8d2-4cb5-9bdd-4ce5251dfc1c tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:28.544318 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4773b6fd-f8d2-4cb5-9bdd-4ce5251dfc1c tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:28.544749 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4773b6fd-f8d2-4cb5-9bdd-4ce5251dfc1c tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:28.549395 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:28.690185 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-4773b6fd-f8d2-4cb5-9bdd-4ce5251dfc1c tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:28.699110 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-4773b6fd-f8d2-4cb5-9bdd-4ce5251dfc1c tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/315dc80e-29c8-4ccc-a45d-1eac4c3ba00d" status: 200 len: 1502 microversion: 2.1 time: 0.168016 Jul 26 07:27:28.699857 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 121/254] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:28 2022] GET /compute/v2.1/servers/315dc80e-29c8-4ccc-a45d-1eac4c3ba00d => generated 1502 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:28.895504 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-55030479-b260-4b96-8b9b-d6dc635f6ff0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:28.896720 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-55030479-b260-4b96-8b9b-d6dc635f6ff0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:28.903891 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-55030479-b260-4b96-8b9b-d6dc635f6ff0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:28.904341 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-55030479-b260-4b96-8b9b-d6dc635f6ff0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:28.905275 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-55030479-b260-4b96-8b9b-d6dc635f6ff0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:28.905670 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-55030479-b260-4b96-8b9b-d6dc635f6ff0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:29.074399 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-55030479-b260-4b96-8b9b-d6dc635f6ff0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:29.082134 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-55030479-b260-4b96-8b9b-d6dc635f6ff0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669" status: 200 len: 1520 microversion: 2.1 time: 0.190576 Jul 26 07:27:29.082700 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 134/255] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:28 2022] GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669 => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:29.299108 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-17c1e600-d59d-4447-95e1-c93ebadcef23 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:29.301571 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-17c1e600-d59d-4447-95e1-c93ebadcef23 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 4a6929a0-8c3d-4474-8ffa-b2777251fa48] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:29.310232 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-17c1e600-d59d-4447-95e1-c93ebadcef23 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:29.311286 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-17c1e600-d59d-4447-95e1-c93ebadcef23 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:29.312666 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-17c1e600-d59d-4447-95e1-c93ebadcef23 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:29.313395 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-17c1e600-d59d-4447-95e1-c93ebadcef23 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:29.388848 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9638d4ae-1041-44b9-8fff-0821993d0242 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:29.389628 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-9638d4ae-1041-44b9-8fff-0821993d0242 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:29.395942 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9638d4ae-1041-44b9-8fff-0821993d0242 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:29.396382 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9638d4ae-1041-44b9-8fff-0821993d0242 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:29.397142 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9638d4ae-1041-44b9-8fff-0821993d0242 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:29.397567 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9638d4ae-1041-44b9-8fff-0821993d0242 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:29.413033 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-17c1e600-d59d-4447-95e1-c93ebadcef23 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:29.422840 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-17c1e600-d59d-4447-95e1-c93ebadcef23 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48" status: 200 len: 1271 microversion: 2.1 time: 0.128768 Jul 26 07:27:29.423395 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 122/256] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:29 2022] GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48 => generated 1271 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:29.517037 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ceb59311-87c0-41f7-86ac-96e44daaefb2 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:29.517996 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ceb59311-87c0-41f7-86ac-96e44daaefb2 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] [instance: 3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:29.525179 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ceb59311-87c0-41f7-86ac-96e44daaefb2 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:29.525958 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ceb59311-87c0-41f7-86ac-96e44daaefb2 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:29.526969 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ceb59311-87c0-41f7-86ac-96e44daaefb2 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:29.527579 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ceb59311-87c0-41f7-86ac-96e44daaefb2 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:29.542196 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.wsgi [None req-ceb59311-87c0-41f7-86ac-96e44daaefb2 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] HTTP exception thrown: Instance 3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c could not be found. Jul 26 07:27:29.544266 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ceb59311-87c0-41f7-86ac-96e44daaefb2 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Request method failure captured: Jul 26 07:27:29.544266 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: request: GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c HTTP/1.1 Jul 26 07:27:29.544266 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept: application/json Jul 26 07:27:29.544266 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept-Encoding: identity Jul 26 07:27:29.544266 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Connection: close Jul 26 07:27:29.544266 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Length: 0 Jul 26 07:27:29.544266 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Type: application/json Jul 26 07:27:29.544266 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Host: 10.222.0.39 Jul 26 07:27:29.544266 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Openstack-System-Scope: None Jul 26 07:27:29.544266 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: User-Agent: python-urllib3/1.26.10 Jul 26 07:27:29.544266 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Auth-Token: gAAAAABi35c7dbzjaq4NDLf_B7aOhrjt9rmvjh3iFVR4olxR63IVaOd_Jyk8BYWiuOt7WeA4vERUjKGIF3soAsh4Z_VwkTSRKKSaWj-_r4wK1XXcHqMjWb9hUedTy-Uctjkf9BPDszr6-2u8xWgok1KG_wdFqAgfa9yZKOxMjEqLpdApQPlJdY4 Jul 26 07:27:29.544266 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Id: None Jul 26 07:27:29.544266 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Name: None Jul 26 07:27:29.544266 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Identity-Status: Confirmed Jul 26 07:27:29.544266 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Is-Admin-Project: True Jul 26 07:27:29.544266 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Id: default Jul 26 07:27:29.544266 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Name: Default Jul 26 07:27:29.544266 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Id: e29dfb4148ff4076a2e42df6b2460aa5 Jul 26 07:27:29.544266 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Name: tempest-VolumesNegativeTest-1303587574 Jul 26 07:27:29.544266 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Role: member,reader Jul 26 07:27:29.544266 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Roles: member,reader Jul 26 07:27:29.545687 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e29dfb4148ff4076a2e42df6b2460aa5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e29dfb4148ff4076a2e42df6b2460aa5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e29dfb4148ff4076a2e42df6b2460aa5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e29dfb4148ff4076a2e42df6b2460aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:27:29.545687 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant: tempest-VolumesNegativeTest-1303587574 Jul 26 07:27:29.545687 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Id: e29dfb4148ff4076a2e42df6b2460aa5 Jul 26 07:27:29.545687 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Name: tempest-VolumesNegativeTest-1303587574 Jul 26 07:27:29.545687 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User: tempest-VolumesNegativeTest-1303587574-project Jul 26 07:27:29.545687 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Id: default Jul 26 07:27:29.545687 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Name: Default Jul 26 07:27:29.545687 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Id: 150235a48e694c8584f4ac521510c80a Jul 26 07:27:29.545687 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Name: tempest-VolumesNegativeTest-1303587574-project Jul 26 07:27:29.545687 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: method: > Jul 26 07:27:29.545687 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: exception: Instance 3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c could not be found. Jul 26 07:27:29.545687 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: action_args: {'id': '3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c'} Jul 26 07:27:29.546609 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:27:29.546609 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:27:29.546609 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 07:27:29.546609 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 07:27:29.546609 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 07:27:29.546609 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 07:27:29.546609 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 07:27:29.546609 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 07:27:29.546609 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 07:27:29.546609 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 07:27:29.546609 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c could not be found. Jul 26 07:27:29.546609 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:27:29.546609 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:27:29.546609 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:27:29.546609 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:27:29.546609 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:27:29.546609 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:27:29.546609 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:27:29.546609 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:27:29.546609 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:27:29.547888 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:27:29.547888 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 07:27:29.547888 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 07:27:29.547888 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 07:27:29.547888 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 07:27:29.547888 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 07:27:29.547888 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:27:29.547888 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c could not be found. Jul 26 07:27:29.547888 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:27:29.547888 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:27:29.547888 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:27:29.547888 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:27:29.547888 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:27:29.547888 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:27:29.547888 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:27:29.547888 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:27:29.547888 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c could not be found. Jul 26 07:27:29.547888 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:27:29.549947 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ceb59311-87c0-41f7-86ac-96e44daaefb2 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] Returning 404 to user: Instance 3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c could not be found. {{(pid=117716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:27:29.550830 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ceb59311-87c0-41f7-86ac-96e44daaefb2 tempest-VolumesNegativeTest-1303587574 tempest-VolumesNegativeTest-1303587574-project] 10.222.0.39 "GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c" status: 404 len: 111 microversion: 2.1 time: 0.039122 Jul 26 07:27:29.551386 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 123/257] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:29 2022] GET /compute/v2.1/servers/3f0d4cd5-fcb8-48f4-a4d1-ba61792b8e2c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 07:27:29.552134 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-9638d4ae-1041-44b9-8fff-0821993d0242 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:29.561637 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-9638d4ae-1041-44b9-8fff-0821993d0242 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:29.563798 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-9638d4ae-1041-44b9-8fff-0821993d0242 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:29.564795 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-9638d4ae-1041-44b9-8fff-0821993d0242 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1725 microversion: 2.20 time: 0.179905 Jul 26 07:27:29.565557 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 135/258] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:27:29 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 07:27:29.727695 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d17a876b-59d4-446c-b6b2-6980a1125dea tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:29.728662 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d17a876b-59d4-446c-b6b2-6980a1125dea tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: 315dc80e-29c8-4ccc-a45d-1eac4c3ba00d] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:29.737763 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d17a876b-59d4-446c-b6b2-6980a1125dea tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:29.738532 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d17a876b-59d4-446c-b6b2-6980a1125dea tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:29.739532 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d17a876b-59d4-446c-b6b2-6980a1125dea tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:29.740125 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d17a876b-59d4-446c-b6b2-6980a1125dea tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:30.104134 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-986e0dee-d776-4640-94fe-9c5a16d4a547 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:30.104767 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-986e0dee-d776-4640-94fe-9c5a16d4a547 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:30.116156 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-986e0dee-d776-4640-94fe-9c5a16d4a547 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:30.125285 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-986e0dee-d776-4640-94fe-9c5a16d4a547 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:30.126644 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-986e0dee-d776-4640-94fe-9c5a16d4a547 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:30.127100 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-986e0dee-d776-4640-94fe-9c5a16d4a547 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:30.210036 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d17a876b-59d4-446c-b6b2-6980a1125dea tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:30.222256 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d17a876b-59d4-446c-b6b2-6980a1125dea tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/315dc80e-29c8-4ccc-a45d-1eac4c3ba00d" status: 200 len: 1502 microversion: 2.1 time: 0.503314 Jul 26 07:27:30.234074 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 124/259] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:29 2022] GET /compute/v2.1/servers/315dc80e-29c8-4ccc-a45d-1eac4c3ba00d => generated 1502 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:30.318022 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-4065b532-19d5-4ba9-95b5-69064f123285 req-835841b5-6c13-4368-9816-6e279b1705a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "315dc80e-29c8-4ccc-a45d-1eac4c3ba00d", "name": "network-vif-deleted", "tag": "021742ce-c417-4166-a80e-c4ba51e4ff2d"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:27:30.334329 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-4065b532-19d5-4ba9-95b5-69064f123285 req-835841b5-6c13-4368-9816-6e279b1705a5 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:30.335860 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-4065b532-19d5-4ba9-95b5-69064f123285 req-835841b5-6c13-4368-9816-6e279b1705a5 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:30.359527 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-4065b532-19d5-4ba9-95b5-69064f123285 req-835841b5-6c13-4368-9816-6e279b1705a5 service nova] Creating event network-vif-deleted:021742ce-c417-4166-a80e-c4ba51e4ff2d for instance 315dc80e-29c8-4ccc-a45d-1eac4c3ba00d on hv-cinder-85083 Jul 26 07:27:30.363520 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-986e0dee-d776-4640-94fe-9c5a16d4a547 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:30.376453 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-4065b532-19d5-4ba9-95b5-69064f123285 req-835841b5-6c13-4368-9816-6e279b1705a5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066993 Jul 26 07:27:30.378011 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 125/260] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:27:30.384412 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-986e0dee-d776-4640-94fe-9c5a16d4a547 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669" status: 200 len: 1520 microversion: 2.1 time: 0.284175 Jul 26 07:27:30.385176 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 136/261] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:30 2022] GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669 => generated 1520 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:27:30.448597 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-dfeaac8c-fe14-43ce-92e8-4295f41c5110 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:30.449724 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-dfeaac8c-fe14-43ce-92e8-4295f41c5110 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 4a6929a0-8c3d-4474-8ffa-b2777251fa48] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:30.463762 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dfeaac8c-fe14-43ce-92e8-4295f41c5110 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:30.464522 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dfeaac8c-fe14-43ce-92e8-4295f41c5110 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:30.466145 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dfeaac8c-fe14-43ce-92e8-4295f41c5110 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:30.466857 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dfeaac8c-fe14-43ce-92e8-4295f41c5110 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:30.590705 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7eaa6fbd-c248-495c-bec9-ec5eb9a678eb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:30.592112 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7eaa6fbd-c248-495c-bec9-ec5eb9a678eb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:30.596330 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-dfeaac8c-fe14-43ce-92e8-4295f41c5110 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:30.600585 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7eaa6fbd-c248-495c-bec9-ec5eb9a678eb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:30.601638 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7eaa6fbd-c248-495c-bec9-ec5eb9a678eb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:30.603156 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7eaa6fbd-c248-495c-bec9-ec5eb9a678eb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:30.603835 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7eaa6fbd-c248-495c-bec9-ec5eb9a678eb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:30.606551 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-dfeaac8c-fe14-43ce-92e8-4295f41c5110 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48" status: 200 len: 1277 microversion: 2.1 time: 0.165089 Jul 26 07:27:30.607961 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 126/262] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:30 2022] GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48 => generated 1277 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:27:30.773832 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7eaa6fbd-c248-495c-bec9-ec5eb9a678eb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:30.778893 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:30.785846 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7eaa6fbd-c248-495c-bec9-ec5eb9a678eb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:30.787358 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7eaa6fbd-c248-495c-bec9-ec5eb9a678eb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:30.788822 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7eaa6fbd-c248-495c-bec9-ec5eb9a678eb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1725 microversion: 2.20 time: 0.204258 Jul 26 07:27:30.801837 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 137/263] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:27:30 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1725 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 07:27:31.250060 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d555b368-03c1-4c56-a0b2-06d779e2f740 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:31.251045 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d555b368-03c1-4c56-a0b2-06d779e2f740 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: 315dc80e-29c8-4ccc-a45d-1eac4c3ba00d] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:31.262647 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d555b368-03c1-4c56-a0b2-06d779e2f740 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:31.263100 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d555b368-03c1-4c56-a0b2-06d779e2f740 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:31.268124 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d555b368-03c1-4c56-a0b2-06d779e2f740 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:31.268800 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d555b368-03c1-4c56-a0b2-06d779e2f740 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:31.300292 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.wsgi [None req-d555b368-03c1-4c56-a0b2-06d779e2f740 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] HTTP exception thrown: Instance 315dc80e-29c8-4ccc-a45d-1eac4c3ba00d could not be found. Jul 26 07:27:31.311282 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d555b368-03c1-4c56-a0b2-06d779e2f740 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Request method failure captured: Jul 26 07:27:31.311282 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: request: GET /compute/v2.1/servers/315dc80e-29c8-4ccc-a45d-1eac4c3ba00d HTTP/1.1 Jul 26 07:27:31.311282 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept: application/json Jul 26 07:27:31.311282 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept-Encoding: identity Jul 26 07:27:31.311282 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Connection: close Jul 26 07:27:31.311282 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Length: 0 Jul 26 07:27:31.311282 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Type: application/json Jul 26 07:27:31.311282 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Host: 10.222.0.39 Jul 26 07:27:31.311282 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Openstack-System-Scope: None Jul 26 07:27:31.311282 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: User-Agent: python-urllib3/1.26.10 Jul 26 07:27:31.311282 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Auth-Token: gAAAAABi35dKBK5D_2gRqLbqPA7UorEI7Yxabmswmrcu0MNAtmKCBGL0VrNnRu-pIyLDWHlLRHaZeutsjSArYkCp9iauW7Y5twfQJj2W-I0Nb_PhmJ1swdQFDPeH_j0_k77aMrK-VKw5goBO6epeuXanUqRk2189wOnntfUDtPv272MuxUsENiI Jul 26 07:27:31.311282 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Id: None Jul 26 07:27:31.311282 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Name: None Jul 26 07:27:31.311282 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Identity-Status: Confirmed Jul 26 07:27:31.311282 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Is-Admin-Project: True Jul 26 07:27:31.311282 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Id: default Jul 26 07:27:31.311282 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Name: Default Jul 26 07:27:31.311282 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Id: c9cbf9b8d2e646eb945deb24d55fa0ad Jul 26 07:27:31.311282 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Name: tempest-VolumesActionsTest-34610786 Jul 26 07:27:31.311282 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Role: member,reader Jul 26 07:27:31.311282 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Roles: member,reader Jul 26 07:27:31.312628 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c9cbf9b8d2e646eb945deb24d55fa0ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c9cbf9b8d2e646eb945deb24d55fa0ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c9cbf9b8d2e646eb945deb24d55fa0ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c9cbf9b8d2e646eb945deb24d55fa0ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:27:31.312628 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant: tempest-VolumesActionsTest-34610786 Jul 26 07:27:31.312628 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Id: c9cbf9b8d2e646eb945deb24d55fa0ad Jul 26 07:27:31.312628 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Name: tempest-VolumesActionsTest-34610786 Jul 26 07:27:31.312628 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User: tempest-VolumesActionsTest-34610786-project Jul 26 07:27:31.312628 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Id: default Jul 26 07:27:31.312628 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Name: Default Jul 26 07:27:31.312628 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Id: 7a4c3b33511646b59d89dc933827dcb5 Jul 26 07:27:31.312628 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Name: tempest-VolumesActionsTest-34610786-project Jul 26 07:27:31.312628 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: method: > Jul 26 07:27:31.312628 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: exception: Instance 315dc80e-29c8-4ccc-a45d-1eac4c3ba00d could not be found. Jul 26 07:27:31.312628 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: action_args: {'id': '315dc80e-29c8-4ccc-a45d-1eac4c3ba00d'} Jul 26 07:27:31.313515 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:27:31.313515 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:27:31.313515 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 07:27:31.313515 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 07:27:31.313515 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 07:27:31.313515 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 07:27:31.313515 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 07:27:31.313515 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 07:27:31.313515 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 07:27:31.313515 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 07:27:31.313515 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 315dc80e-29c8-4ccc-a45d-1eac4c3ba00d could not be found. Jul 26 07:27:31.313515 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:27:31.313515 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:27:31.313515 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:27:31.313515 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:27:31.313515 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:27:31.313515 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:27:31.313515 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:27:31.313515 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:27:31.313515 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:27:31.316627 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:27:31.316627 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 07:27:31.316627 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 07:27:31.316627 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 07:27:31.316627 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 07:27:31.316627 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 07:27:31.316627 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:27:31.316627 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 315dc80e-29c8-4ccc-a45d-1eac4c3ba00d could not be found. Jul 26 07:27:31.316627 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:27:31.316627 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:27:31.316627 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:27:31.316627 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:27:31.316627 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:27:31.316627 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:27:31.316627 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:27:31.316627 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:27:31.316627 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 315dc80e-29c8-4ccc-a45d-1eac4c3ba00d could not be found. Jul 26 07:27:31.316627 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:27:31.319017 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d555b368-03c1-4c56-a0b2-06d779e2f740 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Returning 404 to user: Instance 315dc80e-29c8-4ccc-a45d-1eac4c3ba00d could not be found. {{(pid=117716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:27:31.320589 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d555b368-03c1-4c56-a0b2-06d779e2f740 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/315dc80e-29c8-4ccc-a45d-1eac4c3ba00d" status: 404 len: 111 microversion: 2.1 time: 0.076316 Jul 26 07:27:31.321538 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 127/264] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:31 2022] GET /compute/v2.1/servers/315dc80e-29c8-4ccc-a45d-1eac4c3ba00d => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 07:27:31.407603 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d5d45309-66f6-4002-a4b7-d48593f4df1c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:31.408310 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d5d45309-66f6-4002-a4b7-d48593f4df1c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:31.434082 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d5d45309-66f6-4002-a4b7-d48593f4df1c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:31.436467 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d5d45309-66f6-4002-a4b7-d48593f4df1c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:31.437674 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d5d45309-66f6-4002-a4b7-d48593f4df1c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:31.438860 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d5d45309-66f6-4002-a4b7-d48593f4df1c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:31.573901 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-53b08a50-3fd3-43ba-9067-50ab823a42b5 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1156055849", "imageRef": "b9589773-813f-42af-846a-43bcf9d4d002", "flavorRef": "452", "networks": [{"uuid": "b429f2bc-8187-46e0-8801-0af25835d0c5"}]}} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:27:31.665214 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.network.neutron [None req-53b08a50-3fd3-43ba-9067-50ab823a42b5 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] validate_networks() for [('b429f2bc-8187-46e0-8801-0af25835d0c5', None, None, None, None, None)] {{(pid=117716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 07:27:31.680837 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d5d45309-66f6-4002-a4b7-d48593f4df1c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:31.689328 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d5d45309-66f6-4002-a4b7-d48593f4df1c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669" status: 200 len: 1520 microversion: 2.1 time: 0.287085 Jul 26 07:27:31.690004 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 138/265] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:31 2022] GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669 => generated 1520 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:27:31.717434 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-90f944ea-7037-4807-a67f-d1ec7aa417d1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:31.720527 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-90f944ea-7037-4807-a67f-d1ec7aa417d1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 4a6929a0-8c3d-4474-8ffa-b2777251fa48] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:31.746113 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-90f944ea-7037-4807-a67f-d1ec7aa417d1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:31.746893 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-90f944ea-7037-4807-a67f-d1ec7aa417d1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:31.748352 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-90f944ea-7037-4807-a67f-d1ec7aa417d1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:31.749152 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-90f944ea-7037-4807-a67f-d1ec7aa417d1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:31.960580 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-90f944ea-7037-4807-a67f-d1ec7aa417d1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:31.970728 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-90f944ea-7037-4807-a67f-d1ec7aa417d1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48" status: 200 len: 1319 microversion: 2.1 time: 0.269235 Jul 26 07:27:31.971434 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 139/266] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:31 2022] GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48 => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:31.977169 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7bfbd86d-d9ed-4d99-8c2d-43b6f86ce024 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:31.977916 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7bfbd86d-d9ed-4d99-8c2d-43b6f86ce024 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:31.988066 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7bfbd86d-d9ed-4d99-8c2d-43b6f86ce024 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:31.994584 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7bfbd86d-d9ed-4d99-8c2d-43b6f86ce024 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:31.997055 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7bfbd86d-d9ed-4d99-8c2d-43b6f86ce024 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:31.997818 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7bfbd86d-d9ed-4d99-8c2d-43b6f86ce024 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:32.178115 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7bfbd86d-d9ed-4d99-8c2d-43b6f86ce024 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:32.192388 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7bfbd86d-d9ed-4d99-8c2d-43b6f86ce024 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:32.195793 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7bfbd86d-d9ed-4d99-8c2d-43b6f86ce024 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:32.197976 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7bfbd86d-d9ed-4d99-8c2d-43b6f86ce024 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1725 microversion: 2.20 time: 0.225005 Jul 26 07:27:32.199390 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 140/267] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:27:31 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1725 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:27:32.666915 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-53b08a50-3fd3-43ba-9067-50ab823a42b5 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Flavor limits 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 07:27:32.667379 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-53b08a50-3fd3-43ba-9067-50ab823a42b5 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Image limits 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 07:27:32.667810 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-53b08a50-3fd3-43ba-9067-50ab823a42b5 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Flavor pref 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 07:27:32.668274 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-53b08a50-3fd3-43ba-9067-50ab823a42b5 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Image pref 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 07:27:32.668694 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-53b08a50-3fd3-43ba-9067-50ab823a42b5 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 07:27:32.680245 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-53b08a50-3fd3-43ba-9067-50ab823a42b5 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:32.680724 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-53b08a50-3fd3-43ba-9067-50ab823a42b5 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:32.681726 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-53b08a50-3fd3-43ba-9067-50ab823a42b5 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:32.682026 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-53b08a50-3fd3-43ba-9067-50ab823a42b5 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:32.703838 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.quota [None req-53b08a50-3fd3-43ba-9067-50ab823a42b5 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Getting quotas for project c9cbf9b8d2e646eb945deb24d55fa0ad. Resources: {'instances', 'cores', 'ram'} {{(pid=117716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 07:27:32.710091 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.quota [None req-53b08a50-3fd3-43ba-9067-50ab823a42b5 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Getting quotas for user 7a4c3b33511646b59d89dc933827dcb5 and project c9cbf9b8d2e646eb945deb24d55fa0ad. Resources: {'instances', 'cores', 'ram'} {{(pid=117716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 07:27:32.722836 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-4cf43c54-eef3-46c6-af69-a3cd5dbecb68 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:32.725439 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-4cf43c54-eef3-46c6-af69-a3cd5dbecb68 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:32.725659 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-53b08a50-3fd3-43ba-9067-50ab823a42b5 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Going to run 1 instances... {{(pid=117716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 07:27:32.728364 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-53b08a50-3fd3-43ba-9067-50ab823a42b5 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: c9897f10-f186-4747-9f58-0d3f1cdf9287] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9589773-813f-42af-846a-43bcf9d4d002',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 07:27:32.747098 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4cf43c54-eef3-46c6-af69-a3cd5dbecb68 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:32.748340 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4cf43c54-eef3-46c6-af69-a3cd5dbecb68 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:32.750449 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4cf43c54-eef3-46c6-af69-a3cd5dbecb68 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:32.751688 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4cf43c54-eef3-46c6-af69-a3cd5dbecb68 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:32.806571 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-53b08a50-3fd3-43ba-9067-50ab823a42b5 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.240012 Jul 26 07:27:32.815275 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 128/268] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Jul 26 07:27:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 07:27:32.821058 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8b8ebb09-627f-48e6-ac8d-25faa1973419 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:32.822064 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8b8ebb09-627f-48e6-ac8d-25faa1973419 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: c9897f10-f186-4747-9f58-0d3f1cdf9287] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:32.919768 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8b8ebb09-627f-48e6-ac8d-25faa1973419 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:32.941290 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8b8ebb09-627f-48e6-ac8d-25faa1973419 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287" status: 200 len: 1214 microversion: 2.1 time: 0.124200 Jul 26 07:27:32.942936 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 129/269] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:32 2022] GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287 => generated 1214 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:32.949084 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-2b20767f-efcd-4230-8733-f9feabcf5be6 req-a3ad61ad-7615-4539-8a10-bd51925ee1ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a6929a0-8c3d-4474-8ffa-b2777251fa48", "tag": "3c2acf45-527d-4fda-b300-54247d2954e9"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:27:32.976476 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-2b20767f-efcd-4230-8733-f9feabcf5be6 req-a3ad61ad-7615-4539-8a10-bd51925ee1ee service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:32.977258 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-2b20767f-efcd-4230-8733-f9feabcf5be6 req-a3ad61ad-7615-4539-8a10-bd51925ee1ee service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:33.012024 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-2b20767f-efcd-4230-8733-f9feabcf5be6 req-a3ad61ad-7615-4539-8a10-bd51925ee1ee service nova] Creating event network-changed:3c2acf45-527d-4fda-b300-54247d2954e9 for instance 4a6929a0-8c3d-4474-8ffa-b2777251fa48 on hv-cinder-85083 Jul 26 07:27:33.027209 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-2b20767f-efcd-4230-8733-f9feabcf5be6 req-a3ad61ad-7615-4539-8a10-bd51925ee1ee service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080237 Jul 26 07:27:33.028945 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 130/270] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:27:33.043385 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6fc2b896-76b1-4ed6-ba39-da2f24e25cc6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:33.045032 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6fc2b896-76b1-4ed6-ba39-da2f24e25cc6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 4a6929a0-8c3d-4474-8ffa-b2777251fa48] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:33.053056 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:33.067800 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6fc2b896-76b1-4ed6-ba39-da2f24e25cc6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:33.069223 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6fc2b896-76b1-4ed6-ba39-da2f24e25cc6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:33.071793 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6fc2b896-76b1-4ed6-ba39-da2f24e25cc6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:33.072818 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6fc2b896-76b1-4ed6-ba39-da2f24e25cc6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:33.114931 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-4cf43c54-eef3-46c6-af69-a3cd5dbecb68 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:33.124595 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-4cf43c54-eef3-46c6-af69-a3cd5dbecb68 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669" status: 200 len: 1520 microversion: 2.1 time: 0.414438 Jul 26 07:27:33.126697 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 141/271] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:32 2022] GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669 => generated 1520 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:27:33.230684 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-2c8abff0-074c-4be8-b457-2c4a9f2e68ec tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:33.231398 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2c8abff0-074c-4be8-b457-2c4a9f2e68ec tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:33.249660 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2c8abff0-074c-4be8-b457-2c4a9f2e68ec tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:33.252717 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2c8abff0-074c-4be8-b457-2c4a9f2e68ec tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:33.253732 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2c8abff0-074c-4be8-b457-2c4a9f2e68ec tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:33.254202 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2c8abff0-074c-4be8-b457-2c4a9f2e68ec tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:33.355690 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6fc2b896-76b1-4ed6-ba39-da2f24e25cc6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:33.368161 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6fc2b896-76b1-4ed6-ba39-da2f24e25cc6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48" status: 200 len: 1319 microversion: 2.1 time: 0.337027 Jul 26 07:27:33.368784 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 131/272] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:33 2022] GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48 => generated 1319 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:33.573145 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2c8abff0-074c-4be8-b457-2c4a9f2e68ec tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:33.585513 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2c8abff0-074c-4be8-b457-2c4a9f2e68ec tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:33.587221 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2c8abff0-074c-4be8-b457-2c4a9f2e68ec tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:33.588601 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-2c8abff0-074c-4be8-b457-2c4a9f2e68ec tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1725 microversion: 2.20 time: 0.369184 Jul 26 07:27:33.588995 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 142/273] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:27:33 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1725 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:27:33.966777 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-dfa9ea87-0e8e-46c3-8e12-79b126f56477 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:33.968589 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-dfa9ea87-0e8e-46c3-8e12-79b126f56477 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: c9897f10-f186-4747-9f58-0d3f1cdf9287] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:33.979575 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dfa9ea87-0e8e-46c3-8e12-79b126f56477 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:33.980261 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dfa9ea87-0e8e-46c3-8e12-79b126f56477 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:33.981492 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dfa9ea87-0e8e-46c3-8e12-79b126f56477 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:33.986855 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dfa9ea87-0e8e-46c3-8e12-79b126f56477 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:34.087050 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-dfa9ea87-0e8e-46c3-8e12-79b126f56477 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:34.097862 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-dfa9ea87-0e8e-46c3-8e12-79b126f56477 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287" status: 200 len: 1218 microversion: 2.1 time: 0.135923 Jul 26 07:27:34.098687 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 132/274] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:33 2022] GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287 => generated 1218 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:34.149224 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-af9b1722-501e-409c-9eac-b4942a245480 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:34.150066 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-af9b1722-501e-409c-9eac-b4942a245480 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:34.157031 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-af9b1722-501e-409c-9eac-b4942a245480 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:34.157533 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-af9b1722-501e-409c-9eac-b4942a245480 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:34.158863 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-af9b1722-501e-409c-9eac-b4942a245480 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:34.159665 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-af9b1722-501e-409c-9eac-b4942a245480 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:34.353516 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-af9b1722-501e-409c-9eac-b4942a245480 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:34.369272 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-af9b1722-501e-409c-9eac-b4942a245480 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669" status: 200 len: 1520 microversion: 2.1 time: 0.225821 Jul 26 07:27:34.370873 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 143/275] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:34 2022] GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669 => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:34.414381 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9e640ee6-62e0-48b4-b07f-1a7fe09e244a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:34.416396 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-9e640ee6-62e0-48b4-b07f-1a7fe09e244a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 4a6929a0-8c3d-4474-8ffa-b2777251fa48] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:34.427674 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9e640ee6-62e0-48b4-b07f-1a7fe09e244a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:34.428431 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9e640ee6-62e0-48b4-b07f-1a7fe09e244a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:34.429830 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9e640ee6-62e0-48b4-b07f-1a7fe09e244a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:34.430785 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9e640ee6-62e0-48b4-b07f-1a7fe09e244a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:34.623618 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8c2bbe6d-9713-4bb6-9518-dc4758a19d4a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:34.624951 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8c2bbe6d-9713-4bb6-9518-dc4758a19d4a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:34.638051 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8c2bbe6d-9713-4bb6-9518-dc4758a19d4a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:34.654058 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8c2bbe6d-9713-4bb6-9518-dc4758a19d4a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:34.654058 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8c2bbe6d-9713-4bb6-9518-dc4758a19d4a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:34.654058 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8c2bbe6d-9713-4bb6-9518-dc4758a19d4a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:34.751511 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-9e640ee6-62e0-48b4-b07f-1a7fe09e244a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:34.764979 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-9e640ee6-62e0-48b4-b07f-1a7fe09e244a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48" status: 200 len: 1319 microversion: 2.1 time: 0.360135 Jul 26 07:27:34.765579 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 133/276] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:34 2022] GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48 => generated 1319 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:27:34.876201 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8c2bbe6d-9713-4bb6-9518-dc4758a19d4a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:34.900271 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8c2bbe6d-9713-4bb6-9518-dc4758a19d4a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:34.904844 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8c2bbe6d-9713-4bb6-9518-dc4758a19d4a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:34.909206 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8c2bbe6d-9713-4bb6-9518-dc4758a19d4a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1725 microversion: 2.20 time: 0.298522 Jul 26 07:27:34.911480 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 144/277] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:27:34 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1725 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:27:35.126269 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-16ee5758-8616-4692-94ed-b18085e413d2 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:35.127357 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-16ee5758-8616-4692-94ed-b18085e413d2 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: c9897f10-f186-4747-9f58-0d3f1cdf9287] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:35.139337 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-16ee5758-8616-4692-94ed-b18085e413d2 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:35.140118 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-16ee5758-8616-4692-94ed-b18085e413d2 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:35.141923 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-16ee5758-8616-4692-94ed-b18085e413d2 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:35.142859 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-16ee5758-8616-4692-94ed-b18085e413d2 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:35.251440 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-16ee5758-8616-4692-94ed-b18085e413d2 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:35.263993 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-16ee5758-8616-4692-94ed-b18085e413d2 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287" status: 200 len: 1210 microversion: 2.1 time: 0.144951 Jul 26 07:27:35.268548 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 134/278] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:35 2022] GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287 => generated 1210 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:35.397236 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-acd7480f-c0fd-4dba-adee-eccb043db9ff tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:35.399242 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-acd7480f-c0fd-4dba-adee-eccb043db9ff tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:35.409937 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-acd7480f-c0fd-4dba-adee-eccb043db9ff tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:35.410634 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-acd7480f-c0fd-4dba-adee-eccb043db9ff tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:35.412051 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-acd7480f-c0fd-4dba-adee-eccb043db9ff tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:35.413025 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-acd7480f-c0fd-4dba-adee-eccb043db9ff tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:35.637722 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-acd7480f-c0fd-4dba-adee-eccb043db9ff tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:35.648375 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-acd7480f-c0fd-4dba-adee-eccb043db9ff tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669" status: 200 len: 1520 microversion: 2.1 time: 0.257964 Jul 26 07:27:35.649389 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 145/279] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:35 2022] GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669 => generated 1520 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:27:35.797161 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-84af1b80-5972-486e-9b78-e568581c468e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:35.797974 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-84af1b80-5972-486e-9b78-e568581c468e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 4a6929a0-8c3d-4474-8ffa-b2777251fa48] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:35.804761 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-84af1b80-5972-486e-9b78-e568581c468e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:35.805212 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-84af1b80-5972-486e-9b78-e568581c468e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:35.806033 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-84af1b80-5972-486e-9b78-e568581c468e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:35.806474 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-84af1b80-5972-486e-9b78-e568581c468e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:35.956217 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-73a36aa0-f0f3-489d-a2f0-94d027dc8cfe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:35.957633 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-73a36aa0-f0f3-489d-a2f0-94d027dc8cfe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:35.972261 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-73a36aa0-f0f3-489d-a2f0-94d027dc8cfe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:35.973044 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-73a36aa0-f0f3-489d-a2f0-94d027dc8cfe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:35.974363 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-73a36aa0-f0f3-489d-a2f0-94d027dc8cfe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:35.975162 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-73a36aa0-f0f3-489d-a2f0-94d027dc8cfe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:36.060095 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-84af1b80-5972-486e-9b78-e568581c468e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:36.073712 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-84af1b80-5972-486e-9b78-e568581c468e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48" status: 200 len: 1319 microversion: 2.1 time: 0.280226 Jul 26 07:27:36.075035 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 135/280] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:35 2022] GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48 => generated 1319 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:27:36.154195 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-73a36aa0-f0f3-489d-a2f0-94d027dc8cfe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:36.163201 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-73a36aa0-f0f3-489d-a2f0-94d027dc8cfe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:36.164870 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-73a36aa0-f0f3-489d-a2f0-94d027dc8cfe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:36.166168 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-73a36aa0-f0f3-489d-a2f0-94d027dc8cfe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1725 microversion: 2.20 time: 0.217302 Jul 26 07:27:36.172917 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 146/281] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:27:35 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1725 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 07:27:36.288656 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b9a5a6c1-b70e-4dc2-a7c7-a8590b144c91 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:36.290257 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-b9a5a6c1-b70e-4dc2-a7c7-a8590b144c91 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: c9897f10-f186-4747-9f58-0d3f1cdf9287] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:36.303698 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b9a5a6c1-b70e-4dc2-a7c7-a8590b144c91 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:36.307243 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b9a5a6c1-b70e-4dc2-a7c7-a8590b144c91 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:36.309344 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b9a5a6c1-b70e-4dc2-a7c7-a8590b144c91 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:36.311226 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b9a5a6c1-b70e-4dc2-a7c7-a8590b144c91 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:36.442338 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-b9a5a6c1-b70e-4dc2-a7c7-a8590b144c91 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:36.452453 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b9a5a6c1-b70e-4dc2-a7c7-a8590b144c91 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287" status: 200 len: 1266 microversion: 2.1 time: 0.169245 Jul 26 07:27:36.453054 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 136/282] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:36 2022] GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:36.674093 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7171f978-ff3e-4e57-8891-0e5d2537751f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:36.675758 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7171f978-ff3e-4e57-8891-0e5d2537751f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:36.701098 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7171f978-ff3e-4e57-8891-0e5d2537751f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:36.702853 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7171f978-ff3e-4e57-8891-0e5d2537751f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:36.704053 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7171f978-ff3e-4e57-8891-0e5d2537751f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:36.705045 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7171f978-ff3e-4e57-8891-0e5d2537751f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:36.896665 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7171f978-ff3e-4e57-8891-0e5d2537751f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:36.906353 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-217b96dc-3d25-4062-b7e8-272af1e1bea0 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Action: 'create', calling method: .version_select at 0x7f7f02a2c550>, body: {"keypair": {"name": "tempest-keypair-208874891", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRfCRWD8VwaFUZuHdXRF3/EzjTPEeHOSz37d7eT9DVg1Lk0TyMbJW4l+8+49eEk4uxJFi3MfGv9hAJc6fLA6Qx/GVRdyOcDSXzsqrEKtZukPQXWANK1JX10TAZpEq3GOQ=="}} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:27:36.906757 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7171f978-ff3e-4e57-8891-0e5d2537751f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669" status: 200 len: 1520 microversion: 2.1 time: 0.239838 Jul 26 07:27:36.907327 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 147/283] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:36 2022] GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669 => generated 1520 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:36.964620 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.quota [None req-217b96dc-3d25-4062-b7e8-272af1e1bea0 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Getting quotas for project 4fa0c5574ef9497ebe29658f8164764c. Resources: {'key_pairs'} {{(pid=117716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 07:27:36.967123 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.quota [None req-217b96dc-3d25-4062-b7e8-272af1e1bea0 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Getting quotas for user 57029844165f4d83892176fe82594685 and project 4fa0c5574ef9497ebe29658f8164764c. Resources: {'key_pairs'} {{(pid=117716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 07:27:36.999262 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-217b96dc-3d25-4062-b7e8-272af1e1bea0 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.097102 Jul 26 07:27:37.000064 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 137/284] 10.222.0.39 () {60 vars in 1159 bytes} [Tue Jul 26 07:27:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 07:27:37.110095 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3608413c-a90c-45e9-8ba5-1b81d37c9f6a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:37.111860 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3608413c-a90c-45e9-8ba5-1b81d37c9f6a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 4a6929a0-8c3d-4474-8ffa-b2777251fa48] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:37.125139 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3608413c-a90c-45e9-8ba5-1b81d37c9f6a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:37.125918 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3608413c-a90c-45e9-8ba5-1b81d37c9f6a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:37.127625 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3608413c-a90c-45e9-8ba5-1b81d37c9f6a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:37.128617 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3608413c-a90c-45e9-8ba5-1b81d37c9f6a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:37.198132 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-3f5d1591-d438-491f-a1b5-4e8ef88d0664 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:37.199162 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-3f5d1591-d438-491f-a1b5-4e8ef88d0664 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:37.207258 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3f5d1591-d438-491f-a1b5-4e8ef88d0664 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:37.207734 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3f5d1591-d438-491f-a1b5-4e8ef88d0664 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:37.208601 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3f5d1591-d438-491f-a1b5-4e8ef88d0664 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:37.209242 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3f5d1591-d438-491f-a1b5-4e8ef88d0664 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:37.335008 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3608413c-a90c-45e9-8ba5-1b81d37c9f6a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:37.348596 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3608413c-a90c-45e9-8ba5-1b81d37c9f6a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48" status: 200 len: 1319 microversion: 2.1 time: 0.245712 Jul 26 07:27:37.349671 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 148/285] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:37 2022] GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48 => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:27:37.450721 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-3f5d1591-d438-491f-a1b5-4e8ef88d0664 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:37.466112 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-3f5d1591-d438-491f-a1b5-4e8ef88d0664 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:37.468627 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-3f5d1591-d438-491f-a1b5-4e8ef88d0664 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:37.472445 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-3f5d1591-d438-491f-a1b5-4e8ef88d0664 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1725 microversion: 2.20 time: 0.277530 Jul 26 07:27:37.473437 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 138/286] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:27:37 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1725 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:27:37.491026 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-87bb5148-fb98-4ee9-98e3-e83abb24a455 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:37.492202 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-87bb5148-fb98-4ee9-98e3-e83abb24a455 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: c9897f10-f186-4747-9f58-0d3f1cdf9287] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:37.509682 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-87bb5148-fb98-4ee9-98e3-e83abb24a455 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:37.510325 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-87bb5148-fb98-4ee9-98e3-e83abb24a455 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:37.511267 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-87bb5148-fb98-4ee9-98e3-e83abb24a455 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:37.511707 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-87bb5148-fb98-4ee9-98e3-e83abb24a455 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:37.748713 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-87bb5148-fb98-4ee9-98e3-e83abb24a455 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:37.764897 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-87bb5148-fb98-4ee9-98e3-e83abb24a455 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287" status: 200 len: 1272 microversion: 2.1 time: 0.290579 Jul 26 07:27:37.765725 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 149/287] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:37 2022] GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287 => generated 1272 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:37.943223 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ef4bc1d5-2533-438a-be4f-ee8d23e5d717 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:37.943947 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ef4bc1d5-2533-438a-be4f-ee8d23e5d717 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:37.950804 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ef4bc1d5-2533-438a-be4f-ee8d23e5d717 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:37.951249 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ef4bc1d5-2533-438a-be4f-ee8d23e5d717 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:37.952033 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ef4bc1d5-2533-438a-be4f-ee8d23e5d717 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:37.952462 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ef4bc1d5-2533-438a-be4f-ee8d23e5d717 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:38.188760 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ef4bc1d5-2533-438a-be4f-ee8d23e5d717 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:38.197682 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ef4bc1d5-2533-438a-be4f-ee8d23e5d717 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669" status: 200 len: 1520 microversion: 2.1 time: 0.258442 Jul 26 07:27:38.198348 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 139/288] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:37 2022] GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669 => generated 1520 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:38.382524 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-0c1140c3-c622-44f7-bbf0-c4f99c419360 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:38.383229 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-0c1140c3-c622-44f7-bbf0-c4f99c419360 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 4a6929a0-8c3d-4474-8ffa-b2777251fa48] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:38.385502 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell0:SELECT=2 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:38.388330 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell0:SELECT=8 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:38.395700 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0c1140c3-c622-44f7-bbf0-c4f99c419360 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:38.396143 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0c1140c3-c622-44f7-bbf0-c4f99c419360 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:38.396933 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0c1140c3-c622-44f7-bbf0-c4f99c419360 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:38.397395 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0c1140c3-c622-44f7-bbf0-c4f99c419360 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:38.520379 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-bb28aefa-90f7-4d97-afbf-773dfb8324e4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:38.521384 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-bb28aefa-90f7-4d97-afbf-773dfb8324e4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:38.531019 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bb28aefa-90f7-4d97-afbf-773dfb8324e4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:38.531637 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bb28aefa-90f7-4d97-afbf-773dfb8324e4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:38.532794 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bb28aefa-90f7-4d97-afbf-773dfb8324e4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:38.533295 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bb28aefa-90f7-4d97-afbf-773dfb8324e4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:38.559518 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-0c1140c3-c622-44f7-bbf0-c4f99c419360 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:38.574331 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-0c1140c3-c622-44f7-bbf0-c4f99c419360 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48" status: 200 len: 1319 microversion: 2.1 time: 0.196305 Jul 26 07:27:38.577945 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 150/289] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:38 2022] GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48 => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:27:38.790304 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f8ce2b4e-0743-4145-8af2-b65b3c8330e2 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:38.792149 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f8ce2b4e-0743-4145-8af2-b65b3c8330e2 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: c9897f10-f186-4747-9f58-0d3f1cdf9287] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:38.800405 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f8ce2b4e-0743-4145-8af2-b65b3c8330e2 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:38.801365 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f8ce2b4e-0743-4145-8af2-b65b3c8330e2 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:38.802398 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f8ce2b4e-0743-4145-8af2-b65b3c8330e2 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:38.802968 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f8ce2b4e-0743-4145-8af2-b65b3c8330e2 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:38.866215 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-bb28aefa-90f7-4d97-afbf-773dfb8324e4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:38.878384 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f8ce2b4e-0743-4145-8af2-b65b3c8330e2 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:38.883243 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-bb28aefa-90f7-4d97-afbf-773dfb8324e4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:38.887190 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-bb28aefa-90f7-4d97-afbf-773dfb8324e4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:38.890086 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-bb28aefa-90f7-4d97-afbf-773dfb8324e4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1725 microversion: 2.20 time: 0.376889 Jul 26 07:27:38.891975 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 140/290] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:27:38 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1725 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 07:27:38.892340 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f8ce2b4e-0743-4145-8af2-b65b3c8330e2 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287" status: 200 len: 1272 microversion: 2.1 time: 0.108436 Jul 26 07:27:38.900925 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 151/291] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:38 2022] GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287 => generated 1272 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:27:39.079138 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-302fb0b0-a0a5-4f14-99f0-5150e2cb0aa0 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1999623597", "imageRef": "b9589773-813f-42af-846a-43bcf9d4d002", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4aa6648c-5052-41c3-a55b-aea07445bb59"}], "security_groups": [{"name": "tempest-securitygroup--270156133"}], "key_name": "tempest-keypair-208874891", "user_data": "}} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:27:39.211533 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.network.neutron [None req-302fb0b0-a0a5-4f14-99f0-5150e2cb0aa0 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] validate_networks() for [('4aa6648c-5052-41c3-a55b-aea07445bb59', None, None, None, None, None)] {{(pid=117716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 07:27:39.225156 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c84f4fc6-b8f2-467c-b85d-3ce2368280b6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:39.226445 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c84f4fc6-b8f2-467c-b85d-3ce2368280b6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:39.238115 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c84f4fc6-b8f2-467c-b85d-3ce2368280b6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:39.238854 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c84f4fc6-b8f2-467c-b85d-3ce2368280b6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:39.239819 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c84f4fc6-b8f2-467c-b85d-3ce2368280b6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:39.240522 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c84f4fc6-b8f2-467c-b85d-3ce2368280b6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:39.426864 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c84f4fc6-b8f2-467c-b85d-3ce2368280b6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:39.438157 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c84f4fc6-b8f2-467c-b85d-3ce2368280b6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669" status: 200 len: 1520 microversion: 2.1 time: 0.220662 Jul 26 07:27:39.439286 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 152/292] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:39 2022] GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669 => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:27:39.597649 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8d1c095a-6e6a-48b9-a19f-3bc5ec7266e8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:39.598459 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8d1c095a-6e6a-48b9-a19f-3bc5ec7266e8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 4a6929a0-8c3d-4474-8ffa-b2777251fa48] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:39.605040 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8d1c095a-6e6a-48b9-a19f-3bc5ec7266e8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:39.605631 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8d1c095a-6e6a-48b9-a19f-3bc5ec7266e8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:39.606451 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8d1c095a-6e6a-48b9-a19f-3bc5ec7266e8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:39.606994 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8d1c095a-6e6a-48b9-a19f-3bc5ec7266e8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:39.752342 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-302fb0b0-a0a5-4f14-99f0-5150e2cb0aa0 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Flavor limits 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 07:27:39.753167 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-302fb0b0-a0a5-4f14-99f0-5150e2cb0aa0 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Image limits 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 07:27:39.753776 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-302fb0b0-a0a5-4f14-99f0-5150e2cb0aa0 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Flavor pref 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 07:27:39.754299 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-302fb0b0-a0a5-4f14-99f0-5150e2cb0aa0 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Image pref 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 07:27:39.754898 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-302fb0b0-a0a5-4f14-99f0-5150e2cb0aa0 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 07:27:39.768044 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-302fb0b0-a0a5-4f14-99f0-5150e2cb0aa0 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:39.768684 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-302fb0b0-a0a5-4f14-99f0-5150e2cb0aa0 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:39.769676 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-302fb0b0-a0a5-4f14-99f0-5150e2cb0aa0 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:39.770423 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-302fb0b0-a0a5-4f14-99f0-5150e2cb0aa0 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:39.784057 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8d1c095a-6e6a-48b9-a19f-3bc5ec7266e8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:39.796618 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8d1c095a-6e6a-48b9-a19f-3bc5ec7266e8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48" status: 200 len: 1319 microversion: 2.1 time: 0.203089 Jul 26 07:27:39.797412 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.quota [None req-302fb0b0-a0a5-4f14-99f0-5150e2cb0aa0 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Getting quotas for project 4fa0c5574ef9497ebe29658f8164764c. Resources: {'instances', 'cores', 'ram'} {{(pid=117716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 07:27:39.797592 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 153/293] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:39 2022] GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48 => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:39.805083 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.quota [None req-302fb0b0-a0a5-4f14-99f0-5150e2cb0aa0 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Getting quotas for user 57029844165f4d83892176fe82594685 and project 4fa0c5574ef9497ebe29658f8164764c. Resources: {'instances', 'cores', 'ram'} {{(pid=117716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 07:27:39.825550 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-302fb0b0-a0a5-4f14-99f0-5150e2cb0aa0 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Going to run 1 instances... {{(pid=117716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 07:27:39.828822 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-302fb0b0-a0a5-4f14-99f0-5150e2cb0aa0 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: e5a904a1-f100-432e-8c8c-f3dc187c3a0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9589773-813f-42af-846a-43bcf9d4d002',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 07:27:39.894206 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-302fb0b0-a0a5-4f14-99f0-5150e2cb0aa0 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.819472 Jul 26 07:27:39.895319 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 141/294] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Jul 26 07:27:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 07:27:39.908756 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8e9fb7f6-ba73-4716-be58-51f8ec590cdc tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:39.909588 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8e9fb7f6-ba73-4716-be58-51f8ec590cdc tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: e5a904a1-f100-432e-8c8c-f3dc187c3a0c] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:39.929613 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0364672d-f0cd-4195-aa8d-2b238a44a907 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:39.931108 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0364672d-f0cd-4195-aa8d-2b238a44a907 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: c9897f10-f186-4747-9f58-0d3f1cdf9287] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:39.945308 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0364672d-f0cd-4195-aa8d-2b238a44a907 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:39.946530 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0364672d-f0cd-4195-aa8d-2b238a44a907 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:39.948173 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0364672d-f0cd-4195-aa8d-2b238a44a907 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:39.949201 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0364672d-f0cd-4195-aa8d-2b238a44a907 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:39.981595 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8e9fb7f6-ba73-4716-be58-51f8ec590cdc tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:39.991237 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8e9fb7f6-ba73-4716-be58-51f8ec590cdc tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c" status: 200 len: 1241 microversion: 2.1 time: 0.086774 Jul 26 07:27:39.992781 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 154/295] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:39 2022] GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c => generated 1241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:39.998787 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-2da7e6e4-07b6-423e-bf06-507addd171f5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:39.999784 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2da7e6e4-07b6-423e-bf06-507addd171f5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:40.007959 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2da7e6e4-07b6-423e-bf06-507addd171f5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:40.008684 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2da7e6e4-07b6-423e-bf06-507addd171f5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:40.009828 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2da7e6e4-07b6-423e-bf06-507addd171f5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:40.010432 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2da7e6e4-07b6-423e-bf06-507addd171f5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:40.045866 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:40.096757 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0364672d-f0cd-4195-aa8d-2b238a44a907 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:40.131108 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0364672d-f0cd-4195-aa8d-2b238a44a907 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287" status: 200 len: 1272 microversion: 2.1 time: 0.207528 Jul 26 07:27:40.134847 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 142/296] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:39 2022] GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287 => generated 1272 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:27:40.270362 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2da7e6e4-07b6-423e-bf06-507addd171f5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:40.304489 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2da7e6e4-07b6-423e-bf06-507addd171f5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:40.308807 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2da7e6e4-07b6-423e-bf06-507addd171f5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:40.322234 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-2da7e6e4-07b6-423e-bf06-507addd171f5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1725 microversion: 2.20 time: 0.327765 Jul 26 07:27:40.323638 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 155/297] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:27:39 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1725 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:27:40.466350 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b72d86a9-33fd-4387-b1e4-982471b0f52e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:40.467868 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-b72d86a9-33fd-4387-b1e4-982471b0f52e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:40.476623 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b72d86a9-33fd-4387-b1e4-982471b0f52e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:40.477108 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b72d86a9-33fd-4387-b1e4-982471b0f52e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:40.478114 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b72d86a9-33fd-4387-b1e4-982471b0f52e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:40.478554 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b72d86a9-33fd-4387-b1e4-982471b0f52e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:40.766637 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-b72d86a9-33fd-4387-b1e4-982471b0f52e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:40.770427 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:40.783025 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b72d86a9-33fd-4387-b1e4-982471b0f52e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669" status: 200 len: 1500 microversion: 2.1 time: 0.321746 Jul 26 07:27:40.784441 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 143/298] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:40 2022] GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669 => generated 1500 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:27:40.823571 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-34ff3103-594b-4bb1-943b-6c1085d40579 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73f31715-8f35-4b92-86e3-c2b6f8680294"}} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:27:40.828062 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-34ff3103-594b-4bb1-943b-6c1085d40579 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:40.832952 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-156e2f17-c531-4ca1-99bd-b285997abf41 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:40.836272 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-156e2f17-c531-4ca1-99bd-b285997abf41 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 4a6929a0-8c3d-4474-8ffa-b2777251fa48] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:40.837531 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:40.844266 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-156e2f17-c531-4ca1-99bd-b285997abf41 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:40.845103 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-156e2f17-c531-4ca1-99bd-b285997abf41 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:40.847696 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-156e2f17-c531-4ca1-99bd-b285997abf41 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:40.848507 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-34ff3103-594b-4bb1-943b-6c1085d40579 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:40.849132 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-156e2f17-c531-4ca1-99bd-b285997abf41 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:40.850272 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-34ff3103-594b-4bb1-943b-6c1085d40579 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:40.851970 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-34ff3103-594b-4bb1-943b-6c1085d40579 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:40.853433 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-34ff3103-594b-4bb1-943b-6c1085d40579 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:40.970615 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.wsgi [None req-34ff3103-594b-4bb1-943b-6c1085d40579 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] HTTP exception thrown: Cannot 'attach_volume' instance 80da1213-270f-4afc-87f8-345874caa669 while it is in vm_state rescued Jul 26 07:27:40.975736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-34ff3103-594b-4bb1-943b-6c1085d40579 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Request method failure captured: Jul 26 07:27:40.975736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: request: POST /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669/os-volume_attachments HTTP/1.1 Jul 26 07:27:40.975736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept: application/json Jul 26 07:27:40.975736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept-Encoding: identity Jul 26 07:27:40.975736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Connection: close Jul 26 07:27:40.975736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Length: 74 Jul 26 07:27:40.975736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Type: application/json Jul 26 07:27:40.975736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Host: 10.222.0.39 Jul 26 07:27:40.975736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Openstack-System-Scope: None Jul 26 07:27:40.975736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: User-Agent: python-urllib3/1.26.10 Jul 26 07:27:40.975736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Auth-Token: gAAAAABi35b0t1LoOclOQiICyH7DfI9hTlCmo6suXwXRkCJi3MOM6RoKV-npsPapEw2uaIZ5CDpBRV73e8bEa0KMo_SVyclOzKbXE-MGMa484BeADltPBu8Mv7x89PigpBRQ6AvYL7hJKXltVglq5g-su4TtRmSS4VgBmr5HVZ4x5obXr-WQPfA Jul 26 07:27:40.975736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Id: None Jul 26 07:27:40.975736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Name: None Jul 26 07:27:40.975736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Identity-Status: Confirmed Jul 26 07:27:40.975736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Is-Admin-Project: True Jul 26 07:27:40.975736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Id: default Jul 26 07:27:40.975736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Name: Default Jul 26 07:27:40.975736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Id: 02e545f0c2784698a35cd8dcb1b02395 Jul 26 07:27:40.975736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1083850303 Jul 26 07:27:40.975736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Role: member,reader Jul 26 07:27:40.975736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Roles: member,reader Jul 26 07:27:40.978444 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/02e545f0c2784698a35cd8dcb1b02395"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_02e545f0c2784698a35cd8dcb1b02395"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/02e545f0c2784698a35cd8dcb1b02395"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/02e545f0c2784698a35cd8dcb1b02395"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:27:40.978444 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1083850303 Jul 26 07:27:40.978444 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Id: 02e545f0c2784698a35cd8dcb1b02395 Jul 26 07:27:40.978444 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1083850303 Jul 26 07:27:40.978444 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User: tempest-ServerRescueNegativeTestJSON-1083850303-project Jul 26 07:27:40.978444 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Id: default Jul 26 07:27:40.978444 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Name: Default Jul 26 07:27:40.978444 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Id: 886151888fc84ccf890d609ba62da9e1 Jul 26 07:27:40.978444 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1083850303-project Jul 26 07:27:40.978444 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Jul 26 07:27:40.978444 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: {"volumeAttachment": {"volumeId": "73f31715-8f35-4b92-86e3-c2b6f8680294"}} Jul 26 07:27:40.978444 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: method: > Jul 26 07:27:40.979823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: exception: Cannot 'attach_volume' instance 80da1213-270f-4afc-87f8-345874caa669 while it is in vm_state rescued Jul 26 07:27:40.979823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: action_args: {'server_id': '80da1213-270f-4afc-87f8-345874caa669', 'body': {'volumeAttachment': {'volumeId': '73f31715-8f35-4b92-86e3-c2b6f8680294'}}} Jul 26 07:27:40.979823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:27:40.979823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:27:40.979823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 26 07:27:40.979823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 26 07:27:40.979823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 07:27:40.979823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 07:27:40.979823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 07:27:40.979823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 07:27:40.979823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 80da1213-270f-4afc-87f8-345874caa669 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 26 07:27:40.979823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:27:40.979823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:27:40.979823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:27:40.979823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:27:40.979823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:27:40.979823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:27:40.979823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:27:40.979823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:27:40.982385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:27:40.982385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:27:40.982385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 07:27:40.982385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 07:27:40.982385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 07:27:40.982385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 07:27:40.982385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 07:27:40.982385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 07:27:40.982385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 26 07:27:40.982385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 07:27:40.982385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 07:27:40.982385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 07:27:40.982385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 80da1213-270f-4afc-87f8-345874caa669 while it is in vm_state rescued Jul 26 07:27:40.982385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:27:40.982385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:27:40.982385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:27:40.982385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:27:40.982385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:27:40.982385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:27:40.991438 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:27:40.991438 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:27:40.991438 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 80da1213-270f-4afc-87f8-345874caa669 while it is in vm_state rescued Jul 26 07:27:40.991438 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:27:40.991438 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-34ff3103-594b-4bb1-943b-6c1085d40579 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Returning 409 to user: Cannot 'attach_volume' instance 80da1213-270f-4afc-87f8-345874caa669 while it is in vm_state rescued {{(pid=117715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:27:40.994265 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-34ff3103-594b-4bb1-943b-6c1085d40579 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "POST /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.175316 Jul 26 07:27:40.995996 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 156/299] 10.222.0.39 () {60 vars in 1323 bytes} [Tue Jul 26 07:27:40 2022] POST /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669/os-volume_attachments => generated 152 bytes in 182 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 07:27:41.012744 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-def986d7-5bb7-4966-a60b-860625aa6cbf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:27:41.014217 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-def986d7-5bb7-4966-a60b-860625aa6cbf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:41.028641 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-def986d7-5bb7-4966-a60b-860625aa6cbf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:41.041220 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-def986d7-5bb7-4966-a60b-860625aa6cbf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:41.046210 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-def986d7-5bb7-4966-a60b-860625aa6cbf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:41.047907 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-def986d7-5bb7-4966-a60b-860625aa6cbf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:41.255388 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-def986d7-5bb7-4966-a60b-860625aa6cbf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "POST /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669/action" status: 202 len: 0 microversion: 2.1 time: 0.249037 Jul 26 07:27:41.263035 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 157/300] 10.222.0.39 () {60 vars in 1278 bytes} [Tue Jul 26 07:27:41 2022] POST /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 07:27:41.273543 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-23d67b57-e70c-41a1-b208-b1e9d207c9d8 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:41.276840 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-23d67b57-e70c-41a1-b208-b1e9d207c9d8 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: e5a904a1-f100-432e-8c8c-f3dc187c3a0c] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:41.293544 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-23d67b57-e70c-41a1-b208-b1e9d207c9d8 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:41.294184 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-23d67b57-e70c-41a1-b208-b1e9d207c9d8 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:41.297574 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-23d67b57-e70c-41a1-b208-b1e9d207c9d8 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:41.301951 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-23d67b57-e70c-41a1-b208-b1e9d207c9d8 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:41.416836 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-23d67b57-e70c-41a1-b208-b1e9d207c9d8 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:41.428711 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-23d67b57-e70c-41a1-b208-b1e9d207c9d8 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c" status: 200 len: 1237 microversion: 2.1 time: 0.168168 Jul 26 07:27:41.429640 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 158/301] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:41 2022] GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c => generated 1237 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:41.434656 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-156e2f17-c531-4ca1-99bd-b285997abf41 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:41.441009 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-52e92969-57bb-4a36-8db4-e0b7db4a4813 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:41.445907 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-52e92969-57bb-4a36-8db4-e0b7db4a4813 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: c9897f10-f186-4747-9f58-0d3f1cdf9287] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:41.459492 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-156e2f17-c531-4ca1-99bd-b285997abf41 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48" status: 200 len: 1319 microversion: 2.1 time: 0.631494 Jul 26 07:27:41.469255 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-52e92969-57bb-4a36-8db4-e0b7db4a4813 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:41.470713 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-52e92969-57bb-4a36-8db4-e0b7db4a4813 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:41.474464 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-52e92969-57bb-4a36-8db4-e0b7db4a4813 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:41.475508 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-52e92969-57bb-4a36-8db4-e0b7db4a4813 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:41.477881 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 144/302] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:40 2022] GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48 => generated 1319 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:41.483821 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7ab1a631-b833-42d7-9cf5-33a0187ebd02 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:41.486443 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7ab1a631-b833-42d7-9cf5-33a0187ebd02 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:41.508042 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7ab1a631-b833-42d7-9cf5-33a0187ebd02 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:41.512047 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7ab1a631-b833-42d7-9cf5-33a0187ebd02 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:41.513028 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7ab1a631-b833-42d7-9cf5-33a0187ebd02 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:41.513485 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7ab1a631-b833-42d7-9cf5-33a0187ebd02 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:41.742558 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-52e92969-57bb-4a36-8db4-e0b7db4a4813 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:41.758231 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-52e92969-57bb-4a36-8db4-e0b7db4a4813 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287" status: 200 len: 1314 microversion: 2.1 time: 0.327090 Jul 26 07:27:41.760375 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 159/303] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:41 2022] GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287 => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:41.772859 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3651b5ba-edf0-4948-a526-caa390804931 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:41.774120 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3651b5ba-edf0-4948-a526-caa390804931 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:41.786349 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3651b5ba-edf0-4948-a526-caa390804931 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:41.787387 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3651b5ba-edf0-4948-a526-caa390804931 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:41.788963 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3651b5ba-edf0-4948-a526-caa390804931 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:41.789833 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3651b5ba-edf0-4948-a526-caa390804931 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:42.029960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3651b5ba-edf0-4948-a526-caa390804931 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:42.046512 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3651b5ba-edf0-4948-a526-caa390804931 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:42.050382 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3651b5ba-edf0-4948-a526-caa390804931 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:42.052821 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3651b5ba-edf0-4948-a526-caa390804931 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1746 microversion: 2.20 time: 0.289227 Jul 26 07:27:42.054126 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 160/304] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:27:41 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1746 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:27:42.364397 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7ab1a631-b833-42d7-9cf5-33a0187ebd02 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:42.373184 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7ab1a631-b833-42d7-9cf5-33a0187ebd02 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669" status: 200 len: 1508 microversion: 2.1 time: 0.893777 Jul 26 07:27:42.373849 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 145/305] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:41 2022] GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669 => generated 1508 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:42.462011 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b4952d35-782f-46e6-8e1b-15e709475cad tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:42.462670 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b4952d35-782f-46e6-8e1b-15e709475cad tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: e5a904a1-f100-432e-8c8c-f3dc187c3a0c] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:42.470834 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b4952d35-782f-46e6-8e1b-15e709475cad tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:42.471295 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b4952d35-782f-46e6-8e1b-15e709475cad tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:42.472092 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b4952d35-782f-46e6-8e1b-15e709475cad tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:42.472528 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b4952d35-782f-46e6-8e1b-15e709475cad tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:42.483506 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2baf3d70-c1ab-4e58-94cf-317adc53ff7c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:42.484510 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2baf3d70-c1ab-4e58-94cf-317adc53ff7c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 4a6929a0-8c3d-4474-8ffa-b2777251fa48] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:42.493396 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2baf3d70-c1ab-4e58-94cf-317adc53ff7c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:42.494540 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2baf3d70-c1ab-4e58-94cf-317adc53ff7c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:42.496459 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2baf3d70-c1ab-4e58-94cf-317adc53ff7c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:42.497476 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2baf3d70-c1ab-4e58-94cf-317adc53ff7c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:42.572553 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-b4952d35-782f-46e6-8e1b-15e709475cad tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:42.581699 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b4952d35-782f-46e6-8e1b-15e709475cad tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c" status: 200 len: 1299 microversion: 2.1 time: 0.123933 Jul 26 07:27:42.582583 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 161/306] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:42 2022] GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c => generated 1299 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:42.807352 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-be4f3295-be03-4daa-b895-7653ef1c41ae tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:42.811128 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-be4f3295-be03-4daa-b895-7653ef1c41ae tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: c9897f10-f186-4747-9f58-0d3f1cdf9287] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:42.828392 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-be4f3295-be03-4daa-b895-7653ef1c41ae tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:42.829457 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-be4f3295-be03-4daa-b895-7653ef1c41ae tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:42.830964 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-be4f3295-be03-4daa-b895-7653ef1c41ae tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:42.831611 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-be4f3295-be03-4daa-b895-7653ef1c41ae tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:43.115976 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-be4f3295-be03-4daa-b895-7653ef1c41ae tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:43.125519 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-be4f3295-be03-4daa-b895-7653ef1c41ae tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287" status: 200 len: 1314 microversion: 2.1 time: 0.331863 Jul 26 07:27:43.126159 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 162/307] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:42 2022] GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:43.131335 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-544348cd-904d-4f4d-8d16-61f6e40bfb68 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:43.131954 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-544348cd-904d-4f4d-8d16-61f6e40bfb68 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:43.154832 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-544348cd-904d-4f4d-8d16-61f6e40bfb68 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:43.155306 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-544348cd-904d-4f4d-8d16-61f6e40bfb68 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:43.156519 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-544348cd-904d-4f4d-8d16-61f6e40bfb68 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:43.158359 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-544348cd-904d-4f4d-8d16-61f6e40bfb68 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:43.255208 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2baf3d70-c1ab-4e58-94cf-317adc53ff7c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:43.273865 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2baf3d70-c1ab-4e58-94cf-317adc53ff7c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48" status: 200 len: 1319 microversion: 2.1 time: 0.796263 Jul 26 07:27:43.284409 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 146/308] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:42 2022] GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48 => generated 1319 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:43.400590 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-634182bd-c5a3-4519-9f39-7ef6c20c62d0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:43.405264 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-634182bd-c5a3-4519-9f39-7ef6c20c62d0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:43.414985 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-544348cd-904d-4f4d-8d16-61f6e40bfb68 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:43.436034 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-634182bd-c5a3-4519-9f39-7ef6c20c62d0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:43.437266 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-634182bd-c5a3-4519-9f39-7ef6c20c62d0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:43.439127 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-634182bd-c5a3-4519-9f39-7ef6c20c62d0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:43.440415 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-634182bd-c5a3-4519-9f39-7ef6c20c62d0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:43.442557 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-544348cd-904d-4f4d-8d16-61f6e40bfb68 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:43.444392 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-544348cd-904d-4f4d-8d16-61f6e40bfb68 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:43.446368 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-544348cd-904d-4f4d-8d16-61f6e40bfb68 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1746 microversion: 2.20 time: 0.318357 Jul 26 07:27:43.459929 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 163/309] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:27:43 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1746 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:27:43.541358 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-04aa0673-3c3e-4789-98e2-d2ee2260fa95 req-96c85054-57f6-470d-9a7a-5826826014f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a6929a0-8c3d-4474-8ffa-b2777251fa48", "name": "network-vif-plugged", "status": "completed", "tag": "3c2acf45-527d-4fda-b300-54247d2954e9"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:27:43.555312 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-04aa0673-3c3e-4789-98e2-d2ee2260fa95 req-96c85054-57f6-470d-9a7a-5826826014f3 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:43.555312 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-04aa0673-3c3e-4789-98e2-d2ee2260fa95 req-96c85054-57f6-470d-9a7a-5826826014f3 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:43.574210 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-04aa0673-3c3e-4789-98e2-d2ee2260fa95 req-96c85054-57f6-470d-9a7a-5826826014f3 service nova] Creating event network-vif-plugged:3c2acf45-527d-4fda-b300-54247d2954e9 for instance 4a6929a0-8c3d-4474-8ffa-b2777251fa48 on hv-cinder-85083 Jul 26 07:27:43.587766 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-04aa0673-3c3e-4789-98e2-d2ee2260fa95 req-96c85054-57f6-470d-9a7a-5826826014f3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050617 Jul 26 07:27:43.590258 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 164/310] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:27:43.617302 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f32038d5-f983-4dd1-8168-e706997a1fa1 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:43.620195 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f32038d5-f983-4dd1-8168-e706997a1fa1 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: e5a904a1-f100-432e-8c8c-f3dc187c3a0c] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:43.637288 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f32038d5-f983-4dd1-8168-e706997a1fa1 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:43.638754 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f32038d5-f983-4dd1-8168-e706997a1fa1 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:43.641414 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f32038d5-f983-4dd1-8168-e706997a1fa1 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:43.643351 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f32038d5-f983-4dd1-8168-e706997a1fa1 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:43.746361 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f32038d5-f983-4dd1-8168-e706997a1fa1 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:43.756523 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f32038d5-f983-4dd1-8168-e706997a1fa1 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c" status: 200 len: 1299 microversion: 2.1 time: 0.152369 Jul 26 07:27:43.762038 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 165/311] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:43 2022] GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c => generated 1299 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:27:44.162324 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7fc675c9-1273-4222-b72b-cd99d822b567 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:44.163404 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7fc675c9-1273-4222-b72b-cd99d822b567 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: c9897f10-f186-4747-9f58-0d3f1cdf9287] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:44.170881 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7fc675c9-1273-4222-b72b-cd99d822b567 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:44.171333 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7fc675c9-1273-4222-b72b-cd99d822b567 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:44.172217 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7fc675c9-1273-4222-b72b-cd99d822b567 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:44.173301 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7fc675c9-1273-4222-b72b-cd99d822b567 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:44.275986 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-634182bd-c5a3-4519-9f39-7ef6c20c62d0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:44.285040 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-634182bd-c5a3-4519-9f39-7ef6c20c62d0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669" status: 200 len: 1508 microversion: 2.1 time: 0.892506 Jul 26 07:27:44.308554 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 147/312] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:43 2022] GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669 => generated 1508 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:27:44.317778 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-014b5742-7b4b-4c05-bdc0-a8ed5041dc00 req-997b349d-939c-4dc4-beb4-e4837f2190ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9897f10-f186-4747-9f58-0d3f1cdf9287", "tag": "3f70ab89-871b-41bb-9ed0-3d3b4e06c0d8"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:27:44.332259 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-014b5742-7b4b-4c05-bdc0-a8ed5041dc00 req-997b349d-939c-4dc4-beb4-e4837f2190ee service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:44.333167 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-014b5742-7b4b-4c05-bdc0-a8ed5041dc00 req-997b349d-939c-4dc4-beb4-e4837f2190ee service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:44.347935 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-014b5742-7b4b-4c05-bdc0-a8ed5041dc00 req-997b349d-939c-4dc4-beb4-e4837f2190ee service nova] Creating event network-changed:3f70ab89-871b-41bb-9ed0-3d3b4e06c0d8 for instance c9897f10-f186-4747-9f58-0d3f1cdf9287 on hv-cinder-85083 Jul 26 07:27:44.354439 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-014b5742-7b4b-4c05-bdc0-a8ed5041dc00 req-997b349d-939c-4dc4-beb4-e4837f2190ee service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043785 Jul 26 07:27:44.355533 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 148/313] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:27:44.363044 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b7188015-d630-4afc-88ee-6741a0f8ba25 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:44.364057 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-b7188015-d630-4afc-88ee-6741a0f8ba25 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 4a6929a0-8c3d-4474-8ffa-b2777251fa48] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:44.373508 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b7188015-d630-4afc-88ee-6741a0f8ba25 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:44.374411 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b7188015-d630-4afc-88ee-6741a0f8ba25 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:44.375469 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b7188015-d630-4afc-88ee-6741a0f8ba25 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:44.376222 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b7188015-d630-4afc-88ee-6741a0f8ba25 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:44.384412 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7fc675c9-1273-4222-b72b-cd99d822b567 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:44.404187 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7fc675c9-1273-4222-b72b-cd99d822b567 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287" status: 200 len: 1314 microversion: 2.1 time: 0.245482 Jul 26 07:27:44.407836 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 166/314] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:44 2022] GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:27:44.472954 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3e6aa33f-a599-4e0b-92d9-b4c3d472cd4b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:44.473599 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3e6aa33f-a599-4e0b-92d9-b4c3d472cd4b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:44.483402 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3e6aa33f-a599-4e0b-92d9-b4c3d472cd4b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:44.484260 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3e6aa33f-a599-4e0b-92d9-b4c3d472cd4b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:44.485568 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3e6aa33f-a599-4e0b-92d9-b4c3d472cd4b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:44.486324 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3e6aa33f-a599-4e0b-92d9-b4c3d472cd4b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:44.748898 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3e6aa33f-a599-4e0b-92d9-b4c3d472cd4b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:44.762307 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-b7188015-d630-4afc-88ee-6741a0f8ba25 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:44.764829 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3e6aa33f-a599-4e0b-92d9-b4c3d472cd4b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:44.767964 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3e6aa33f-a599-4e0b-92d9-b4c3d472cd4b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:44.771196 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3e6aa33f-a599-4e0b-92d9-b4c3d472cd4b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1741 microversion: 2.20 time: 0.302020 Jul 26 07:27:44.772685 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 167/315] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:27:44 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1741 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 07:27:44.795786 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b7188015-d630-4afc-88ee-6741a0f8ba25 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48" status: 200 len: 1319 microversion: 2.1 time: 0.438324 Jul 26 07:27:44.796520 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-30e545b5-f214-49be-80cc-e12a72e67e40 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:44.797163 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-30e545b5-f214-49be-80cc-e12a72e67e40 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: e5a904a1-f100-432e-8c8c-f3dc187c3a0c] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:44.799146 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 149/316] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:44 2022] GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48 => generated 1319 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:44.827004 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-30e545b5-f214-49be-80cc-e12a72e67e40 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:44.827982 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-30e545b5-f214-49be-80cc-e12a72e67e40 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:44.829321 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-30e545b5-f214-49be-80cc-e12a72e67e40 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:44.830051 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-30e545b5-f214-49be-80cc-e12a72e67e40 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:45.122898 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-30e545b5-f214-49be-80cc-e12a72e67e40 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:45.137413 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-30e545b5-f214-49be-80cc-e12a72e67e40 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c" status: 200 len: 1366 microversion: 2.1 time: 0.346589 Jul 26 07:27:45.139076 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 168/317] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:44 2022] GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c => generated 1366 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:27:45.314043 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-fd18c4fb-5eef-4a56-888c-38c2944b412d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:45.314909 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-fd18c4fb-5eef-4a56-888c-38c2944b412d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:45.323216 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fd18c4fb-5eef-4a56-888c-38c2944b412d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:45.323756 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fd18c4fb-5eef-4a56-888c-38c2944b412d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:45.324695 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fd18c4fb-5eef-4a56-888c-38c2944b412d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:45.325261 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fd18c4fb-5eef-4a56-888c-38c2944b412d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:45.445607 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7581a76c-cca5-4926-b592-bc8cea93f841 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:45.448408 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7581a76c-cca5-4926-b592-bc8cea93f841 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: c9897f10-f186-4747-9f58-0d3f1cdf9287] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:45.458469 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7581a76c-cca5-4926-b592-bc8cea93f841 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:45.459132 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7581a76c-cca5-4926-b592-bc8cea93f841 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:45.460650 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7581a76c-cca5-4926-b592-bc8cea93f841 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:45.461346 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7581a76c-cca5-4926-b592-bc8cea93f841 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:45.527127 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-fd18c4fb-5eef-4a56-888c-38c2944b412d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:45.537007 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-fd18c4fb-5eef-4a56-888c-38c2944b412d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669" status: 200 len: 1508 microversion: 2.1 time: 0.227956 Jul 26 07:27:45.537956 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 150/318] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:45 2022] GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669 => generated 1508 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:45.613453 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-d0d6a3f9-2b53-4969-a498-f90fd325b1e0 req-acbfc4d7-f57c-485a-a7b0-42f4d04931b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "990571a8-aa04-4aac-921c-cf071eca1dd0", "name": "network-vif-plugged", "status": "completed", "tag": "06f98651-1a4f-4f3c-a886-1d5aad025305"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:27:45.636376 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-d0d6a3f9-2b53-4969-a498-f90fd325b1e0 req-acbfc4d7-f57c-485a-a7b0-42f4d04931b9 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:45.637927 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-d0d6a3f9-2b53-4969-a498-f90fd325b1e0 req-acbfc4d7-f57c-485a-a7b0-42f4d04931b9 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:45.667467 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-d0d6a3f9-2b53-4969-a498-f90fd325b1e0 req-acbfc4d7-f57c-485a-a7b0-42f4d04931b9 service nova] Creating event network-vif-plugged:06f98651-1a4f-4f3c-a886-1d5aad025305 for instance 990571a8-aa04-4aac-921c-cf071eca1dd0 on hv-cinder-85083 Jul 26 07:27:45.677231 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-d0d6a3f9-2b53-4969-a498-f90fd325b1e0 req-acbfc4d7-f57c-485a-a7b0-42f4d04931b9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071063 Jul 26 07:27:45.682025 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 151/319] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 07:27:45.697000 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7581a76c-cca5-4926-b592-bc8cea93f841 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:45.705253 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7581a76c-cca5-4926-b592-bc8cea93f841 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287" status: 200 len: 1314 microversion: 2.1 time: 0.267139 Jul 26 07:27:45.705874 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 169/320] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:45 2022] GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:27:45.802809 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-64c4e8c2-3684-4426-92a3-80d6dd3aab5a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:45.803985 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-64c4e8c2-3684-4426-92a3-80d6dd3aab5a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:45.813471 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-64c4e8c2-3684-4426-92a3-80d6dd3aab5a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:45.814069 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-64c4e8c2-3684-4426-92a3-80d6dd3aab5a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:45.815727 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-64c4e8c2-3684-4426-92a3-80d6dd3aab5a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:45.816624 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-64c4e8c2-3684-4426-92a3-80d6dd3aab5a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:45.823782 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8ccd8377-8c6d-42a9-a91b-a88a9c3f78f3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:45.824925 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8ccd8377-8c6d-42a9-a91b-a88a9c3f78f3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 4a6929a0-8c3d-4474-8ffa-b2777251fa48] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:45.836937 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ccd8377-8c6d-42a9-a91b-a88a9c3f78f3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:45.837657 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ccd8377-8c6d-42a9-a91b-a88a9c3f78f3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:45.839247 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ccd8377-8c6d-42a9-a91b-a88a9c3f78f3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:45.839952 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ccd8377-8c6d-42a9-a91b-a88a9c3f78f3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:46.052079 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8ccd8377-8c6d-42a9-a91b-a88a9c3f78f3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:46.072636 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8ccd8377-8c6d-42a9-a91b-a88a9c3f78f3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48" status: 200 len: 1319 microversion: 2.1 time: 0.255405 Jul 26 07:27:46.075922 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 170/321] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:45 2022] GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:27:46.161673 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ba9d3e9f-63ad-45db-86aa-82ea4f8c2723 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:46.162513 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ba9d3e9f-63ad-45db-86aa-82ea4f8c2723 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: e5a904a1-f100-432e-8c8c-f3dc187c3a0c] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:46.178885 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ba9d3e9f-63ad-45db-86aa-82ea4f8c2723 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:46.180180 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ba9d3e9f-63ad-45db-86aa-82ea4f8c2723 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:46.181625 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ba9d3e9f-63ad-45db-86aa-82ea4f8c2723 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:46.182231 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ba9d3e9f-63ad-45db-86aa-82ea4f8c2723 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:46.203757 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-64c4e8c2-3684-4426-92a3-80d6dd3aab5a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:46.227273 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-64c4e8c2-3684-4426-92a3-80d6dd3aab5a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:46.229277 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-64c4e8c2-3684-4426-92a3-80d6dd3aab5a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:46.230836 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-64c4e8c2-3684-4426-92a3-80d6dd3aab5a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1741 microversion: 2.20 time: 0.437110 Jul 26 07:27:46.231961 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 152/322] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:27:45 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1741 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:27:46.463855 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ba9d3e9f-63ad-45db-86aa-82ea4f8c2723 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:46.473296 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ba9d3e9f-63ad-45db-86aa-82ea4f8c2723 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c" status: 200 len: 1366 microversion: 2.1 time: 0.315707 Jul 26 07:27:46.474480 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 171/323] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:46 2022] GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c => generated 1366 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:46.575251 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b81b6b87-1cf4-4ad6-a819-0a18e1051252 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:46.576865 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-b81b6b87-1cf4-4ad6-a819-0a18e1051252 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:46.590764 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b81b6b87-1cf4-4ad6-a819-0a18e1051252 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:46.591934 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b81b6b87-1cf4-4ad6-a819-0a18e1051252 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:46.596263 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b81b6b87-1cf4-4ad6-a819-0a18e1051252 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:46.597538 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b81b6b87-1cf4-4ad6-a819-0a18e1051252 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:46.728448 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-630a5866-7120-4567-aa7b-62481c9d114e tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:46.728953 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-630a5866-7120-4567-aa7b-62481c9d114e tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: c9897f10-f186-4747-9f58-0d3f1cdf9287] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:46.739923 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-630a5866-7120-4567-aa7b-62481c9d114e tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:46.740366 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-630a5866-7120-4567-aa7b-62481c9d114e tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:46.746206 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-630a5866-7120-4567-aa7b-62481c9d114e tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:46.747507 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-630a5866-7120-4567-aa7b-62481c9d114e tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:46.786595 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:46.971353 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-630a5866-7120-4567-aa7b-62481c9d114e tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:46.983958 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-630a5866-7120-4567-aa7b-62481c9d114e tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287" status: 200 len: 1314 microversion: 2.1 time: 0.259443 Jul 26 07:27:46.985458 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 172/324] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:46 2022] GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:47.097896 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-809f9d59-b589-48d0-9408-5101dace69bd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:47.099195 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-809f9d59-b589-48d0-9408-5101dace69bd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 4a6929a0-8c3d-4474-8ffa-b2777251fa48] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:47.106773 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-809f9d59-b589-48d0-9408-5101dace69bd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:47.107721 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-809f9d59-b589-48d0-9408-5101dace69bd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:47.108883 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-809f9d59-b589-48d0-9408-5101dace69bd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:47.109594 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-809f9d59-b589-48d0-9408-5101dace69bd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:47.405198 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-809f9d59-b589-48d0-9408-5101dace69bd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:47.421333 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-809f9d59-b589-48d0-9408-5101dace69bd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48" status: 200 len: 1508 microversion: 2.1 time: 0.327513 Jul 26 07:27:47.423302 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 173/325] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:47 2022] GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48 => generated 1508 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:27:47.430853 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c5f89bfc-0f6e-41b7-adee-ca02dad0c584 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:47.431927 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c5f89bfc-0f6e-41b7-adee-ca02dad0c584 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:47.454896 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c5f89bfc-0f6e-41b7-adee-ca02dad0c584 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:47.455352 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c5f89bfc-0f6e-41b7-adee-ca02dad0c584 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:47.456243 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c5f89bfc-0f6e-41b7-adee-ca02dad0c584 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:47.456662 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c5f89bfc-0f6e-41b7-adee-ca02dad0c584 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:47.629259 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-b81b6b87-1cf4-4ad6-a819-0a18e1051252 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:47.655297 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b81b6b87-1cf4-4ad6-a819-0a18e1051252 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669" status: 200 len: 1514 microversion: 2.1 time: 1.082003 Jul 26 07:27:47.671002 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 153/326] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:46 2022] GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669 => generated 1514 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:47.692678 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ec6d0695-4a2d-4660-9a60-35d4d800f55e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:47.696557 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ec6d0695-4a2d-4660-9a60-35d4d800f55e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: e5a904a1-f100-432e-8c8c-f3dc187c3a0c] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:47.713435 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ec6d0695-4a2d-4660-9a60-35d4d800f55e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:47.714720 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ec6d0695-4a2d-4660-9a60-35d4d800f55e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:47.720036 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ec6d0695-4a2d-4660-9a60-35d4d800f55e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:47.721777 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ec6d0695-4a2d-4660-9a60-35d4d800f55e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:47.791601 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c5f89bfc-0f6e-41b7-adee-ca02dad0c584 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:47.806583 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c5f89bfc-0f6e-41b7-adee-ca02dad0c584 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:47.808148 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c5f89bfc-0f6e-41b7-adee-ca02dad0c584 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:47.828165 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c5f89bfc-0f6e-41b7-adee-ca02dad0c584 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1741 microversion: 2.20 time: 0.400744 Jul 26 07:27:47.828770 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 174/327] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:27:47 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1741 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:27:48.034551 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-4f109f0c-cb1a-46fa-b7e5-2284d6b9987f tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:48.036102 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-4f109f0c-cb1a-46fa-b7e5-2284d6b9987f tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: c9897f10-f186-4747-9f58-0d3f1cdf9287] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:48.057587 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4f109f0c-cb1a-46fa-b7e5-2284d6b9987f tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:48.060246 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4f109f0c-cb1a-46fa-b7e5-2284d6b9987f tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:48.063352 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4f109f0c-cb1a-46fa-b7e5-2284d6b9987f tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:48.064503 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4f109f0c-cb1a-46fa-b7e5-2284d6b9987f tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:48.305093 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-4f109f0c-cb1a-46fa-b7e5-2284d6b9987f tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:48.316010 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-4f109f0c-cb1a-46fa-b7e5-2284d6b9987f tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287" status: 200 len: 1314 microversion: 2.1 time: 0.299605 Jul 26 07:27:48.319032 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 175/328] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:48 2022] GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:48.759508 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ec6d0695-4a2d-4660-9a60-35d4d800f55e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:48.775428 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ec6d0695-4a2d-4660-9a60-35d4d800f55e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c" status: 200 len: 1366 microversion: 2.1 time: 1.102338 Jul 26 07:27:48.777438 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 154/329] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:47 2022] GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c => generated 1366 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:48.878752 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a2be000b-c5db-4c21-aace-adf6b00b3103 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:48.881307 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a2be000b-c5db-4c21-aace-adf6b00b3103 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:48.901219 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a2be000b-c5db-4c21-aace-adf6b00b3103 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:48.903778 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a2be000b-c5db-4c21-aace-adf6b00b3103 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:48.905174 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a2be000b-c5db-4c21-aace-adf6b00b3103 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:48.907826 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a2be000b-c5db-4c21-aace-adf6b00b3103 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:48.959720 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-848f0c94-8764-42cc-816a-951fd6de4afa req-8f571fcd-2310-44b7-8554-0e5c4541d683 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5a904a1-f100-432e-8c8c-f3dc187c3a0c", "tag": "05fcdb60-6df8-4eba-b269-358abb08dcc2"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:27:49.010707 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-848f0c94-8764-42cc-816a-951fd6de4afa req-8f571fcd-2310-44b7-8554-0e5c4541d683 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:49.012414 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-848f0c94-8764-42cc-816a-951fd6de4afa req-8f571fcd-2310-44b7-8554-0e5c4541d683 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:49.039192 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-848f0c94-8764-42cc-816a-951fd6de4afa req-8f571fcd-2310-44b7-8554-0e5c4541d683 service nova] Creating event network-changed:05fcdb60-6df8-4eba-b269-358abb08dcc2 for instance e5a904a1-f100-432e-8c8c-f3dc187c3a0c on hv-cinder-85083 Jul 26 07:27:49.046862 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-848f0c94-8764-42cc-816a-951fd6de4afa req-8f571fcd-2310-44b7-8554-0e5c4541d683 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094091 Jul 26 07:27:49.051682 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 155/330] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 07:27:49.175668 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-a2be000b-c5db-4c21-aace-adf6b00b3103 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:49.187003 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-a2be000b-c5db-4c21-aace-adf6b00b3103 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:49.189139 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-a2be000b-c5db-4c21-aace-adf6b00b3103 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:49.190788 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a2be000b-c5db-4c21-aace-adf6b00b3103 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1741 microversion: 2.20 time: 0.327070 Jul 26 07:27:49.191744 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 176/331] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:27:48 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1741 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 07:27:49.347457 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-10781fcf-7f59-4f2e-a475-a9768ad4a6a2 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:49.349019 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-10781fcf-7f59-4f2e-a475-a9768ad4a6a2 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: c9897f10-f186-4747-9f58-0d3f1cdf9287] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:49.362854 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-10781fcf-7f59-4f2e-a475-a9768ad4a6a2 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:49.363825 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-10781fcf-7f59-4f2e-a475-a9768ad4a6a2 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:49.365453 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-10781fcf-7f59-4f2e-a475-a9768ad4a6a2 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:49.366440 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-10781fcf-7f59-4f2e-a475-a9768ad4a6a2 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:49.718742 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-bfafabfc-96a6-409f-ab95-8f5b544c1403 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Action: 'create', calling method: .version_select at 0x7f7f028e3280>, body: {"keypair": {"name": "tempest-keypair-1015692343", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEf3/90umSLsuxtxChg39iAheTpWTqdpCsEL7N4AOa8a3Nr/kNV2zwnLe8wYTXHuKnCYaQiMmgyhzVQNO3efak9IYaiKB0GxjyU0QIbKj6LzXdCaJDPFxiHBED8EmDDZWA=="}} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:27:49.746448 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.quota [None req-bfafabfc-96a6-409f-ab95-8f5b544c1403 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Getting quotas for project 02e545f0c2784698a35cd8dcb1b02395. Resources: {'key_pairs'} {{(pid=117715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 07:27:49.752316 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.quota [None req-bfafabfc-96a6-409f-ab95-8f5b544c1403 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Getting quotas for user 886151888fc84ccf890d609ba62da9e1 and project 02e545f0c2784698a35cd8dcb1b02395. Resources: {'key_pairs'} {{(pid=117715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 07:27:49.781920 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell0:SELECT=4 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:49.799468 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-bfafabfc-96a6-409f-ab95-8f5b544c1403 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.085689 Jul 26 07:27:49.801229 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 177/332] 10.222.0.39 () {60 vars in 1159 bytes} [Tue Jul 26 07:27:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:27:49.816070 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7edcb781-3504-41f8-ac6e-8fc383a49bfe tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:49.816070 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7edcb781-3504-41f8-ac6e-8fc383a49bfe tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: e5a904a1-f100-432e-8c8c-f3dc187c3a0c] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:49.816603 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell0:SELECT=18 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:49.823380 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7edcb781-3504-41f8-ac6e-8fc383a49bfe tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:49.823938 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7edcb781-3504-41f8-ac6e-8fc383a49bfe tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:49.825032 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7edcb781-3504-41f8-ac6e-8fc383a49bfe tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:49.826021 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7edcb781-3504-41f8-ac6e-8fc383a49bfe tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:49.927324 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-10781fcf-7f59-4f2e-a475-a9768ad4a6a2 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:49.940908 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-10781fcf-7f59-4f2e-a475-a9768ad4a6a2 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287" status: 200 len: 1314 microversion: 2.1 time: 0.602500 Jul 26 07:27:49.954150 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 156/333] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:49 2022] GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287 => generated 1314 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:50.062622 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7edcb781-3504-41f8-ac6e-8fc383a49bfe tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:50.075525 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7edcb781-3504-41f8-ac6e-8fc383a49bfe tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c" status: 200 len: 1366 microversion: 2.1 time: 0.269650 Jul 26 07:27:50.079359 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 178/334] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:49 2022] GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:50.234032 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7fe6064c-8a9a-4d21-9cfc-b25c15ad2a0e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:50.240816 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7fe6064c-8a9a-4d21-9cfc-b25c15ad2a0e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:50.285407 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7fe6064c-8a9a-4d21-9cfc-b25c15ad2a0e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:50.286745 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7fe6064c-8a9a-4d21-9cfc-b25c15ad2a0e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:50.288434 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7fe6064c-8a9a-4d21-9cfc-b25c15ad2a0e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:50.289445 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7fe6064c-8a9a-4d21-9cfc-b25c15ad2a0e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:50.960184 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7fe6064c-8a9a-4d21-9cfc-b25c15ad2a0e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:50.974102 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6aaa608e-5637-48d6-9e21-6097628bd713 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:50.976828 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-6aaa608e-5637-48d6-9e21-6097628bd713 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: c9897f10-f186-4747-9f58-0d3f1cdf9287] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:50.985305 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7fe6064c-8a9a-4d21-9cfc-b25c15ad2a0e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:50.991917 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7fe6064c-8a9a-4d21-9cfc-b25c15ad2a0e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:50.992981 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7fe6064c-8a9a-4d21-9cfc-b25c15ad2a0e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1741 microversion: 2.20 time: 0.777773 Jul 26 07:27:50.993571 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 157/335] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:27:50 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1741 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:27:51.013832 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6aaa608e-5637-48d6-9e21-6097628bd713 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:51.014832 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6aaa608e-5637-48d6-9e21-6097628bd713 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:51.020040 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6aaa608e-5637-48d6-9e21-6097628bd713 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:51.020691 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6aaa608e-5637-48d6-9e21-6097628bd713 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:51.105841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-520bfda7-1391-4f7e-a444-8826e049b170 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:51.106379 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-520bfda7-1391-4f7e-a444-8826e049b170 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: e5a904a1-f100-432e-8c8c-f3dc187c3a0c] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:51.126710 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-520bfda7-1391-4f7e-a444-8826e049b170 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:51.127156 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-520bfda7-1391-4f7e-a444-8826e049b170 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:51.128194 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-520bfda7-1391-4f7e-a444-8826e049b170 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:51.129175 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-520bfda7-1391-4f7e-a444-8826e049b170 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:51.599389 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-520bfda7-1391-4f7e-a444-8826e049b170 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:51.620849 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-520bfda7-1391-4f7e-a444-8826e049b170 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c" status: 200 len: 1366 microversion: 2.1 time: 0.520342 Jul 26 07:27:51.622273 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 158/336] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:51 2022] GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c => generated 1366 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:51.801005 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-6aaa608e-5637-48d6-9e21-6097628bd713 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:51.812701 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6aaa608e-5637-48d6-9e21-6097628bd713 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287" status: 200 len: 1314 microversion: 2.1 time: 0.849805 Jul 26 07:27:51.827284 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 179/337] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:50 2022] GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287 => generated 1314 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:52.019261 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2e64c1b8-04f5-49bf-9ab0-99fc833a4be8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:52.021226 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2e64c1b8-04f5-49bf-9ab0-99fc833a4be8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:52.031556 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2e64c1b8-04f5-49bf-9ab0-99fc833a4be8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:52.032667 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2e64c1b8-04f5-49bf-9ab0-99fc833a4be8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:52.034102 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2e64c1b8-04f5-49bf-9ab0-99fc833a4be8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:52.034826 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2e64c1b8-04f5-49bf-9ab0-99fc833a4be8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:52.368651 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2e64c1b8-04f5-49bf-9ab0-99fc833a4be8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:52.401597 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2e64c1b8-04f5-49bf-9ab0-99fc833a4be8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:52.404082 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2e64c1b8-04f5-49bf-9ab0-99fc833a4be8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:52.405837 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2e64c1b8-04f5-49bf-9ab0-99fc833a4be8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1741 microversion: 2.20 time: 0.392178 Jul 26 07:27:52.406311 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 159/338] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:27:52 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1741 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 07:27:52.644550 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-0e5a243b-9a5f-4084-be8d-16186d169935 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:52.645047 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-0e5a243b-9a5f-4084-be8d-16186d169935 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: e5a904a1-f100-432e-8c8c-f3dc187c3a0c] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:52.653879 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0e5a243b-9a5f-4084-be8d-16186d169935 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:52.655468 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0e5a243b-9a5f-4084-be8d-16186d169935 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:52.656755 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0e5a243b-9a5f-4084-be8d-16186d169935 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:52.657205 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0e5a243b-9a5f-4084-be8d-16186d169935 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:52.836019 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6716823f-0dc8-448d-bf43-1bb6aa754acb tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:52.836651 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6716823f-0dc8-448d-bf43-1bb6aa754acb tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: c9897f10-f186-4747-9f58-0d3f1cdf9287] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:52.853543 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6716823f-0dc8-448d-bf43-1bb6aa754acb tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:52.854339 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6716823f-0dc8-448d-bf43-1bb6aa754acb tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:52.855352 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6716823f-0dc8-448d-bf43-1bb6aa754acb tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:52.855807 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6716823f-0dc8-448d-bf43-1bb6aa754acb tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:53.041682 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6716823f-0dc8-448d-bf43-1bb6aa754acb tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:53.053834 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6716823f-0dc8-448d-bf43-1bb6aa754acb tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287" status: 200 len: 1314 microversion: 2.1 time: 0.220896 Jul 26 07:27:53.055132 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 160/339] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:52 2022] GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:53.168054 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-0e5a243b-9a5f-4084-be8d-16186d169935 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:53.184724 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-0e5a243b-9a5f-4084-be8d-16186d169935 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c" status: 200 len: 1366 microversion: 2.1 time: 0.544254 Jul 26 07:27:53.186517 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 180/340] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:52 2022] GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c => generated 1366 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:53.383998 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-e88711c3-c1c4-4c82-9fa8-7879dcf0a339 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1319284229", "imageRef": "b9589773-813f-42af-846a-43bcf9d4d002", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ddc42cf1-1b0a-4f4c-8ce7-024cddb60ad4"}], "security_groups": [{"name": "tempest-securitygroup--530754536"}], "key_name": "tempest-keypair-1015692343", "user_data": "}} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:27:53.432760 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7777c869-8892-457d-87c8-d2530ca71d19 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:53.434381 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7777c869-8892-457d-87c8-d2530ca71d19 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:53.449919 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7777c869-8892-457d-87c8-d2530ca71d19 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:53.450884 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7777c869-8892-457d-87c8-d2530ca71d19 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:53.452198 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7777c869-8892-457d-87c8-d2530ca71d19 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:53.453014 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7777c869-8892-457d-87c8-d2530ca71d19 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:53.723116 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7777c869-8892-457d-87c8-d2530ca71d19 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:53.735191 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7777c869-8892-457d-87c8-d2530ca71d19 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:53.737499 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7777c869-8892-457d-87c8-d2530ca71d19 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:53.739070 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7777c869-8892-457d-87c8-d2530ca71d19 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1741 microversion: 2.20 time: 0.312512 Jul 26 07:27:53.756318 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 181/341] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:27:53 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1741 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 07:27:54.100497 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-77ee7417-b9d3-40de-9b41-7ed844c87d56 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:54.102098 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-77ee7417-b9d3-40de-9b41-7ed844c87d56 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: c9897f10-f186-4747-9f58-0d3f1cdf9287] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:54.110969 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-77ee7417-b9d3-40de-9b41-7ed844c87d56 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:54.112465 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-77ee7417-b9d3-40de-9b41-7ed844c87d56 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:54.114519 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-77ee7417-b9d3-40de-9b41-7ed844c87d56 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:54.115357 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-77ee7417-b9d3-40de-9b41-7ed844c87d56 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:54.425620 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-77ee7417-b9d3-40de-9b41-7ed844c87d56 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:54.438956 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-77ee7417-b9d3-40de-9b41-7ed844c87d56 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287" status: 200 len: 1314 microversion: 2.1 time: 0.347151 Jul 26 07:27:54.440194 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 182/342] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:54 2022] GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287 => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:54.449611 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b1366533-e046-4ca0-8146-5df33211032d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:54.455231 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b1366533-e046-4ca0-8146-5df33211032d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: e5a904a1-f100-432e-8c8c-f3dc187c3a0c] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:54.481985 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b1366533-e046-4ca0-8146-5df33211032d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:54.482775 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b1366533-e046-4ca0-8146-5df33211032d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:54.484377 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b1366533-e046-4ca0-8146-5df33211032d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:54.489831 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b1366533-e046-4ca0-8146-5df33211032d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:54.736227 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-b1366533-e046-4ca0-8146-5df33211032d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:54.750287 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b1366533-e046-4ca0-8146-5df33211032d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c" status: 200 len: 1366 microversion: 2.1 time: 0.307722 Jul 26 07:27:54.751331 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 183/343] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:54 2022] GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c => generated 1366 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:54.778177 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-4bbc5a29-4e5b-49cc-b60b-0d7c9a1f3cf3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:54.778789 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-4bbc5a29-4e5b-49cc-b60b-0d7c9a1f3cf3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:54.785898 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4bbc5a29-4e5b-49cc-b60b-0d7c9a1f3cf3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:54.786359 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4bbc5a29-4e5b-49cc-b60b-0d7c9a1f3cf3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:54.787177 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4bbc5a29-4e5b-49cc-b60b-0d7c9a1f3cf3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:54.787616 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4bbc5a29-4e5b-49cc-b60b-0d7c9a1f3cf3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:55.034321 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-4bbc5a29-4e5b-49cc-b60b-0d7c9a1f3cf3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:55.046358 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-4bbc5a29-4e5b-49cc-b60b-0d7c9a1f3cf3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:55.048634 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-4bbc5a29-4e5b-49cc-b60b-0d7c9a1f3cf3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:55.050142 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-4bbc5a29-4e5b-49cc-b60b-0d7c9a1f3cf3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1741 microversion: 2.20 time: 0.288097 Jul 26 07:27:55.051134 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 184/344] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:27:54 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1741 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:27:55.358590 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-f80ae360-5771-4a71-87ce-5fe264e58c3c req-59bfff02-c97b-45d1-a9d0-b2287fc1b170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9897f10-f186-4747-9f58-0d3f1cdf9287", "name": "network-vif-plugged", "status": "completed", "tag": "3f70ab89-871b-41bb-9ed0-3d3b4e06c0d8"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:27:55.369596 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-f80ae360-5771-4a71-87ce-5fe264e58c3c req-59bfff02-c97b-45d1-a9d0-b2287fc1b170 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:55.370227 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-f80ae360-5771-4a71-87ce-5fe264e58c3c req-59bfff02-c97b-45d1-a9d0-b2287fc1b170 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:55.384077 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-f80ae360-5771-4a71-87ce-5fe264e58c3c req-59bfff02-c97b-45d1-a9d0-b2287fc1b170 service nova] Creating event network-vif-plugged:3f70ab89-871b-41bb-9ed0-3d3b4e06c0d8 for instance c9897f10-f186-4747-9f58-0d3f1cdf9287 on hv-cinder-85083 Jul 26 07:27:55.391881 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-f80ae360-5771-4a71-87ce-5fe264e58c3c req-59bfff02-c97b-45d1-a9d0-b2287fc1b170 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035161 Jul 26 07:27:55.391881 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 185/345] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:27:55.481269 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d1b047e0-7f2f-4c33-b041-34fc1867c7fe tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:55.482992 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d1b047e0-7f2f-4c33-b041-34fc1867c7fe tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: c9897f10-f186-4747-9f58-0d3f1cdf9287] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:55.490762 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d1b047e0-7f2f-4c33-b041-34fc1867c7fe tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:55.491567 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d1b047e0-7f2f-4c33-b041-34fc1867c7fe tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:55.492681 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d1b047e0-7f2f-4c33-b041-34fc1867c7fe tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:55.493191 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d1b047e0-7f2f-4c33-b041-34fc1867c7fe tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:55.799640 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d1b047e0-7f2f-4c33-b041-34fc1867c7fe tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:55.812596 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d1b047e0-7f2f-4c33-b041-34fc1867c7fe tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287" status: 200 len: 1314 microversion: 2.1 time: 0.339766 Jul 26 07:27:55.822269 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 186/346] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:55 2022] GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287 => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:27:55.822269 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-052c007d-447f-4b82-a2ee-b3a42b5f383f tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:55.822269 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-052c007d-447f-4b82-a2ee-b3a42b5f383f tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: e5a904a1-f100-432e-8c8c-f3dc187c3a0c] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:55.827532 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-052c007d-447f-4b82-a2ee-b3a42b5f383f tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:55.828283 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-052c007d-447f-4b82-a2ee-b3a42b5f383f tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:55.829385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-052c007d-447f-4b82-a2ee-b3a42b5f383f tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:55.830093 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-052c007d-447f-4b82-a2ee-b3a42b5f383f tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:56.013807 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-052c007d-447f-4b82-a2ee-b3a42b5f383f tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:56.027649 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-052c007d-447f-4b82-a2ee-b3a42b5f383f tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c" status: 200 len: 1366 microversion: 2.1 time: 0.213192 Jul 26 07:27:56.028365 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 187/347] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:55 2022] GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:56.078612 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ef60a094-c2b6-4483-95c0-1fc708638a2e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:56.079311 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ef60a094-c2b6-4483-95c0-1fc708638a2e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:56.086432 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef60a094-c2b6-4483-95c0-1fc708638a2e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:56.086966 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef60a094-c2b6-4483-95c0-1fc708638a2e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:56.087921 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef60a094-c2b6-4483-95c0-1fc708638a2e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:56.088355 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef60a094-c2b6-4483-95c0-1fc708638a2e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:56.261010 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ef60a094-c2b6-4483-95c0-1fc708638a2e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:56.271712 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ef60a094-c2b6-4483-95c0-1fc708638a2e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:56.273389 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ef60a094-c2b6-4483-95c0-1fc708638a2e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:56.274774 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ef60a094-c2b6-4483-95c0-1fc708638a2e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1741 microversion: 2.20 time: 0.201725 Jul 26 07:27:56.275607 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 188/348] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:27:56 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1741 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 07:27:56.850200 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-fd649efc-b81e-42ec-8196-8c31eb29d9b5 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:56.851820 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-fd649efc-b81e-42ec-8196-8c31eb29d9b5 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: c9897f10-f186-4747-9f58-0d3f1cdf9287] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:56.863709 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fd649efc-b81e-42ec-8196-8c31eb29d9b5 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:56.864553 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fd649efc-b81e-42ec-8196-8c31eb29d9b5 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:56.865688 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fd649efc-b81e-42ec-8196-8c31eb29d9b5 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:56.866463 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fd649efc-b81e-42ec-8196-8c31eb29d9b5 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:57.117224 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-fd649efc-b81e-42ec-8196-8c31eb29d9b5 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:57.128563 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-fd649efc-b81e-42ec-8196-8c31eb29d9b5 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287" status: 200 len: 1314 microversion: 2.1 time: 0.282127 Jul 26 07:27:57.129885 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 189/349] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:56 2022] GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:57.135179 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-52f5dda4-3203-4377-817f-09e6d0f78989 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:57.135795 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-52f5dda4-3203-4377-817f-09e6d0f78989 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: e5a904a1-f100-432e-8c8c-f3dc187c3a0c] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:57.144065 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-52f5dda4-3203-4377-817f-09e6d0f78989 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:57.144606 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-52f5dda4-3203-4377-817f-09e6d0f78989 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:57.145624 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-52f5dda4-3203-4377-817f-09e6d0f78989 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:57.146121 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-52f5dda4-3203-4377-817f-09e6d0f78989 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:57.176299 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:57.365462 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-52f5dda4-3203-4377-817f-09e6d0f78989 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:57.376302 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-52f5dda4-3203-4377-817f-09e6d0f78989 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c" status: 200 len: 1366 microversion: 2.1 time: 0.245078 Jul 26 07:27:57.376925 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 190/350] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:57 2022] GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:57.382458 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-407060dd-52c2-4ccc-bc81-3c7db375d126 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:57.383077 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-407060dd-52c2-4ccc-bc81-3c7db375d126 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:57.390284 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-407060dd-52c2-4ccc-bc81-3c7db375d126 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:57.390735 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-407060dd-52c2-4ccc-bc81-3c7db375d126 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:57.391533 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-407060dd-52c2-4ccc-bc81-3c7db375d126 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:57.391968 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-407060dd-52c2-4ccc-bc81-3c7db375d126 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:57.578372 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-407060dd-52c2-4ccc-bc81-3c7db375d126 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:57.601796 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-407060dd-52c2-4ccc-bc81-3c7db375d126 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:57.604348 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-407060dd-52c2-4ccc-bc81-3c7db375d126 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:57.607901 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-407060dd-52c2-4ccc-bc81-3c7db375d126 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1741 microversion: 2.20 time: 0.229043 Jul 26 07:27:57.609067 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 191/351] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:27:57 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1741 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:27:57.617556 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-a70cac4c-137d-489a-b2bd-637eb4cd9725 req-3d68316b-af14-402f-a53e-f5a924f5deba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5a904a1-f100-432e-8c8c-f3dc187c3a0c", "name": "network-vif-plugged", "status": "completed", "tag": "05fcdb60-6df8-4eba-b269-358abb08dcc2"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:27:57.642297 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-a70cac4c-137d-489a-b2bd-637eb4cd9725 req-3d68316b-af14-402f-a53e-f5a924f5deba service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:57.643092 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-a70cac4c-137d-489a-b2bd-637eb4cd9725 req-3d68316b-af14-402f-a53e-f5a924f5deba service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:57.664709 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-a70cac4c-137d-489a-b2bd-637eb4cd9725 req-3d68316b-af14-402f-a53e-f5a924f5deba service nova] Creating event network-vif-plugged:05fcdb60-6df8-4eba-b269-358abb08dcc2 for instance e5a904a1-f100-432e-8c8c-f3dc187c3a0c on hv-cinder-85083 Jul 26 07:27:57.677033 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-a70cac4c-137d-489a-b2bd-637eb4cd9725 req-3d68316b-af14-402f-a53e-f5a924f5deba service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064669 Jul 26 07:27:57.678025 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 192/352] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:27:58.173255 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-4fdfa00b-63f7-4abc-8c35-ef73681bfc4c tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:58.174343 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-4fdfa00b-63f7-4abc-8c35-ef73681bfc4c tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: c9897f10-f186-4747-9f58-0d3f1cdf9287] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:58.186034 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4fdfa00b-63f7-4abc-8c35-ef73681bfc4c tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:58.186818 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4fdfa00b-63f7-4abc-8c35-ef73681bfc4c tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:58.188525 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4fdfa00b-63f7-4abc-8c35-ef73681bfc4c tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:58.189207 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4fdfa00b-63f7-4abc-8c35-ef73681bfc4c tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:58.460717 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-4fdfa00b-63f7-4abc-8c35-ef73681bfc4c tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:58.475710 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-4fdfa00b-63f7-4abc-8c35-ef73681bfc4c tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287" status: 200 len: 1497 microversion: 2.1 time: 0.310777 Jul 26 07:27:58.489778 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 193/353] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:58 2022] GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287 => generated 1497 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:58.489778 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-542557b1-c537-4a91-a0c0-c896a5c33854 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:58.489778 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-542557b1-c537-4a91-a0c0-c896a5c33854 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: e5a904a1-f100-432e-8c8c-f3dc187c3a0c] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:58.503205 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-542557b1-c537-4a91-a0c0-c896a5c33854 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:58.504188 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-542557b1-c537-4a91-a0c0-c896a5c33854 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:58.511664 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-542557b1-c537-4a91-a0c0-c896a5c33854 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:58.520297 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-542557b1-c537-4a91-a0c0-c896a5c33854 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:58.859953 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-542557b1-c537-4a91-a0c0-c896a5c33854 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:58.881733 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-542557b1-c537-4a91-a0c0-c896a5c33854 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c" status: 200 len: 1366 microversion: 2.1 time: 0.400339 Jul 26 07:27:58.903965 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 194/354] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:58 2022] GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c => generated 1366 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:27:58.922031 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-708f6608-9e29-4bb4-aba8-e4276b69b785 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:58.923258 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-708f6608-9e29-4bb4-aba8-e4276b69b785 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:58.934666 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-708f6608-9e29-4bb4-aba8-e4276b69b785 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:58.935365 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-708f6608-9e29-4bb4-aba8-e4276b69b785 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:58.937899 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-708f6608-9e29-4bb4-aba8-e4276b69b785 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:58.938637 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-708f6608-9e29-4bb4-aba8-e4276b69b785 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:59.148503 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-708f6608-9e29-4bb4-aba8-e4276b69b785 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:59.162315 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-708f6608-9e29-4bb4-aba8-e4276b69b785 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:59.163777 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-708f6608-9e29-4bb4-aba8-e4276b69b785 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:59.165041 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-708f6608-9e29-4bb4-aba8-e4276b69b785 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1741 microversion: 2.20 time: 0.259555 Jul 26 07:27:59.178559 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 195/355] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:27:58 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1741 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:27:59.524549 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-45a57641-ef75-4b27-989b-efa8369445b0 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:59.525039 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-45a57641-ef75-4b27-989b-efa8369445b0 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: c9897f10-f186-4747-9f58-0d3f1cdf9287] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:59.532894 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-45a57641-ef75-4b27-989b-efa8369445b0 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:59.533342 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-45a57641-ef75-4b27-989b-efa8369445b0 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:59.534203 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-45a57641-ef75-4b27-989b-efa8369445b0 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:59.534835 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-45a57641-ef75-4b27-989b-efa8369445b0 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:59.569967 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-45a57641-ef75-4b27-989b-efa8369445b0 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: c9897f10-f186-4747-9f58-0d3f1cdf9287] Going to try to terminate instance {{(pid=117715) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 07:27:59.706219 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-45a57641-ef75-4b27-989b-efa8369445b0 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287" status: 204 len: 0 microversion: 2.1 time: 0.184922 Jul 26 07:27:59.706943 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 196/356] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Jul 26 07:27:59 2022] DELETE /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 07:27:59.722257 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c0f3dcaa-36cc-4ce3-8116-d329fd7a401b tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:27:59.723081 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c0f3dcaa-36cc-4ce3-8116-d329fd7a401b tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: c9897f10-f186-4747-9f58-0d3f1cdf9287] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:27:59.735376 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c0f3dcaa-36cc-4ce3-8116-d329fd7a401b tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:59.736381 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c0f3dcaa-36cc-4ce3-8116-d329fd7a401b tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:59.737510 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c0f3dcaa-36cc-4ce3-8116-d329fd7a401b tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:27:59.738372 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c0f3dcaa-36cc-4ce3-8116-d329fd7a401b tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:27:59.767111 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell0:SELECT=6 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:59.980397 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c0f3dcaa-36cc-4ce3-8116-d329fd7a401b tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:27:59.995471 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c0f3dcaa-36cc-4ce3-8116-d329fd7a401b tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287" status: 200 len: 1503 microversion: 2.1 time: 0.281937 Jul 26 07:28:00.010317 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 197/357] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:27:59 2022] GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287 => generated 1503 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:28:00.018908 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.network.neutron [None req-e88711c3-c1c4-4c82-9fa8-7879dcf0a339 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] validate_networks() for [('ddc42cf1-1b0a-4f4c-8ce7-024cddb60ad4', None, None, None, None, None)] {{(pid=117716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 07:28:00.035421 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b4281648-3db1-4133-bf86-c99e9f5a307e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:00.036457 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b4281648-3db1-4133-bf86-c99e9f5a307e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: e5a904a1-f100-432e-8c8c-f3dc187c3a0c] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:00.041508 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:00.049112 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b4281648-3db1-4133-bf86-c99e9f5a307e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:00.049884 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b4281648-3db1-4133-bf86-c99e9f5a307e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:00.051313 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b4281648-3db1-4133-bf86-c99e9f5a307e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:00.052069 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b4281648-3db1-4133-bf86-c99e9f5a307e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:00.284991 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-b4281648-3db1-4133-bf86-c99e9f5a307e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:00.302147 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b4281648-3db1-4133-bf86-c99e9f5a307e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c" status: 200 len: 1366 microversion: 2.1 time: 0.289207 Jul 26 07:28:00.303394 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 198/358] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:28:00 2022] GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c => generated 1366 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:28:00.311539 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-aee0dd97-3926-4a83-b5f3-62e9b91d214e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:00.313129 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-aee0dd97-3926-4a83-b5f3-62e9b91d214e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:00.324312 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-aee0dd97-3926-4a83-b5f3-62e9b91d214e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:00.325449 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-aee0dd97-3926-4a83-b5f3-62e9b91d214e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:00.327395 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-aee0dd97-3926-4a83-b5f3-62e9b91d214e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:00.328736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-aee0dd97-3926-4a83-b5f3-62e9b91d214e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:00.559760 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-aee0dd97-3926-4a83-b5f3-62e9b91d214e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:00.572817 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-aee0dd97-3926-4a83-b5f3-62e9b91d214e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:00.575229 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-aee0dd97-3926-4a83-b5f3-62e9b91d214e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:00.577130 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-aee0dd97-3926-4a83-b5f3-62e9b91d214e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1741 microversion: 2.20 time: 0.272061 Jul 26 07:28:00.578112 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 199/359] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:00 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1741 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:28:00.626807 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-e88711c3-c1c4-4c82-9fa8-7879dcf0a339 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Flavor limits 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 07:28:00.627519 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-e88711c3-c1c4-4c82-9fa8-7879dcf0a339 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Image limits 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 07:28:00.628349 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-e88711c3-c1c4-4c82-9fa8-7879dcf0a339 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Flavor pref 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 07:28:00.629145 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-e88711c3-c1c4-4c82-9fa8-7879dcf0a339 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Image pref 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 07:28:00.629926 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-e88711c3-c1c4-4c82-9fa8-7879dcf0a339 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 07:28:00.645982 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e88711c3-c1c4-4c82-9fa8-7879dcf0a339 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:00.646501 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e88711c3-c1c4-4c82-9fa8-7879dcf0a339 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:00.647365 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e88711c3-c1c4-4c82-9fa8-7879dcf0a339 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:00.647844 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e88711c3-c1c4-4c82-9fa8-7879dcf0a339 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:00.667462 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.quota [None req-e88711c3-c1c4-4c82-9fa8-7879dcf0a339 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Getting quotas for project 02e545f0c2784698a35cd8dcb1b02395. Resources: {'instances', 'cores', 'ram'} {{(pid=117716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 07:28:00.672564 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.quota [None req-e88711c3-c1c4-4c82-9fa8-7879dcf0a339 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Getting quotas for user 886151888fc84ccf890d609ba62da9e1 and project 02e545f0c2784698a35cd8dcb1b02395. Resources: {'instances', 'cores', 'ram'} {{(pid=117716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 07:28:00.685680 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-e88711c3-c1c4-4c82-9fa8-7879dcf0a339 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Going to run 1 instances... {{(pid=117716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 07:28:00.688039 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-e88711c3-c1c4-4c82-9fa8-7879dcf0a339 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9589773-813f-42af-846a-43bcf9d4d002',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 07:28:00.698745 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:00.745421 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-e88711c3-c1c4-4c82-9fa8-7879dcf0a339 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 7.366303 Jul 26 07:28:00.746588 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 161/360] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Jul 26 07:27:53 2022] POST /compute/v2.1/servers => generated 408 bytes in 7368 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 07:28:00.758009 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-622239bf-017b-4dd3-9724-8494c06f56ee tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:00.758631 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-622239bf-017b-4dd3-9724-8494c06f56ee tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:00.835760 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-622239bf-017b-4dd3-9724-8494c06f56ee tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:00.848337 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-622239bf-017b-4dd3-9724-8494c06f56ee tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1246 microversion: 2.1 time: 0.094186 Jul 26 07:28:00.849901 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 200/361] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:28:00 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1246 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:28:01.040386 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-60658631-e23d-43a0-ba1b-b15bef50fe59 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:01.041568 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-60658631-e23d-43a0-ba1b-b15bef50fe59 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: c9897f10-f186-4747-9f58-0d3f1cdf9287] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:01.050253 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-60658631-e23d-43a0-ba1b-b15bef50fe59 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:01.050702 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-60658631-e23d-43a0-ba1b-b15bef50fe59 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:01.051486 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-60658631-e23d-43a0-ba1b-b15bef50fe59 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:01.051917 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-60658631-e23d-43a0-ba1b-b15bef50fe59 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:01.257106 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-60658631-e23d-43a0-ba1b-b15bef50fe59 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:01.267565 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-60658631-e23d-43a0-ba1b-b15bef50fe59 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287" status: 200 len: 1503 microversion: 2.1 time: 0.233566 Jul 26 07:28:01.268526 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 162/362] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:28:01 2022] GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287 => generated 1503 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:28:01.338458 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-eefff4a5-0ac9-4b9f-92be-34bfba9e1453 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:01.339159 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-eefff4a5-0ac9-4b9f-92be-34bfba9e1453 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: e5a904a1-f100-432e-8c8c-f3dc187c3a0c] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:01.346713 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-eefff4a5-0ac9-4b9f-92be-34bfba9e1453 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:01.347157 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-eefff4a5-0ac9-4b9f-92be-34bfba9e1453 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:01.347952 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-eefff4a5-0ac9-4b9f-92be-34bfba9e1453 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:01.348384 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-eefff4a5-0ac9-4b9f-92be-34bfba9e1453 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:01.505049 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-eefff4a5-0ac9-4b9f-92be-34bfba9e1453 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:01.514565 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-eefff4a5-0ac9-4b9f-92be-34bfba9e1453 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c" status: 200 len: 1556 microversion: 2.1 time: 0.179988 Jul 26 07:28:01.515052 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 201/363] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:28:01 2022] GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c => generated 1556 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:28:01.536368 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8f74e4e9-2619-407b-846f-0b4ca5a9862c tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:01.536872 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8f74e4e9-2619-407b-846f-0b4ca5a9862c tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: e5a904a1-f100-432e-8c8c-f3dc187c3a0c] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:01.544205 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8f74e4e9-2619-407b-846f-0b4ca5a9862c tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:01.544657 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8f74e4e9-2619-407b-846f-0b4ca5a9862c tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:01.545555 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8f74e4e9-2619-407b-846f-0b4ca5a9862c tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:01.546026 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8f74e4e9-2619-407b-846f-0b4ca5a9862c tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:01.548904 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:01.605460 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-abdd0470-2858-46dc-95ef-d650a1bdcfe7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:01.606366 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-abdd0470-2858-46dc-95ef-d650a1bdcfe7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:01.614855 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-abdd0470-2858-46dc-95ef-d650a1bdcfe7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:01.615298 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-abdd0470-2858-46dc-95ef-d650a1bdcfe7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:01.616141 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-abdd0470-2858-46dc-95ef-d650a1bdcfe7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:01.616571 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-abdd0470-2858-46dc-95ef-d650a1bdcfe7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:01.641782 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8f74e4e9-2619-407b-846f-0b4ca5a9862c tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109423 Jul 26 07:28:01.642439 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 163/364] 10.222.0.39 () {58 vars in 1275 bytes} [Tue Jul 26 07:28:01 2022] GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:28:01.805233 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-abdd0470-2858-46dc-95ef-d650a1bdcfe7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:01.816213 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-abdd0470-2858-46dc-95ef-d650a1bdcfe7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:01.818527 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-abdd0470-2858-46dc-95ef-d650a1bdcfe7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:01.820824 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-abdd0470-2858-46dc-95ef-d650a1bdcfe7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1741 microversion: 2.20 time: 0.219435 Jul 26 07:28:01.822025 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 202/365] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:01 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1741 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:28:01.883527 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-18f1c37a-a65e-48a4-90d2-86c9b5e3353c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:01.884651 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-18f1c37a-a65e-48a4-90d2-86c9b5e3353c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:01.896163 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-18f1c37a-a65e-48a4-90d2-86c9b5e3353c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:01.896975 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-18f1c37a-a65e-48a4-90d2-86c9b5e3353c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:01.898509 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-18f1c37a-a65e-48a4-90d2-86c9b5e3353c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:01.899317 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-18f1c37a-a65e-48a4-90d2-86c9b5e3353c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:02.017378 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-18f1c37a-a65e-48a4-90d2-86c9b5e3353c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:02.028018 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-18f1c37a-a65e-48a4-90d2-86c9b5e3353c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1250 microversion: 2.1 time: 0.152869 Jul 26 07:28:02.029047 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 164/366] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:28:01 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1250 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:28:02.295687 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a3afed63-19f0-46c8-99c9-08db63378e1b tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:02.296719 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a3afed63-19f0-46c8-99c9-08db63378e1b tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: c9897f10-f186-4747-9f58-0d3f1cdf9287] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:02.308039 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a3afed63-19f0-46c8-99c9-08db63378e1b tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:02.308974 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a3afed63-19f0-46c8-99c9-08db63378e1b tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:02.310393 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a3afed63-19f0-46c8-99c9-08db63378e1b tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:02.311191 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a3afed63-19f0-46c8-99c9-08db63378e1b tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:02.549975 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-a3afed63-19f0-46c8-99c9-08db63378e1b tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:02.562414 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a3afed63-19f0-46c8-99c9-08db63378e1b tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287" status: 200 len: 1503 microversion: 2.1 time: 0.274289 Jul 26 07:28:02.563254 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 203/367] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:28:02 2022] GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287 => generated 1503 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:28:02.858325 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-61f582ab-b9ef-431d-9e24-5c4952b1fbf2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:02.859371 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-61f582ab-b9ef-431d-9e24-5c4952b1fbf2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:02.867568 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-61f582ab-b9ef-431d-9e24-5c4952b1fbf2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:02.868278 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-61f582ab-b9ef-431d-9e24-5c4952b1fbf2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:02.869418 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-61f582ab-b9ef-431d-9e24-5c4952b1fbf2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:02.869987 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-61f582ab-b9ef-431d-9e24-5c4952b1fbf2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:03.064786 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-76a76b32-858c-4e59-b794-c8e444e8a42a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:03.065967 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-76a76b32-858c-4e59-b794-c8e444e8a42a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:03.078500 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-76a76b32-858c-4e59-b794-c8e444e8a42a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:03.079561 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-76a76b32-858c-4e59-b794-c8e444e8a42a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:03.087651 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-76a76b32-858c-4e59-b794-c8e444e8a42a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:03.088610 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-76a76b32-858c-4e59-b794-c8e444e8a42a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:03.530480 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-61f582ab-b9ef-431d-9e24-5c4952b1fbf2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:03.548517 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-61f582ab-b9ef-431d-9e24-5c4952b1fbf2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:03.551693 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-61f582ab-b9ef-431d-9e24-5c4952b1fbf2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:03.552840 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-76a76b32-858c-4e59-b794-c8e444e8a42a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:03.554480 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-61f582ab-b9ef-431d-9e24-5c4952b1fbf2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1723 microversion: 2.20 time: 0.700589 Jul 26 07:28:03.555728 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 165/368] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:02 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1723 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:28:03.568578 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-76a76b32-858c-4e59-b794-c8e444e8a42a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1306 microversion: 2.1 time: 0.511854 Jul 26 07:28:03.582782 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 204/369] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:28:03 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1306 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:28:03.596588 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-84c88633-0295-4366-920a-ec6c165fba5a tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:03.598176 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-84c88633-0295-4366-920a-ec6c165fba5a tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: c9897f10-f186-4747-9f58-0d3f1cdf9287] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:03.610060 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-84c88633-0295-4366-920a-ec6c165fba5a tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:03.611049 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-84c88633-0295-4366-920a-ec6c165fba5a tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:03.612926 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-84c88633-0295-4366-920a-ec6c165fba5a tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:03.613935 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-84c88633-0295-4366-920a-ec6c165fba5a tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:04.104048 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-84c88633-0295-4366-920a-ec6c165fba5a tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:04.118867 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-84c88633-0295-4366-920a-ec6c165fba5a tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287" status: 200 len: 1503 microversion: 2.1 time: 0.531628 Jul 26 07:28:04.120448 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 166/370] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:28:03 2022] GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287 => generated 1503 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:28:04.462835 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-d696b79a-1caa-42da-ac8b-d36625d77bf1 req-d7bc8959-0caa-442c-834a-b05227b5e261 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5a904a1-f100-432e-8c8c-f3dc187c3a0c", "tag": "05fcdb60-6df8-4eba-b269-358abb08dcc2"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:28:04.485976 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-d696b79a-1caa-42da-ac8b-d36625d77bf1 req-d7bc8959-0caa-442c-834a-b05227b5e261 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:04.487561 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-d696b79a-1caa-42da-ac8b-d36625d77bf1 req-d7bc8959-0caa-442c-834a-b05227b5e261 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:04.528758 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-d696b79a-1caa-42da-ac8b-d36625d77bf1 req-d7bc8959-0caa-442c-834a-b05227b5e261 service nova] Creating event network-changed:05fcdb60-6df8-4eba-b269-358abb08dcc2 for instance e5a904a1-f100-432e-8c8c-f3dc187c3a0c on hv-cinder-85083 Jul 26 07:28:04.540360 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-d696b79a-1caa-42da-ac8b-d36625d77bf1 req-d7bc8959-0caa-442c-834a-b05227b5e261 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105437 Jul 26 07:28:04.546870 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 205/371] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:28:04.604570 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-e1baaeb2-690a-4361-a536-ea3c8e0c8769 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:04.605629 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-e1baaeb2-690a-4361-a536-ea3c8e0c8769 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:04.610507 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6674118a-5709-49d5-b335-8fac0e382e53 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:04.614850 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-6674118a-5709-49d5-b335-8fac0e382e53 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:04.627791 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e1baaeb2-690a-4361-a536-ea3c8e0c8769 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:04.639370 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e1baaeb2-690a-4361-a536-ea3c8e0c8769 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:04.640378 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6674118a-5709-49d5-b335-8fac0e382e53 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:04.640849 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e1baaeb2-690a-4361-a536-ea3c8e0c8769 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:04.641147 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6674118a-5709-49d5-b335-8fac0e382e53 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:04.641634 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e1baaeb2-690a-4361-a536-ea3c8e0c8769 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:04.650229 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6674118a-5709-49d5-b335-8fac0e382e53 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:04.650794 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6674118a-5709-49d5-b335-8fac0e382e53 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:05.124192 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-6674118a-5709-49d5-b335-8fac0e382e53 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:05.137162 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6674118a-5709-49d5-b335-8fac0e382e53 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1371 microversion: 2.1 time: 0.535297 Jul 26 07:28:05.138665 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 206/372] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:28:04 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1371 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:28:05.148241 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9d9d7601-6c61-4830-b02d-d29d1923b36a tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:05.149170 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-9d9d7601-6c61-4830-b02d-d29d1923b36a tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: c9897f10-f186-4747-9f58-0d3f1cdf9287] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:05.159092 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9d9d7601-6c61-4830-b02d-d29d1923b36a tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:05.159734 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9d9d7601-6c61-4830-b02d-d29d1923b36a tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:05.160738 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9d9d7601-6c61-4830-b02d-d29d1923b36a tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:05.161366 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9d9d7601-6c61-4830-b02d-d29d1923b36a tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:05.298742 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-e1baaeb2-690a-4361-a536-ea3c8e0c8769 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:05.310074 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-9d9d7601-6c61-4830-b02d-d29d1923b36a tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:05.313547 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-e1baaeb2-690a-4361-a536-ea3c8e0c8769 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:05.317384 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:05.317895 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-e1baaeb2-690a-4361-a536-ea3c8e0c8769 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:05.321273 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-e1baaeb2-690a-4361-a536-ea3c8e0c8769 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1723 microversion: 2.20 time: 0.725088 Jul 26 07:28:05.329295 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-9d9d7601-6c61-4830-b02d-d29d1923b36a tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287" status: 200 len: 1461 microversion: 2.1 time: 0.188653 Jul 26 07:28:05.330523 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 207/373] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:28:05 2022] GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287 => generated 1461 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:28:05.332419 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 167/374] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:04 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1723 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:28:05.479674 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-831d0285-afb6-45e4-b4a2-a6279fc15eed req-ce2bbd95-7a05-4ea1-8ceb-669846f7328b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "990571a8-aa04-4aac-921c-cf071eca1dd0", "name": "network-vif-unplugged", "status": "completed", "tag": "06f98651-1a4f-4f3c-a886-1d5aad025305"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:28:05.505710 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-831d0285-afb6-45e4-b4a2-a6279fc15eed req-ce2bbd95-7a05-4ea1-8ceb-669846f7328b service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:05.506631 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-831d0285-afb6-45e4-b4a2-a6279fc15eed req-ce2bbd95-7a05-4ea1-8ceb-669846f7328b service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:05.516346 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-e6f0b208-6634-4590-b02f-1fd7c7d12548 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b0afb0f-cb60-485e-b3c4-0dc894d1fd7b", "device": "/dev/sdb"}} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:28:05.522498 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-e6f0b208-6634-4590-b02f-1fd7c7d12548 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 4a6929a0-8c3d-4474-8ffa-b2777251fa48] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:05.539915 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e6f0b208-6634-4590-b02f-1fd7c7d12548 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:05.540555 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e6f0b208-6634-4590-b02f-1fd7c7d12548 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:05.541477 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e6f0b208-6634-4590-b02f-1fd7c7d12548 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:05.542548 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e6f0b208-6634-4590-b02f-1fd7c7d12548 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:05.556053 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-831d0285-afb6-45e4-b4a2-a6279fc15eed req-ce2bbd95-7a05-4ea1-8ceb-669846f7328b service nova] Creating event network-vif-unplugged:06f98651-1a4f-4f3c-a886-1d5aad025305 for instance 990571a8-aa04-4aac-921c-cf071eca1dd0 on hv-cinder-85083 Jul 26 07:28:05.573359 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-831d0285-afb6-45e4-b4a2-a6279fc15eed req-ce2bbd95-7a05-4ea1-8ceb-669846f7328b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097526 Jul 26 07:28:05.575036 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 208/375] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 07:28:06.133409 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-32cba6e1-1090-46b4-a9b8-b76de6ef6a0d req-8b4ba6f3-a894-4dbf-adc5-d4caa33d093f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8172b67c-005b-4f1f-91f0-f6ce67a50ab1", "tag": "643ec2f5-7bcc-4a3c-9ca2-bb545c332e35"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:28:06.152622 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-32cba6e1-1090-46b4-a9b8-b76de6ef6a0d req-8b4ba6f3-a894-4dbf-adc5-d4caa33d093f service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:06.154078 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-32cba6e1-1090-46b4-a9b8-b76de6ef6a0d req-8b4ba6f3-a894-4dbf-adc5-d4caa33d093f service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:06.186494 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-32cba6e1-1090-46b4-a9b8-b76de6ef6a0d req-8b4ba6f3-a894-4dbf-adc5-d4caa33d093f service nova] Creating event network-changed:643ec2f5-7bcc-4a3c-9ca2-bb545c332e35 for instance 8172b67c-005b-4f1f-91f0-f6ce67a50ab1 on hv-cinder-85083 Jul 26 07:28:06.192944 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-32cba6e1-1090-46b4-a9b8-b76de6ef6a0d req-8b4ba6f3-a894-4dbf-adc5-d4caa33d093f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066646 Jul 26 07:28:06.194823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 209/376] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 07:28:06.205361 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-2a471952-46b4-4fba-b5d0-efe508a63748 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:06.206874 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2a471952-46b4-4fba-b5d0-efe508a63748 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:06.218798 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2a471952-46b4-4fba-b5d0-efe508a63748 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:06.219376 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2a471952-46b4-4fba-b5d0-efe508a63748 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:06.220750 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2a471952-46b4-4fba-b5d0-efe508a63748 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:06.221317 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2a471952-46b4-4fba-b5d0-efe508a63748 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:06.447449 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2a471952-46b4-4fba-b5d0-efe508a63748 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:06.459444 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-2a471952-46b4-4fba-b5d0-efe508a63748 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1371 microversion: 2.1 time: 0.262495 Jul 26 07:28:06.460280 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 210/377] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:28:06 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1371 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:28:06.475075 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-df4a9555-b14e-4550-926f-0e2cab44198f tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:06.476512 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-df4a9555-b14e-4550-926f-0e2cab44198f tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: c9897f10-f186-4747-9f58-0d3f1cdf9287] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:06.488093 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-df4a9555-b14e-4550-926f-0e2cab44198f tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:06.488997 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-df4a9555-b14e-4550-926f-0e2cab44198f tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:06.491642 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-df4a9555-b14e-4550-926f-0e2cab44198f tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:06.491642 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-df4a9555-b14e-4550-926f-0e2cab44198f tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:06.601895 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-df4a9555-b14e-4550-926f-0e2cab44198f tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:06.614364 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-df4a9555-b14e-4550-926f-0e2cab44198f tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287" status: 200 len: 1461 microversion: 2.1 time: 0.147978 Jul 26 07:28:06.615267 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 211/378] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:28:06 2022] GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287 => generated 1461 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:28:06.624735 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-05c6544d-d4bc-4058-97ad-08f8faa34eee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:06.625876 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-05c6544d-d4bc-4058-97ad-08f8faa34eee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:06.637802 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-05c6544d-d4bc-4058-97ad-08f8faa34eee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:06.638666 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-05c6544d-d4bc-4058-97ad-08f8faa34eee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:06.640182 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-05c6544d-d4bc-4058-97ad-08f8faa34eee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:06.640993 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-05c6544d-d4bc-4058-97ad-08f8faa34eee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:07.106137 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-e6f0b208-6634-4590-b02f-1fd7c7d12548 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "POST /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.596143 Jul 26 07:28:07.110947 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 168/379] 10.222.0.39 () {60 vars in 1323 bytes} [Tue Jul 26 07:28:05 2022] POST /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48/os-volume_attachments => generated 194 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:28:07.126310 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-c3cd672c-bc0d-42f2-bc23-80f517cd2de9 req-baddd092-5777-4e21-bfcf-f7fff63cbbc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9897f10-f186-4747-9f58-0d3f1cdf9287", "name": "network-vif-deleted", "tag": "3f70ab89-871b-41bb-9ed0-3d3b4e06c0d8"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:28:07.150667 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-c3cd672c-bc0d-42f2-bc23-80f517cd2de9 req-baddd092-5777-4e21-bfcf-f7fff63cbbc4 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:07.151402 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-c3cd672c-bc0d-42f2-bc23-80f517cd2de9 req-baddd092-5777-4e21-bfcf-f7fff63cbbc4 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:07.170656 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-05c6544d-d4bc-4058-97ad-08f8faa34eee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:07.173208 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-c3cd672c-bc0d-42f2-bc23-80f517cd2de9 req-baddd092-5777-4e21-bfcf-f7fff63cbbc4 service nova] Creating event network-vif-deleted:3f70ab89-871b-41bb-9ed0-3d3b4e06c0d8 for instance c9897f10-f186-4747-9f58-0d3f1cdf9287 on hv-cinder-85083 Jul 26 07:28:07.183103 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-c3cd672c-bc0d-42f2-bc23-80f517cd2de9 req-baddd092-5777-4e21-bfcf-f7fff63cbbc4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067887 Jul 26 07:28:07.185933 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-05c6544d-d4bc-4058-97ad-08f8faa34eee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:07.189229 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-05c6544d-d4bc-4058-97ad-08f8faa34eee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:07.189464 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 169/380] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:28:07.191072 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-05c6544d-d4bc-4058-97ad-08f8faa34eee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1723 microversion: 2.20 time: 0.574248 Jul 26 07:28:07.191801 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 212/381] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:06 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1723 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:28:07.492916 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f7b10fc4-ca80-47a3-8a13-2ee0b2aadc61 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:07.494800 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-f7b10fc4-ca80-47a3-8a13-2ee0b2aadc61 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:07.510103 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f7b10fc4-ca80-47a3-8a13-2ee0b2aadc61 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:07.510701 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f7b10fc4-ca80-47a3-8a13-2ee0b2aadc61 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:07.511671 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f7b10fc4-ca80-47a3-8a13-2ee0b2aadc61 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:07.512205 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f7b10fc4-ca80-47a3-8a13-2ee0b2aadc61 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:07.653775 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-894a1f68-86e0-4fa2-b09a-98ab7f0c2781 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:07.657295 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-894a1f68-86e0-4fa2-b09a-98ab7f0c2781 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: c9897f10-f186-4747-9f58-0d3f1cdf9287] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:07.683408 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-894a1f68-86e0-4fa2-b09a-98ab7f0c2781 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:07.684194 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-894a1f68-86e0-4fa2-b09a-98ab7f0c2781 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:07.686154 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-894a1f68-86e0-4fa2-b09a-98ab7f0c2781 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:07.686920 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-894a1f68-86e0-4fa2-b09a-98ab7f0c2781 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:07.787171 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-894a1f68-86e0-4fa2-b09a-98ab7f0c2781 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:07.791006 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-894a1f68-86e0-4fa2-b09a-98ab7f0c2781 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:07.791813 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.objects.instance [None req-894a1f68-86e0-4fa2-b09a-98ab7f0c2781 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lazy-loading 'fault' on Instance uuid c9897f10-f186-4747-9f58-0d3f1cdf9287 {{(pid=117715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 07:28:07.886547 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-f7b10fc4-ca80-47a3-8a13-2ee0b2aadc61 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:07.906094 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f7b10fc4-ca80-47a3-8a13-2ee0b2aadc61 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1371 microversion: 2.1 time: 0.423066 Jul 26 07:28:07.906805 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 170/382] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:28:07 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1371 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:28:07.931008 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-894a1f68-86e0-4fa2-b09a-98ab7f0c2781 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4c3b33511646b59d89dc933827dcb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cbf9b8d2e646eb945deb24d55fa0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:07.939694 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-894a1f68-86e0-4fa2-b09a-98ab7f0c2781 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287" status: 200 len: 1304 microversion: 2.1 time: 0.293024 Jul 26 07:28:07.940308 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 213/383] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:28:07 2022] GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287 => generated 1304 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:28:08.223560 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b9be048e-a78d-4002-99d4-900ec2bc6fc3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:08.224625 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-b9be048e-a78d-4002-99d4-900ec2bc6fc3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:08.235329 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b9be048e-a78d-4002-99d4-900ec2bc6fc3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:08.235880 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b9be048e-a78d-4002-99d4-900ec2bc6fc3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:08.238797 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b9be048e-a78d-4002-99d4-900ec2bc6fc3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:08.239833 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b9be048e-a78d-4002-99d4-900ec2bc6fc3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:08.437212 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-b9be048e-a78d-4002-99d4-900ec2bc6fc3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:08.450378 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-b9be048e-a78d-4002-99d4-900ec2bc6fc3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:08.452494 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-b9be048e-a78d-4002-99d4-900ec2bc6fc3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:08.454549 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b9be048e-a78d-4002-99d4-900ec2bc6fc3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1666 microversion: 2.20 time: 0.238644 Jul 26 07:28:08.455467 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 171/384] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:08 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1666 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:28:08.480468 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-74d497fa-c61d-408a-a62d-c7b6807919b7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa6e6b55-17eb-4f19-b707-afbc384fcd1b"}} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:28:08.483142 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-74d497fa-c61d-408a-a62d-c7b6807919b7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:08.489918 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-74d497fa-c61d-408a-a62d-c7b6807919b7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:08.490370 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-74d497fa-c61d-408a-a62d-c7b6807919b7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:08.491165 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-74d497fa-c61d-408a-a62d-c7b6807919b7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:08.491615 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-74d497fa-c61d-408a-a62d-c7b6807919b7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:08.846635 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-74d497fa-c61d-408a-a62d-c7b6807919b7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "POST /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.370798 Jul 26 07:28:08.847375 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 214/385] 10.222.0.39 () {62 vars in 1364 bytes} [Tue Jul 26 07:28:08 2022] POST /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 188 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:28:08.944048 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-5caed098-8e0f-424a-a2fa-7ed09d94a53e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:08.945283 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-5caed098-8e0f-424a-a2fa-7ed09d94a53e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:08.956494 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5caed098-8e0f-424a-a2fa-7ed09d94a53e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:08.957274 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5caed098-8e0f-424a-a2fa-7ed09d94a53e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:08.958688 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5caed098-8e0f-424a-a2fa-7ed09d94a53e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:08.959458 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5caed098-8e0f-424a-a2fa-7ed09d94a53e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:08.978003 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-444d4128-6d05-4bd0-8a41-f4cbf4a44542 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:08.978842 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-444d4128-6d05-4bd0-8a41-f4cbf4a44542 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] [instance: c9897f10-f186-4747-9f58-0d3f1cdf9287] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:08.987691 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-444d4128-6d05-4bd0-8a41-f4cbf4a44542 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:08.988280 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-444d4128-6d05-4bd0-8a41-f4cbf4a44542 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:08.989198 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-444d4128-6d05-4bd0-8a41-f4cbf4a44542 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:08.989724 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-444d4128-6d05-4bd0-8a41-f4cbf4a44542 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:09.005336 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.wsgi [None req-444d4128-6d05-4bd0-8a41-f4cbf4a44542 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] HTTP exception thrown: Instance c9897f10-f186-4747-9f58-0d3f1cdf9287 could not be found. Jul 26 07:28:09.007185 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-444d4128-6d05-4bd0-8a41-f4cbf4a44542 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Request method failure captured: Jul 26 07:28:09.007185 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: request: GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287 HTTP/1.1 Jul 26 07:28:09.007185 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept: application/json Jul 26 07:28:09.007185 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept-Encoding: identity Jul 26 07:28:09.007185 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Connection: close Jul 26 07:28:09.007185 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Length: 0 Jul 26 07:28:09.007185 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Type: application/json Jul 26 07:28:09.007185 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Host: 10.222.0.39 Jul 26 07:28:09.007185 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Openstack-System-Scope: None Jul 26 07:28:09.007185 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: User-Agent: python-urllib3/1.26.10 Jul 26 07:28:09.007185 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Auth-Token: gAAAAABi35dKBK5D_2gRqLbqPA7UorEI7Yxabmswmrcu0MNAtmKCBGL0VrNnRu-pIyLDWHlLRHaZeutsjSArYkCp9iauW7Y5twfQJj2W-I0Nb_PhmJ1swdQFDPeH_j0_k77aMrK-VKw5goBO6epeuXanUqRk2189wOnntfUDtPv272MuxUsENiI Jul 26 07:28:09.007185 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Id: None Jul 26 07:28:09.007185 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Name: None Jul 26 07:28:09.007185 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Identity-Status: Confirmed Jul 26 07:28:09.007185 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Is-Admin-Project: True Jul 26 07:28:09.007185 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Id: default Jul 26 07:28:09.007185 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Name: Default Jul 26 07:28:09.007185 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Id: c9cbf9b8d2e646eb945deb24d55fa0ad Jul 26 07:28:09.007185 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Name: tempest-VolumesActionsTest-34610786 Jul 26 07:28:09.007185 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Role: member,reader Jul 26 07:28:09.007185 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Roles: member,reader Jul 26 07:28:09.009834 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c9cbf9b8d2e646eb945deb24d55fa0ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c9cbf9b8d2e646eb945deb24d55fa0ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c9cbf9b8d2e646eb945deb24d55fa0ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c9cbf9b8d2e646eb945deb24d55fa0ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:28:09.009834 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant: tempest-VolumesActionsTest-34610786 Jul 26 07:28:09.009834 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Id: c9cbf9b8d2e646eb945deb24d55fa0ad Jul 26 07:28:09.009834 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Name: tempest-VolumesActionsTest-34610786 Jul 26 07:28:09.009834 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User: tempest-VolumesActionsTest-34610786-project Jul 26 07:28:09.009834 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Id: default Jul 26 07:28:09.009834 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Name: Default Jul 26 07:28:09.009834 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Id: 7a4c3b33511646b59d89dc933827dcb5 Jul 26 07:28:09.009834 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Name: tempest-VolumesActionsTest-34610786-project Jul 26 07:28:09.009834 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: method: > Jul 26 07:28:09.009834 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: exception: Instance c9897f10-f186-4747-9f58-0d3f1cdf9287 could not be found. Jul 26 07:28:09.009834 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: action_args: {'id': 'c9897f10-f186-4747-9f58-0d3f1cdf9287'} Jul 26 07:28:09.011204 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:28:09.011204 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:28:09.011204 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 07:28:09.011204 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 07:28:09.011204 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 07:28:09.011204 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 07:28:09.011204 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 07:28:09.011204 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 07:28:09.011204 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 07:28:09.011204 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 07:28:09.011204 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9897f10-f186-4747-9f58-0d3f1cdf9287 could not be found. Jul 26 07:28:09.011204 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:28:09.011204 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:28:09.011204 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:28:09.011204 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:28:09.011204 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:28:09.011204 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:28:09.011204 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:28:09.011204 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:28:09.011204 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:28:09.014256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:28:09.014256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 07:28:09.014256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 07:28:09.014256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 07:28:09.014256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 07:28:09.014256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 07:28:09.014256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:28:09.014256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9897f10-f186-4747-9f58-0d3f1cdf9287 could not be found. Jul 26 07:28:09.014256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:28:09.014256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:28:09.014256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:28:09.014256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:28:09.014256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:28:09.014256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:28:09.014256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:28:09.014256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:28:09.014256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9897f10-f186-4747-9f58-0d3f1cdf9287 could not be found. Jul 26 07:28:09.014256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:28:09.016189 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-444d4128-6d05-4bd0-8a41-f4cbf4a44542 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] Returning 404 to user: Instance c9897f10-f186-4747-9f58-0d3f1cdf9287 could not be found. {{(pid=117715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:28:09.016189 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-444d4128-6d05-4bd0-8a41-f4cbf4a44542 tempest-VolumesActionsTest-34610786 tempest-VolumesActionsTest-34610786-project] 10.222.0.39 "GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287" status: 404 len: 111 microversion: 2.1 time: 0.036108 Jul 26 07:28:09.016189 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 215/386] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:28:08 2022] GET /compute/v2.1/servers/c9897f10-f186-4747-9f58-0d3f1cdf9287 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 07:28:09.016189 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d021a707-e4e1-4c48-b0cc-94ae197d50b3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:28:09.016189 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d021a707-e4e1-4c48-b0cc-94ae197d50b3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:09.030353 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d021a707-e4e1-4c48-b0cc-94ae197d50b3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:09.030978 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d021a707-e4e1-4c48-b0cc-94ae197d50b3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:09.031893 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d021a707-e4e1-4c48-b0cc-94ae197d50b3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:09.032530 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d021a707-e4e1-4c48-b0cc-94ae197d50b3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:09.196220 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d021a707-e4e1-4c48-b0cc-94ae197d50b3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "POST /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/action" status: 202 len: 0 microversion: 2.20 time: 0.185635 Jul 26 07:28:09.197673 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 216/387] 10.222.0.39 () {62 vars in 1319 bytes} [Tue Jul 26 07:28:09 2022] POST /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 07:28:09.200477 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-5caed098-8e0f-424a-a2fa-7ed09d94a53e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:09.213276 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9ae588f7-33ba-4c4d-8aa4-2287a1705413 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:09.214807 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-9ae588f7-33ba-4c4d-8aa4-2287a1705413 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:09.216905 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-5caed098-8e0f-424a-a2fa-7ed09d94a53e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1371 microversion: 2.1 time: 0.279719 Jul 26 07:28:09.218301 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 172/388] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:28:08 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1371 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:28:09.235424 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9ae588f7-33ba-4c4d-8aa4-2287a1705413 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:09.235896 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9ae588f7-33ba-4c4d-8aa4-2287a1705413 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:09.237313 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9ae588f7-33ba-4c4d-8aa4-2287a1705413 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:09.238072 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9ae588f7-33ba-4c4d-8aa4-2287a1705413 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:09.501050 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-9ae588f7-33ba-4c4d-8aa4-2287a1705413 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:09.513931 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-9ae588f7-33ba-4c4d-8aa4-2287a1705413 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:09.517615 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-9ae588f7-33ba-4c4d-8aa4-2287a1705413 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:09.519405 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-9ae588f7-33ba-4c4d-8aa4-2287a1705413 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1752 microversion: 2.20 time: 0.316446 Jul 26 07:28:09.520167 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 217/389] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:09 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1752 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:28:10.256953 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-4d466b61-3764-4d70-8bbf-7799c75ad971 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:10.258050 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-4d466b61-3764-4d70-8bbf-7799c75ad971 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:10.270827 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4d466b61-3764-4d70-8bbf-7799c75ad971 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:10.271451 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4d466b61-3764-4d70-8bbf-7799c75ad971 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:10.272392 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4d466b61-3764-4d70-8bbf-7799c75ad971 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:10.272967 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4d466b61-3764-4d70-8bbf-7799c75ad971 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:10.478606 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-4d466b61-3764-4d70-8bbf-7799c75ad971 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:10.492545 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-4d466b61-3764-4d70-8bbf-7799c75ad971 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1371 microversion: 2.1 time: 0.244486 Jul 26 07:28:10.494126 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 173/390] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:28:10 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1371 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:28:10.556028 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-fea14e32-8f04-4b72-9a76-7b47fc7cb8a5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:10.556903 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-fea14e32-8f04-4b72-9a76-7b47fc7cb8a5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:10.564522 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fea14e32-8f04-4b72-9a76-7b47fc7cb8a5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:10.565161 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fea14e32-8f04-4b72-9a76-7b47fc7cb8a5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:10.566219 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fea14e32-8f04-4b72-9a76-7b47fc7cb8a5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:10.566838 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fea14e32-8f04-4b72-9a76-7b47fc7cb8a5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:10.768101 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-fea14e32-8f04-4b72-9a76-7b47fc7cb8a5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:10.778880 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-fea14e32-8f04-4b72-9a76-7b47fc7cb8a5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:10.780579 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-fea14e32-8f04-4b72-9a76-7b47fc7cb8a5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:10.781860 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-fea14e32-8f04-4b72-9a76-7b47fc7cb8a5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1752 microversion: 2.20 time: 0.231775 Jul 26 07:28:10.782440 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 218/391] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:10 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1752 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:28:11.524190 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-86c7404d-978d-4ac0-b763-9e3c1dd83d03 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:11.525681 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-86c7404d-978d-4ac0-b763-9e3c1dd83d03 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:11.529552 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell0:SELECT=2 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:11.530633 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell0:SELECT=6 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:11.542838 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-86c7404d-978d-4ac0-b763-9e3c1dd83d03 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:11.543586 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-86c7404d-978d-4ac0-b763-9e3c1dd83d03 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:11.545110 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-86c7404d-978d-4ac0-b763-9e3c1dd83d03 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:11.545915 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-86c7404d-978d-4ac0-b763-9e3c1dd83d03 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:11.758153 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-86c7404d-978d-4ac0-b763-9e3c1dd83d03 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:11.766946 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-86c7404d-978d-4ac0-b763-9e3c1dd83d03 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1371 microversion: 2.1 time: 0.250264 Jul 26 07:28:11.767557 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 174/392] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:28:11 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1371 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:28:11.818623 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c4aab3a9-d7db-4de2-b580-ced4a82fb7c0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:11.819629 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c4aab3a9-d7db-4de2-b580-ced4a82fb7c0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:11.822295 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell0:SELECT=2 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:11.829082 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c4aab3a9-d7db-4de2-b580-ced4a82fb7c0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:11.829706 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c4aab3a9-d7db-4de2-b580-ced4a82fb7c0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:11.830746 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c4aab3a9-d7db-4de2-b580-ced4a82fb7c0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:11.831561 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c4aab3a9-d7db-4de2-b580-ced4a82fb7c0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:12.007538 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c4aab3a9-d7db-4de2-b580-ced4a82fb7c0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:12.017272 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c4aab3a9-d7db-4de2-b580-ced4a82fb7c0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:12.019344 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c4aab3a9-d7db-4de2-b580-ced4a82fb7c0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:12.020821 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c4aab3a9-d7db-4de2-b580-ced4a82fb7c0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1752 microversion: 2.20 time: 0.206533 Jul 26 07:28:12.021540 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 219/393] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:11 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1752 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:28:12.788758 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9959c37f-58aa-4ffa-a86d-c77ddd2077fa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:12.789438 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-9959c37f-58aa-4ffa-a86d-c77ddd2077fa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:12.797238 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9959c37f-58aa-4ffa-a86d-c77ddd2077fa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:12.797537 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9959c37f-58aa-4ffa-a86d-c77ddd2077fa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:12.798398 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9959c37f-58aa-4ffa-a86d-c77ddd2077fa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:12.798834 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9959c37f-58aa-4ffa-a86d-c77ddd2077fa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:12.948874 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-9959c37f-58aa-4ffa-a86d-c77ddd2077fa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:12.957425 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-9959c37f-58aa-4ffa-a86d-c77ddd2077fa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1371 microversion: 2.1 time: 0.172683 Jul 26 07:28:12.958512 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 175/394] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:28:12 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:28:13.044994 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-762c14a9-423b-4d61-a5f4-6058982d806b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:13.045609 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-762c14a9-423b-4d61-a5f4-6058982d806b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:13.053268 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-762c14a9-423b-4d61-a5f4-6058982d806b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:13.053652 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-762c14a9-423b-4d61-a5f4-6058982d806b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:13.054571 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-762c14a9-423b-4d61-a5f4-6058982d806b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:13.055134 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-762c14a9-423b-4d61-a5f4-6058982d806b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:13.208482 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-762c14a9-423b-4d61-a5f4-6058982d806b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:13.219744 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-762c14a9-423b-4d61-a5f4-6058982d806b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:13.221353 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-762c14a9-423b-4d61-a5f4-6058982d806b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:13.222642 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-762c14a9-423b-4d61-a5f4-6058982d806b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1752 microversion: 2.20 time: 0.181858 Jul 26 07:28:13.223224 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 220/395] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:13 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1752 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:28:13.980894 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ec8e79fd-5e08-4974-b54a-110331e8662e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:13.981549 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ec8e79fd-5e08-4974-b54a-110331e8662e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:13.988988 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ec8e79fd-5e08-4974-b54a-110331e8662e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:13.989433 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ec8e79fd-5e08-4974-b54a-110331e8662e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:13.990262 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ec8e79fd-5e08-4974-b54a-110331e8662e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:13.990696 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ec8e79fd-5e08-4974-b54a-110331e8662e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:14.256167 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-1af3deac-3ebd-4373-8642-fcae31618c99 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:14.257255 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-1af3deac-3ebd-4373-8642-fcae31618c99 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:14.268776 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1af3deac-3ebd-4373-8642-fcae31618c99 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:14.269538 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1af3deac-3ebd-4373-8642-fcae31618c99 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:14.271080 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1af3deac-3ebd-4373-8642-fcae31618c99 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:14.271864 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1af3deac-3ebd-4373-8642-fcae31618c99 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:14.425688 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ec8e79fd-5e08-4974-b54a-110331e8662e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:14.436390 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ec8e79fd-5e08-4974-b54a-110331e8662e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1371 microversion: 2.1 time: 0.459145 Jul 26 07:28:14.437281 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 176/396] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:28:13 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1371 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:28:14.515832 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-1af3deac-3ebd-4373-8642-fcae31618c99 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:14.536117 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-1af3deac-3ebd-4373-8642-fcae31618c99 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:14.539242 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-1af3deac-3ebd-4373-8642-fcae31618c99 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:14.542286 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-1af3deac-3ebd-4373-8642-fcae31618c99 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1754 microversion: 2.20 time: 0.292547 Jul 26 07:28:14.543568 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 221/397] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:14 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1754 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:28:15.465917 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-dddb7c7a-ff13-4aa6-9f91-295f3117e874 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:15.470255 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-dddb7c7a-ff13-4aa6-9f91-295f3117e874 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:15.488912 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dddb7c7a-ff13-4aa6-9f91-295f3117e874 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:15.489817 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dddb7c7a-ff13-4aa6-9f91-295f3117e874 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:15.491289 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dddb7c7a-ff13-4aa6-9f91-295f3117e874 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:15.492044 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dddb7c7a-ff13-4aa6-9f91-295f3117e874 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:15.594192 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-41302297-4e6a-4bb9-b670-207d5ab96a7f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:15.599608 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-41302297-4e6a-4bb9-b670-207d5ab96a7f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:15.634506 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-41302297-4e6a-4bb9-b670-207d5ab96a7f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:15.640660 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-41302297-4e6a-4bb9-b670-207d5ab96a7f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:15.643996 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-41302297-4e6a-4bb9-b670-207d5ab96a7f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:15.651415 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-41302297-4e6a-4bb9-b670-207d5ab96a7f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:15.693707 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-dddb7c7a-ff13-4aa6-9f91-295f3117e874 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:15.706081 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-dddb7c7a-ff13-4aa6-9f91-295f3117e874 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1371 microversion: 2.1 time: 0.245993 Jul 26 07:28:15.707842 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 177/398] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:28:15 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1371 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:28:15.716222 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:15.726008 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-ed5866d7-1b9b-48af-af3e-c9e1ca8caa65 req-6b9a632d-2b8b-4d5a-a57d-4c6b95034309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8172b67c-005b-4f1f-91f0-f6ce67a50ab1", "name": "network-vif-plugged", "status": "completed", "tag": "643ec2f5-7bcc-4a3c-9ca2-bb545c332e35"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:28:15.749832 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-ed5866d7-1b9b-48af-af3e-c9e1ca8caa65 req-6b9a632d-2b8b-4d5a-a57d-4c6b95034309 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:15.750568 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-ed5866d7-1b9b-48af-af3e-c9e1ca8caa65 req-6b9a632d-2b8b-4d5a-a57d-4c6b95034309 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:15.775169 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-ed5866d7-1b9b-48af-af3e-c9e1ca8caa65 req-6b9a632d-2b8b-4d5a-a57d-4c6b95034309 service nova] Creating event network-vif-plugged:643ec2f5-7bcc-4a3c-9ca2-bb545c332e35 for instance 8172b67c-005b-4f1f-91f0-f6ce67a50ab1 on hv-cinder-85083 Jul 26 07:28:15.785930 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-ed5866d7-1b9b-48af-af3e-c9e1ca8caa65 req-6b9a632d-2b8b-4d5a-a57d-4c6b95034309 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074811 Jul 26 07:28:15.788469 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 178/399] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:28:15.965301 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-41302297-4e6a-4bb9-b670-207d5ab96a7f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:15.982956 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-41302297-4e6a-4bb9-b670-207d5ab96a7f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:15.987692 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-41302297-4e6a-4bb9-b670-207d5ab96a7f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:15.990011 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-41302297-4e6a-4bb9-b670-207d5ab96a7f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1810 microversion: 2.20 time: 0.405622 Jul 26 07:28:15.991862 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 222/400] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:15 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1810 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:28:16.749905 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ec756dce-7665-4b39-aff2-fc9cfdff4b02 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:16.752058 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ec756dce-7665-4b39-aff2-fc9cfdff4b02 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:16.761954 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ec756dce-7665-4b39-aff2-fc9cfdff4b02 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:16.762648 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ec756dce-7665-4b39-aff2-fc9cfdff4b02 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:16.763496 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ec756dce-7665-4b39-aff2-fc9cfdff4b02 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:16.764016 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ec756dce-7665-4b39-aff2-fc9cfdff4b02 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:16.994292 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ec756dce-7665-4b39-aff2-fc9cfdff4b02 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:17.004149 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ec756dce-7665-4b39-aff2-fc9cfdff4b02 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1371 microversion: 2.1 time: 0.262639 Jul 26 07:28:17.004750 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 179/401] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:28:16 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1371 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:28:17.024156 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-0c260e60-e7ea-48ce-95e7-927f3f4d0a69 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:17.025616 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-0c260e60-e7ea-48ce-95e7-927f3f4d0a69 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:17.033270 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0c260e60-e7ea-48ce-95e7-927f3f4d0a69 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:17.034165 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0c260e60-e7ea-48ce-95e7-927f3f4d0a69 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:17.035209 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0c260e60-e7ea-48ce-95e7-927f3f4d0a69 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:17.035874 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0c260e60-e7ea-48ce-95e7-927f3f4d0a69 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:17.277498 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-0c260e60-e7ea-48ce-95e7-927f3f4d0a69 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:17.293166 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-0c260e60-e7ea-48ce-95e7-927f3f4d0a69 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:17.295916 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-0c260e60-e7ea-48ce-95e7-927f3f4d0a69 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:17.297693 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-0c260e60-e7ea-48ce-95e7-927f3f4d0a69 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1810 microversion: 2.20 time: 0.277870 Jul 26 07:28:17.299808 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 223/402] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:17 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1810 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 07:28:18.110186 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-109605dc-a4c6-4838-86d9-9a2e1a1e1294 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:18.112885 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-109605dc-a4c6-4838-86d9-9a2e1a1e1294 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:18.136703 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-109605dc-a4c6-4838-86d9-9a2e1a1e1294 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:18.139043 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-109605dc-a4c6-4838-86d9-9a2e1a1e1294 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:18.141128 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-109605dc-a4c6-4838-86d9-9a2e1a1e1294 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:18.142505 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-109605dc-a4c6-4838-86d9-9a2e1a1e1294 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:18.151660 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:18.329263 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c6af981b-efa4-4360-90f8-cd790494768c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:18.330393 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c6af981b-efa4-4360-90f8-cd790494768c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:18.342654 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c6af981b-efa4-4360-90f8-cd790494768c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:18.344536 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c6af981b-efa4-4360-90f8-cd790494768c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:18.346012 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c6af981b-efa4-4360-90f8-cd790494768c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:18.346922 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c6af981b-efa4-4360-90f8-cd790494768c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:18.374430 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-109605dc-a4c6-4838-86d9-9a2e1a1e1294 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:18.383353 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-109605dc-a4c6-4838-86d9-9a2e1a1e1294 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1371 microversion: 2.1 time: 0.329668 Jul 26 07:28:18.396358 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 180/403] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:28:18 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1371 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:28:18.543442 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c6af981b-efa4-4360-90f8-cd790494768c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:18.563176 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c6af981b-efa4-4360-90f8-cd790494768c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:18.566805 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c6af981b-efa4-4360-90f8-cd790494768c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:18.572939 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c6af981b-efa4-4360-90f8-cd790494768c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1810 microversion: 2.20 time: 0.251738 Jul 26 07:28:18.574803 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 224/404] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:18 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1810 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:28:19.411071 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-27fdc626-bb5c-4cfc-b9d6-c164559bebc7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:19.412383 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-27fdc626-bb5c-4cfc-b9d6-c164559bebc7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:19.422639 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-27fdc626-bb5c-4cfc-b9d6-c164559bebc7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:19.423248 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-27fdc626-bb5c-4cfc-b9d6-c164559bebc7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:19.424359 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-27fdc626-bb5c-4cfc-b9d6-c164559bebc7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:19.425289 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-27fdc626-bb5c-4cfc-b9d6-c164559bebc7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:19.598453 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a2c412fb-7ce6-4314-b57b-94656de6ea49 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:19.599346 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a2c412fb-7ce6-4314-b57b-94656de6ea49 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:19.607777 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a2c412fb-7ce6-4314-b57b-94656de6ea49 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:19.608220 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a2c412fb-7ce6-4314-b57b-94656de6ea49 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:19.609280 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a2c412fb-7ce6-4314-b57b-94656de6ea49 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:19.609936 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a2c412fb-7ce6-4314-b57b-94656de6ea49 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:19.699713 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-27fdc626-bb5c-4cfc-b9d6-c164559bebc7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:19.720972 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-27fdc626-bb5c-4cfc-b9d6-c164559bebc7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1371 microversion: 2.1 time: 0.317542 Jul 26 07:28:19.735013 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 181/405] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:28:19 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1371 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:28:20.296525 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-a2c412fb-7ce6-4314-b57b-94656de6ea49 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:20.307411 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-a2c412fb-7ce6-4314-b57b-94656de6ea49 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:20.309020 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-a2c412fb-7ce6-4314-b57b-94656de6ea49 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:20.315695 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a2c412fb-7ce6-4314-b57b-94656de6ea49 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1810 microversion: 2.20 time: 0.718892 Jul 26 07:28:20.319525 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 225/406] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:19 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1810 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:28:20.773093 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d2596f19-94d7-4506-b49c-3c0ac64a086e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:20.774480 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d2596f19-94d7-4506-b49c-3c0ac64a086e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:20.783237 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d2596f19-94d7-4506-b49c-3c0ac64a086e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:20.784546 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d2596f19-94d7-4506-b49c-3c0ac64a086e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:20.785632 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d2596f19-94d7-4506-b49c-3c0ac64a086e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:20.786116 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d2596f19-94d7-4506-b49c-3c0ac64a086e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:20.964609 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d2596f19-94d7-4506-b49c-3c0ac64a086e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:20.974622 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d2596f19-94d7-4506-b49c-3c0ac64a086e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1371 microversion: 2.1 time: 0.205914 Jul 26 07:28:20.975397 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 182/407] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:28:20 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1371 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:28:21.344818 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b1134219-339e-463a-810a-1c921fd59dfc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:21.347207 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b1134219-339e-463a-810a-1c921fd59dfc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:21.359133 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b1134219-339e-463a-810a-1c921fd59dfc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:21.360339 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b1134219-339e-463a-810a-1c921fd59dfc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:21.362021 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b1134219-339e-463a-810a-1c921fd59dfc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:21.363281 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b1134219-339e-463a-810a-1c921fd59dfc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:21.767055 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-b1134219-339e-463a-810a-1c921fd59dfc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:21.785103 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-b1134219-339e-463a-810a-1c921fd59dfc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:21.787727 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-b1134219-339e-463a-810a-1c921fd59dfc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:21.789364 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b1134219-339e-463a-810a-1c921fd59dfc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1810 microversion: 2.20 time: 0.451921 Jul 26 07:28:21.790158 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 226/408] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:21 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1810 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:28:22.005889 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a6ae3461-b226-41d7-8260-264b8197c024 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:22.006864 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a6ae3461-b226-41d7-8260-264b8197c024 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:22.015387 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a6ae3461-b226-41d7-8260-264b8197c024 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:22.015819 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a6ae3461-b226-41d7-8260-264b8197c024 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:22.016724 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a6ae3461-b226-41d7-8260-264b8197c024 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:22.017107 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a6ae3461-b226-41d7-8260-264b8197c024 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:22.254140 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a6ae3461-b226-41d7-8260-264b8197c024 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:22.279561 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a6ae3461-b226-41d7-8260-264b8197c024 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1371 microversion: 2.1 time: 0.277340 Jul 26 07:28:22.311955 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 183/409] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:28:22 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1371 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:28:22.826487 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8efb3be8-ccaf-488b-9169-fab62fb42825 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:22.829033 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8efb3be8-ccaf-488b-9169-fab62fb42825 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:22.841485 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8efb3be8-ccaf-488b-9169-fab62fb42825 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:22.843293 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8efb3be8-ccaf-488b-9169-fab62fb42825 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:22.845222 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8efb3be8-ccaf-488b-9169-fab62fb42825 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:22.846639 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8efb3be8-ccaf-488b-9169-fab62fb42825 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:23.101960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8efb3be8-ccaf-488b-9169-fab62fb42825 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:23.128227 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8efb3be8-ccaf-488b-9169-fab62fb42825 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:23.131727 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8efb3be8-ccaf-488b-9169-fab62fb42825 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:23.134447 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8efb3be8-ccaf-488b-9169-fab62fb42825 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1810 microversion: 2.20 time: 0.314623 Jul 26 07:28:23.137664 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 227/410] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:22 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1810 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:28:23.325312 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-241a1fdf-fa28-4d72-9eb7-7c3198b702fb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:23.326077 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-241a1fdf-fa28-4d72-9eb7-7c3198b702fb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:23.340058 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-241a1fdf-fa28-4d72-9eb7-7c3198b702fb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:23.340823 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-241a1fdf-fa28-4d72-9eb7-7c3198b702fb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:23.341701 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-241a1fdf-fa28-4d72-9eb7-7c3198b702fb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:23.342271 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-241a1fdf-fa28-4d72-9eb7-7c3198b702fb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:23.506757 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-241a1fdf-fa28-4d72-9eb7-7c3198b702fb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:23.525599 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-241a1fdf-fa28-4d72-9eb7-7c3198b702fb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1371 microversion: 2.1 time: 0.203881 Jul 26 07:28:23.526632 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 184/411] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:28:23 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1371 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:28:24.176257 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a923a81a-0719-4ccf-a5af-3ac34456ee4d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:24.177704 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a923a81a-0719-4ccf-a5af-3ac34456ee4d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:24.185299 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a923a81a-0719-4ccf-a5af-3ac34456ee4d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:24.186471 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a923a81a-0719-4ccf-a5af-3ac34456ee4d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:24.187486 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a923a81a-0719-4ccf-a5af-3ac34456ee4d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:24.188011 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a923a81a-0719-4ccf-a5af-3ac34456ee4d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:24.485400 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-a923a81a-0719-4ccf-a5af-3ac34456ee4d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:24.509680 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-a923a81a-0719-4ccf-a5af-3ac34456ee4d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:24.522854 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-a923a81a-0719-4ccf-a5af-3ac34456ee4d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:24.525127 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a923a81a-0719-4ccf-a5af-3ac34456ee4d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1810 microversion: 2.20 time: 0.353719 Jul 26 07:28:24.553368 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 228/412] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:24 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1810 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 07:28:24.560109 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ff09a886-940c-4922-85d6-b6e00aee772e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:24.561883 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ff09a886-940c-4922-85d6-b6e00aee772e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:24.572978 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ff09a886-940c-4922-85d6-b6e00aee772e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:24.573768 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ff09a886-940c-4922-85d6-b6e00aee772e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:24.575642 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ff09a886-940c-4922-85d6-b6e00aee772e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:24.576414 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ff09a886-940c-4922-85d6-b6e00aee772e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:24.843482 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ff09a886-940c-4922-85d6-b6e00aee772e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:24.855377 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ff09a886-940c-4922-85d6-b6e00aee772e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1565 microversion: 2.1 time: 0.302114 Jul 26 07:28:24.856867 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 185/413] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:28:24 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1565 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:28:24.884263 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e993b47c-c2a9-41a9-aaf0-251b43e871e7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:24.885083 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e993b47c-c2a9-41a9-aaf0-251b43e871e7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:24.893309 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e993b47c-c2a9-41a9-aaf0-251b43e871e7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:24.894301 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e993b47c-c2a9-41a9-aaf0-251b43e871e7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:24.895934 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e993b47c-c2a9-41a9-aaf0-251b43e871e7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:24.896775 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e993b47c-c2a9-41a9-aaf0-251b43e871e7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:25.051936 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e993b47c-c2a9-41a9-aaf0-251b43e871e7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.175613 Jul 26 07:28:25.053163 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 229/414] 10.222.0.39 () {58 vars in 1275 bytes} [Tue Jul 26 07:28:24 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-interface => generated 285 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 07:28:25.564143 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8019d5bf-bc2b-4777-875e-35f6601fac1c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:25.565851 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8019d5bf-bc2b-4777-875e-35f6601fac1c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:25.587435 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8019d5bf-bc2b-4777-875e-35f6601fac1c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:25.588301 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8019d5bf-bc2b-4777-875e-35f6601fac1c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:25.589193 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8019d5bf-bc2b-4777-875e-35f6601fac1c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:25.589630 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8019d5bf-bc2b-4777-875e-35f6601fac1c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:26.006584 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8019d5bf-bc2b-4777-875e-35f6601fac1c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:26.041904 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8019d5bf-bc2b-4777-875e-35f6601fac1c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:26.056190 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8019d5bf-bc2b-4777-875e-35f6601fac1c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:26.066309 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8019d5bf-bc2b-4777-875e-35f6601fac1c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1810 microversion: 2.20 time: 0.512156 Jul 26 07:28:26.067555 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 186/415] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:25 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1810 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:28:27.115811 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3375fd8f-14a2-4d11-8dde-cfec2120192e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:27.119116 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3375fd8f-14a2-4d11-8dde-cfec2120192e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:27.132892 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-8746d1cd-3326-450d-ab37-bf7507bc0ca1 req-67addd36-9acc-4b95-9783-b14a6216fde7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8172b67c-005b-4f1f-91f0-f6ce67a50ab1", "tag": "643ec2f5-7bcc-4a3c-9ca2-bb545c332e35"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:28:27.146612 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-8746d1cd-3326-450d-ab37-bf7507bc0ca1 req-67addd36-9acc-4b95-9783-b14a6216fde7 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:27.147120 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-8746d1cd-3326-450d-ab37-bf7507bc0ca1 req-67addd36-9acc-4b95-9783-b14a6216fde7 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:27.162486 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3375fd8f-14a2-4d11-8dde-cfec2120192e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:27.164233 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3375fd8f-14a2-4d11-8dde-cfec2120192e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:27.166797 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3375fd8f-14a2-4d11-8dde-cfec2120192e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:27.168020 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3375fd8f-14a2-4d11-8dde-cfec2120192e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:27.168842 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-8746d1cd-3326-450d-ab37-bf7507bc0ca1 req-67addd36-9acc-4b95-9783-b14a6216fde7 service nova] Creating event network-changed:643ec2f5-7bcc-4a3c-9ca2-bb545c332e35 for instance 8172b67c-005b-4f1f-91f0-f6ce67a50ab1 on hv-cinder-85083 Jul 26 07:28:27.183683 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-8746d1cd-3326-450d-ab37-bf7507bc0ca1 req-67addd36-9acc-4b95-9783-b14a6216fde7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054363 Jul 26 07:28:27.188355 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 187/416] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:28:27.520425 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3375fd8f-14a2-4d11-8dde-cfec2120192e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:27.551027 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3375fd8f-14a2-4d11-8dde-cfec2120192e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:27.556918 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3375fd8f-14a2-4d11-8dde-cfec2120192e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:27.570292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3375fd8f-14a2-4d11-8dde-cfec2120192e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1810 microversion: 2.20 time: 0.456748 Jul 26 07:28:27.571929 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 230/417] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:27 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1810 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 07:28:28.654365 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-45bb22eb-6ca3-46fd-9316-96a79a599549 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:28.663041 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-45bb22eb-6ca3-46fd-9316-96a79a599549 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:28.698885 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-45bb22eb-6ca3-46fd-9316-96a79a599549 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:28.703387 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-45bb22eb-6ca3-46fd-9316-96a79a599549 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:28.708520 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-45bb22eb-6ca3-46fd-9316-96a79a599549 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:28.714798 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-45bb22eb-6ca3-46fd-9316-96a79a599549 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:29.045527 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-45bb22eb-6ca3-46fd-9316-96a79a599549 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:29.055360 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-45bb22eb-6ca3-46fd-9316-96a79a599549 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:29.062799 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-45bb22eb-6ca3-46fd-9316-96a79a599549 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:29.085007 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-45bb22eb-6ca3-46fd-9316-96a79a599549 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1810 microversion: 2.20 time: 0.457182 Jul 26 07:28:29.086449 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 188/418] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:28 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1810 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:28:30.150254 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b548adf2-0d0a-4549-b329-869f472bcf22 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:30.151982 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b548adf2-0d0a-4549-b329-869f472bcf22 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:30.183433 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=71 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:30.197903 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b548adf2-0d0a-4549-b329-869f472bcf22 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:30.202438 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b548adf2-0d0a-4549-b329-869f472bcf22 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:30.210450 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b548adf2-0d0a-4549-b329-869f472bcf22 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:30.211467 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b548adf2-0d0a-4549-b329-869f472bcf22 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:30.914282 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-b548adf2-0d0a-4549-b329-869f472bcf22 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:30.941798 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-b548adf2-0d0a-4549-b329-869f472bcf22 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:30.947062 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-b548adf2-0d0a-4549-b329-869f472bcf22 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:30.950896 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b548adf2-0d0a-4549-b329-869f472bcf22 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1810 microversion: 2.20 time: 0.824482 Jul 26 07:28:30.953259 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 231/419] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:30 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1810 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:28:31.981349 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8363fa2a-e863-4bf7-bf4d-fe4df8074639 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:31.983739 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8363fa2a-e863-4bf7-bf4d-fe4df8074639 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:31.995642 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=55 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:31.997968 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8363fa2a-e863-4bf7-bf4d-fe4df8074639 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:31.998671 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8363fa2a-e863-4bf7-bf4d-fe4df8074639 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:31.999629 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8363fa2a-e863-4bf7-bf4d-fe4df8074639 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:32.000200 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8363fa2a-e863-4bf7-bf4d-fe4df8074639 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:32.220550 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8363fa2a-e863-4bf7-bf4d-fe4df8074639 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:32.232837 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8363fa2a-e863-4bf7-bf4d-fe4df8074639 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:32.235332 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8363fa2a-e863-4bf7-bf4d-fe4df8074639 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:32.236570 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8363fa2a-e863-4bf7-bf4d-fe4df8074639 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1810 microversion: 2.20 time: 0.262926 Jul 26 07:28:32.239199 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 189/420] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:31 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1810 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:28:32.894132 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-2ecce45e-5d13-4b1d-bcb3-d3d2e2b4bad2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:32.895117 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2ecce45e-5d13-4b1d-bcb3-d3d2e2b4bad2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 4a6929a0-8c3d-4474-8ffa-b2777251fa48] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:32.905151 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2ecce45e-5d13-4b1d-bcb3-d3d2e2b4bad2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:32.905601 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2ecce45e-5d13-4b1d-bcb3-d3d2e2b4bad2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:32.906438 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2ecce45e-5d13-4b1d-bcb3-d3d2e2b4bad2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:32.907026 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2ecce45e-5d13-4b1d-bcb3-d3d2e2b4bad2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:33.101807 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.objects.instance [None req-2ecce45e-5d13-4b1d-bcb3-d3d2e2b4bad2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lazy-loading 'services' on Instance uuid 4a6929a0-8c3d-4474-8ffa-b2777251fa48 {{(pid=117715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 07:28:33.268076 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2ed5087f-8c0b-42ff-832c-a6f71100b08e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:33.269242 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2ed5087f-8c0b-42ff-832c-a6f71100b08e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:33.298832 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2ed5087f-8c0b-42ff-832c-a6f71100b08e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:33.305885 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2ed5087f-8c0b-42ff-832c-a6f71100b08e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:33.307467 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2ed5087f-8c0b-42ff-832c-a6f71100b08e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:33.308290 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-2ecce45e-5d13-4b1d-bcb3-d3d2e2b4bad2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48/os-volume_attachments/4b0afb0f-cb60-485e-b3c4-0dc894d1fd7b" status: 202 len: 0 microversion: 2.1 time: 0.418937 Jul 26 07:28:33.308806 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2ed5087f-8c0b-42ff-832c-a6f71100b08e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:33.309176 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 232/421] 10.222.0.39 () {58 vars in 1416 bytes} [Tue Jul 26 07:28:32 2022] DELETE /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48/os-volume_attachments/4b0afb0f-cb60-485e-b3c4-0dc894d1fd7b => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 07:28:33.745345 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2ed5087f-8c0b-42ff-832c-a6f71100b08e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:33.774252 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2ed5087f-8c0b-42ff-832c-a6f71100b08e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:33.785940 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2ed5087f-8c0b-42ff-832c-a6f71100b08e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:33.789407 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2ed5087f-8c0b-42ff-832c-a6f71100b08e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1810 microversion: 2.20 time: 0.528554 Jul 26 07:28:33.799716 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 190/422] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:33 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1810 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:28:34.844648 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e8d842d6-3a8f-4b7f-8c87-5e98172fcfe2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:34.846301 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e8d842d6-3a8f-4b7f-8c87-5e98172fcfe2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:34.861661 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e8d842d6-3a8f-4b7f-8c87-5e98172fcfe2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:34.863766 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e8d842d6-3a8f-4b7f-8c87-5e98172fcfe2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:34.865975 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e8d842d6-3a8f-4b7f-8c87-5e98172fcfe2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:34.866960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e8d842d6-3a8f-4b7f-8c87-5e98172fcfe2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:35.175191 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-e8d842d6-3a8f-4b7f-8c87-5e98172fcfe2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:35.202862 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-e8d842d6-3a8f-4b7f-8c87-5e98172fcfe2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:35.204844 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-e8d842d6-3a8f-4b7f-8c87-5e98172fcfe2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:35.206245 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e8d842d6-3a8f-4b7f-8c87-5e98172fcfe2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1810 microversion: 2.20 time: 0.366788 Jul 26 07:28:35.207139 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 233/423] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:34 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1810 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 07:28:36.239215 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-cda35db8-0371-40d2-afb3-1d52be2cf29c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:36.239903 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-cda35db8-0371-40d2-afb3-1d52be2cf29c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:36.247411 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cda35db8-0371-40d2-afb3-1d52be2cf29c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:36.248074 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cda35db8-0371-40d2-afb3-1d52be2cf29c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:36.248729 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cda35db8-0371-40d2-afb3-1d52be2cf29c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:36.249415 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cda35db8-0371-40d2-afb3-1d52be2cf29c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:36.420537 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-cda35db8-0371-40d2-afb3-1d52be2cf29c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:36.454263 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-cda35db8-0371-40d2-afb3-1d52be2cf29c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:36.458716 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-cda35db8-0371-40d2-afb3-1d52be2cf29c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:36.461362 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-cda35db8-0371-40d2-afb3-1d52be2cf29c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1810 microversion: 2.20 time: 0.226431 Jul 26 07:28:36.467552 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 191/424] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:36 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1810 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:28:37.503527 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8d2acf0e-829e-4c1e-a6b6-539046d82bed tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:37.504210 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8d2acf0e-829e-4c1e-a6b6-539046d82bed tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:37.511068 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8d2acf0e-829e-4c1e-a6b6-539046d82bed tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:37.511571 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8d2acf0e-829e-4c1e-a6b6-539046d82bed tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:37.512557 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8d2acf0e-829e-4c1e-a6b6-539046d82bed tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:37.512906 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8d2acf0e-829e-4c1e-a6b6-539046d82bed tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:37.664582 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8d2acf0e-829e-4c1e-a6b6-539046d82bed tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:37.678631 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8d2acf0e-829e-4c1e-a6b6-539046d82bed tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:37.681450 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8d2acf0e-829e-4c1e-a6b6-539046d82bed tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:37.683622 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8d2acf0e-829e-4c1e-a6b6-539046d82bed tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1810 microversion: 2.20 time: 0.184093 Jul 26 07:28:37.684653 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 234/425] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:37 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1810 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:28:38.709244 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ac467941-705e-4a48-a3db-01898dbfef23 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:38.710175 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ac467941-705e-4a48-a3db-01898dbfef23 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:38.717324 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ac467941-705e-4a48-a3db-01898dbfef23 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:38.718310 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ac467941-705e-4a48-a3db-01898dbfef23 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:38.719202 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ac467941-705e-4a48-a3db-01898dbfef23 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:38.719651 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ac467941-705e-4a48-a3db-01898dbfef23 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:39.059651 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ac467941-705e-4a48-a3db-01898dbfef23 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:39.075137 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ac467941-705e-4a48-a3db-01898dbfef23 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:39.079143 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ac467941-705e-4a48-a3db-01898dbfef23 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:39.081532 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ac467941-705e-4a48-a3db-01898dbfef23 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1810 microversion: 2.20 time: 0.376237 Jul 26 07:28:39.082792 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 192/426] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:38 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1810 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:28:39.151184 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-bf86f814-effc-43b0-a6bc-13f05fa26dc3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:39.151990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-bf86f814-effc-43b0-a6bc-13f05fa26dc3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 4a6929a0-8c3d-4474-8ffa-b2777251fa48] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:39.158727 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bf86f814-effc-43b0-a6bc-13f05fa26dc3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:39.159055 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bf86f814-effc-43b0-a6bc-13f05fa26dc3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:39.161775 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bf86f814-effc-43b0-a6bc-13f05fa26dc3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:39.161775 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bf86f814-effc-43b0-a6bc-13f05fa26dc3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:39.193167 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-bf86f814-effc-43b0-a6bc-13f05fa26dc3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 4a6929a0-8c3d-4474-8ffa-b2777251fa48] Going to try to terminate instance {{(pid=117715) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 07:28:39.287693 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-bf86f814-effc-43b0-a6bc-13f05fa26dc3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48" status: 204 len: 0 microversion: 2.1 time: 0.140234 Jul 26 07:28:39.288257 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 235/427] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Jul 26 07:28:39 2022] DELETE /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 07:28:39.297278 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b998841f-2d6f-45bb-8c71-b9b960849c6b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:39.298076 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-b998841f-2d6f-45bb-8c71-b9b960849c6b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 4a6929a0-8c3d-4474-8ffa-b2777251fa48] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:39.306243 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b998841f-2d6f-45bb-8c71-b9b960849c6b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:39.306714 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b998841f-2d6f-45bb-8c71-b9b960849c6b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:39.307502 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b998841f-2d6f-45bb-8c71-b9b960849c6b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:39.307941 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b998841f-2d6f-45bb-8c71-b9b960849c6b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:39.468440 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-b998841f-2d6f-45bb-8c71-b9b960849c6b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:39.477187 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b998841f-2d6f-45bb-8c71-b9b960849c6b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48" status: 200 len: 1514 microversion: 2.1 time: 0.184016 Jul 26 07:28:39.478102 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 193/428] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:28:39 2022] GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48 => generated 1514 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:28:40.124076 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-fbda1193-b01e-47d7-a64e-ab3454a22b74 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:40.125347 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-fbda1193-b01e-47d7-a64e-ab3454a22b74 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:40.136112 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fbda1193-b01e-47d7-a64e-ab3454a22b74 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:40.136702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fbda1193-b01e-47d7-a64e-ab3454a22b74 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:40.137903 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fbda1193-b01e-47d7-a64e-ab3454a22b74 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:40.138621 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fbda1193-b01e-47d7-a64e-ab3454a22b74 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:40.379060 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-fbda1193-b01e-47d7-a64e-ab3454a22b74 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:40.402321 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-fbda1193-b01e-47d7-a64e-ab3454a22b74 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:40.408343 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-fbda1193-b01e-47d7-a64e-ab3454a22b74 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:40.411209 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-fbda1193-b01e-47d7-a64e-ab3454a22b74 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1810 microversion: 2.20 time: 0.294995 Jul 26 07:28:40.412155 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 236/429] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:40 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1810 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:28:40.503097 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-92279c81-fb96-43be-a7d0-554cc8435822 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:40.504300 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-92279c81-fb96-43be-a7d0-554cc8435822 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 4a6929a0-8c3d-4474-8ffa-b2777251fa48] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:40.514914 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-92279c81-fb96-43be-a7d0-554cc8435822 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:40.515493 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-92279c81-fb96-43be-a7d0-554cc8435822 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:40.516371 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-92279c81-fb96-43be-a7d0-554cc8435822 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:40.516895 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-92279c81-fb96-43be-a7d0-554cc8435822 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:40.731581 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-92279c81-fb96-43be-a7d0-554cc8435822 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:40.745689 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-92279c81-fb96-43be-a7d0-554cc8435822 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48" status: 200 len: 1514 microversion: 2.1 time: 0.248912 Jul 26 07:28:40.746740 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 194/430] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:28:40 2022] GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48 => generated 1514 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:28:41.438179 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-02863c62-6387-4cdd-a906-0c828cdbaba3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:41.439547 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-02863c62-6387-4cdd-a906-0c828cdbaba3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:41.447891 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-02863c62-6387-4cdd-a906-0c828cdbaba3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:41.448405 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-02863c62-6387-4cdd-a906-0c828cdbaba3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:41.449127 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-02863c62-6387-4cdd-a906-0c828cdbaba3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:41.449567 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-02863c62-6387-4cdd-a906-0c828cdbaba3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:41.454715 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:41.613945 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-02863c62-6387-4cdd-a906-0c828cdbaba3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:41.623773 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-02863c62-6387-4cdd-a906-0c828cdbaba3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:41.625388 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-02863c62-6387-4cdd-a906-0c828cdbaba3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:41.626670 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-02863c62-6387-4cdd-a906-0c828cdbaba3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1810 microversion: 2.20 time: 0.193142 Jul 26 07:28:41.635152 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 237/431] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:41 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1810 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:28:41.784783 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-86c2570d-223c-44bc-b0db-bf4a6173d90a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:41.786170 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-86c2570d-223c-44bc-b0db-bf4a6173d90a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 4a6929a0-8c3d-4474-8ffa-b2777251fa48] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:41.798348 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-86c2570d-223c-44bc-b0db-bf4a6173d90a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:41.799729 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-86c2570d-223c-44bc-b0db-bf4a6173d90a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:41.801444 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-86c2570d-223c-44bc-b0db-bf4a6173d90a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:41.802797 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-86c2570d-223c-44bc-b0db-bf4a6173d90a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:42.083132 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-86c2570d-223c-44bc-b0db-bf4a6173d90a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:42.095860 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-86c2570d-223c-44bc-b0db-bf4a6173d90a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48" status: 200 len: 1514 microversion: 2.1 time: 0.318785 Jul 26 07:28:42.096943 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 195/432] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:28:41 2022] GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48 => generated 1514 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:28:42.309348 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-0d98ecda-10d7-48d2-a2a9-3e5d84a63702 req-3934be23-fdab-4b55-b7e6-1d25f6ad1fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a6929a0-8c3d-4474-8ffa-b2777251fa48", "name": "network-vif-deleted", "tag": "3c2acf45-527d-4fda-b300-54247d2954e9"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:28:42.349365 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-0d98ecda-10d7-48d2-a2a9-3e5d84a63702 req-3934be23-fdab-4b55-b7e6-1d25f6ad1fb8 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:42.350209 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-0d98ecda-10d7-48d2-a2a9-3e5d84a63702 req-3934be23-fdab-4b55-b7e6-1d25f6ad1fb8 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:42.375631 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-0d98ecda-10d7-48d2-a2a9-3e5d84a63702 req-3934be23-fdab-4b55-b7e6-1d25f6ad1fb8 service nova] Creating event network-vif-deleted:3c2acf45-527d-4fda-b300-54247d2954e9 for instance 4a6929a0-8c3d-4474-8ffa-b2777251fa48 on hv-cinder-85083 Jul 26 07:28:42.385709 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-0d98ecda-10d7-48d2-a2a9-3e5d84a63702 req-3934be23-fdab-4b55-b7e6-1d25f6ad1fb8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084161 Jul 26 07:28:42.388067 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 238/433] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:28:42.651069 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-70466cbb-3594-4ae1-a0d9-dfab1df12827 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:42.651672 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-70466cbb-3594-4ae1-a0d9-dfab1df12827 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:42.659254 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-70466cbb-3594-4ae1-a0d9-dfab1df12827 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:42.659755 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-70466cbb-3594-4ae1-a0d9-dfab1df12827 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:42.660607 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-70466cbb-3594-4ae1-a0d9-dfab1df12827 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:42.661094 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-70466cbb-3594-4ae1-a0d9-dfab1df12827 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:42.826936 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-70466cbb-3594-4ae1-a0d9-dfab1df12827 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:42.837027 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-70466cbb-3594-4ae1-a0d9-dfab1df12827 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:42.839014 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-70466cbb-3594-4ae1-a0d9-dfab1df12827 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:42.840625 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-70466cbb-3594-4ae1-a0d9-dfab1df12827 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1810 microversion: 2.20 time: 0.193900 Jul 26 07:28:42.841335 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 196/434] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:42 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1810 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:28:43.123886 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f1dc7813-4591-4b04-882e-88f073a3d384 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:43.125154 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f1dc7813-4591-4b04-882e-88f073a3d384 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 4a6929a0-8c3d-4474-8ffa-b2777251fa48] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:43.137087 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f1dc7813-4591-4b04-882e-88f073a3d384 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:43.137924 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f1dc7813-4591-4b04-882e-88f073a3d384 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:43.139345 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f1dc7813-4591-4b04-882e-88f073a3d384 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:43.140448 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f1dc7813-4591-4b04-882e-88f073a3d384 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:43.179863 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f1dc7813-4591-4b04-882e-88f073a3d384 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:43.180292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f1dc7813-4591-4b04-882e-88f073a3d384 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:43.180752 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.objects.instance [None req-f1dc7813-4591-4b04-882e-88f073a3d384 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lazy-loading 'fault' on Instance uuid 4a6929a0-8c3d-4474-8ffa-b2777251fa48 {{(pid=117715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 07:28:43.233091 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f1dc7813-4591-4b04-882e-88f073a3d384 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:43.241549 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f1dc7813-4591-4b04-882e-88f073a3d384 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48" status: 200 len: 1309 microversion: 2.1 time: 0.125940 Jul 26 07:28:43.242192 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 239/435] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:28:43 2022] GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48 => generated 1309 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:28:43.865170 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-56bd3758-e79d-4e8c-97f9-6478a46acfa4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:43.865829 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-56bd3758-e79d-4e8c-97f9-6478a46acfa4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:43.873188 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-56bd3758-e79d-4e8c-97f9-6478a46acfa4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:43.873623 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-56bd3758-e79d-4e8c-97f9-6478a46acfa4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:43.874441 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-56bd3758-e79d-4e8c-97f9-6478a46acfa4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:43.874866 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-56bd3758-e79d-4e8c-97f9-6478a46acfa4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:43.891076 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:44.036979 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-56bd3758-e79d-4e8c-97f9-6478a46acfa4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:44.046895 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-56bd3758-e79d-4e8c-97f9-6478a46acfa4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:44.048785 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-56bd3758-e79d-4e8c-97f9-6478a46acfa4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:44.050388 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-56bd3758-e79d-4e8c-97f9-6478a46acfa4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1810 microversion: 2.20 time: 0.189362 Jul 26 07:28:44.051091 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 197/436] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:43 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1810 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:28:44.265163 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6f2a4d29-760f-4859-869d-7c767b31300d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:44.265885 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-6f2a4d29-760f-4859-869d-7c767b31300d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 4a6929a0-8c3d-4474-8ffa-b2777251fa48] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:44.272714 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6f2a4d29-760f-4859-869d-7c767b31300d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:44.273189 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6f2a4d29-760f-4859-869d-7c767b31300d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:44.274101 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6f2a4d29-760f-4859-869d-7c767b31300d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:44.274543 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6f2a4d29-760f-4859-869d-7c767b31300d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:44.310372 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6f2a4d29-760f-4859-869d-7c767b31300d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:44.310789 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6f2a4d29-760f-4859-869d-7c767b31300d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:44.311253 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.objects.instance [None req-6f2a4d29-760f-4859-869d-7c767b31300d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lazy-loading 'fault' on Instance uuid 4a6929a0-8c3d-4474-8ffa-b2777251fa48 {{(pid=117715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 07:28:44.356361 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-6f2a4d29-760f-4859-869d-7c767b31300d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:44.365300 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6f2a4d29-760f-4859-869d-7c767b31300d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48" status: 200 len: 1309 microversion: 2.1 time: 0.104159 Jul 26 07:28:44.365939 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 240/437] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:28:44 2022] GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48 => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:28:45.075336 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8cbc8280-8a91-4478-ab60-8ad2009b12ba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:45.076081 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8cbc8280-8a91-4478-ab60-8ad2009b12ba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:45.082802 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8cbc8280-8a91-4478-ab60-8ad2009b12ba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:45.083234 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8cbc8280-8a91-4478-ab60-8ad2009b12ba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:45.084015 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8cbc8280-8a91-4478-ab60-8ad2009b12ba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:45.084455 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8cbc8280-8a91-4478-ab60-8ad2009b12ba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:45.228300 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8cbc8280-8a91-4478-ab60-8ad2009b12ba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:45.242474 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8cbc8280-8a91-4478-ab60-8ad2009b12ba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:45.244451 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8cbc8280-8a91-4478-ab60-8ad2009b12ba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:45.246530 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8cbc8280-8a91-4478-ab60-8ad2009b12ba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1810 microversion: 2.20 time: 0.175656 Jul 26 07:28:45.247959 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 198/438] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:45 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1810 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:28:45.388437 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ef6a17d4-75cd-40b4-9bef-254e66db965b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:45.389083 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ef6a17d4-75cd-40b4-9bef-254e66db965b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 4a6929a0-8c3d-4474-8ffa-b2777251fa48] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:45.395568 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef6a17d4-75cd-40b4-9bef-254e66db965b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:45.396025 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef6a17d4-75cd-40b4-9bef-254e66db965b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:45.396811 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef6a17d4-75cd-40b4-9bef-254e66db965b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:45.397245 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef6a17d4-75cd-40b4-9bef-254e66db965b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:45.430700 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef6a17d4-75cd-40b4-9bef-254e66db965b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:45.431134 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef6a17d4-75cd-40b4-9bef-254e66db965b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:45.431587 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.objects.instance [None req-ef6a17d4-75cd-40b4-9bef-254e66db965b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lazy-loading 'fault' on Instance uuid 4a6929a0-8c3d-4474-8ffa-b2777251fa48 {{(pid=117715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 07:28:45.481562 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ef6a17d4-75cd-40b4-9bef-254e66db965b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:45.489649 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ef6a17d4-75cd-40b4-9bef-254e66db965b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48" status: 200 len: 1309 microversion: 2.1 time: 0.105419 Jul 26 07:28:45.490269 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 241/439] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:28:45 2022] GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48 => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:28:46.272521 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-155f7d99-2c83-4281-831e-19ee079787d1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:46.273165 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-155f7d99-2c83-4281-831e-19ee079787d1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:46.281317 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-155f7d99-2c83-4281-831e-19ee079787d1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:46.281910 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-155f7d99-2c83-4281-831e-19ee079787d1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:46.282794 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-155f7d99-2c83-4281-831e-19ee079787d1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:46.283265 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-155f7d99-2c83-4281-831e-19ee079787d1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:46.425633 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-155f7d99-2c83-4281-831e-19ee079787d1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:46.439376 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-155f7d99-2c83-4281-831e-19ee079787d1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:46.441662 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-155f7d99-2c83-4281-831e-19ee079787d1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:46.443407 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-155f7d99-2c83-4281-831e-19ee079787d1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1810 microversion: 2.20 time: 0.175330 Jul 26 07:28:46.443977 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 199/440] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:46 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:28:46.511073 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8ab3d767-b507-495f-9da4-b55617c1c930 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:46.511715 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8ab3d767-b507-495f-9da4-b55617c1c930 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 4a6929a0-8c3d-4474-8ffa-b2777251fa48] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:46.518581 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ab3d767-b507-495f-9da4-b55617c1c930 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:46.519028 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ab3d767-b507-495f-9da4-b55617c1c930 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:46.519819 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ab3d767-b507-495f-9da4-b55617c1c930 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:46.520248 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ab3d767-b507-495f-9da4-b55617c1c930 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:46.554841 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ab3d767-b507-495f-9da4-b55617c1c930 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:46.555188 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ab3d767-b507-495f-9da4-b55617c1c930 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:46.555641 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.objects.instance [None req-8ab3d767-b507-495f-9da4-b55617c1c930 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lazy-loading 'fault' on Instance uuid 4a6929a0-8c3d-4474-8ffa-b2777251fa48 {{(pid=117715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 07:28:46.603684 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8ab3d767-b507-495f-9da4-b55617c1c930 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:46.613187 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8ab3d767-b507-495f-9da4-b55617c1c930 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48" status: 200 len: 1309 microversion: 2.1 time: 0.105998 Jul 26 07:28:46.614880 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 242/441] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:28:46 2022] GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48 => generated 1309 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:28:47.470934 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-bf7722e8-ab4a-4741-87f7-80bd57322ae6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:47.471556 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-bf7722e8-ab4a-4741-87f7-80bd57322ae6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:47.478728 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bf7722e8-ab4a-4741-87f7-80bd57322ae6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:47.479188 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bf7722e8-ab4a-4741-87f7-80bd57322ae6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:47.479983 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bf7722e8-ab4a-4741-87f7-80bd57322ae6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:47.480421 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bf7722e8-ab4a-4741-87f7-80bd57322ae6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:47.630835 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-bf7722e8-ab4a-4741-87f7-80bd57322ae6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:47.639745 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-bf7722e8-ab4a-4741-87f7-80bd57322ae6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:47.641220 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-bf7722e8-ab4a-4741-87f7-80bd57322ae6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:47.642465 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-bf7722e8-ab4a-4741-87f7-80bd57322ae6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1810 microversion: 2.20 time: 0.177490 Jul 26 07:28:47.643019 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 200/442] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:47 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 07:28:47.643627 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-150bfcd3-8c04-44c5-9e36-b262af4a6086 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:47.644512 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-150bfcd3-8c04-44c5-9e36-b262af4a6086 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 4a6929a0-8c3d-4474-8ffa-b2777251fa48] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:47.651016 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-150bfcd3-8c04-44c5-9e36-b262af4a6086 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:47.651459 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-150bfcd3-8c04-44c5-9e36-b262af4a6086 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:47.652224 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-150bfcd3-8c04-44c5-9e36-b262af4a6086 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:47.652661 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-150bfcd3-8c04-44c5-9e36-b262af4a6086 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:47.668465 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.wsgi [None req-150bfcd3-8c04-44c5-9e36-b262af4a6086 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] HTTP exception thrown: Instance 4a6929a0-8c3d-4474-8ffa-b2777251fa48 could not be found. Jul 26 07:28:47.670222 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-150bfcd3-8c04-44c5-9e36-b262af4a6086 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Request method failure captured: Jul 26 07:28:47.670222 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: request: GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48 HTTP/1.1 Jul 26 07:28:47.670222 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept: application/json Jul 26 07:28:47.670222 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept-Encoding: identity Jul 26 07:28:47.670222 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Connection: close Jul 26 07:28:47.670222 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Length: 0 Jul 26 07:28:47.670222 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Type: application/json Jul 26 07:28:47.670222 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Host: 10.222.0.39 Jul 26 07:28:47.670222 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Openstack-System-Scope: None Jul 26 07:28:47.670222 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: User-Agent: python-urllib3/1.26.10 Jul 26 07:28:47.670222 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Auth-Token: gAAAAABi35dcAO8QEYiwXxlg_cR8oiE7Hwy0iZhQ8pghKDIoBWeeZLHnfGOrA-tAINLCvLmjgZ8DXcKM-6HcdW-_cte8vx6wOmPDkNxFu3Tq2KRXoyL-dKEyy-Chou-bK1Y_ec9q5nb167hU-Wro_2cDyQZYpTHbATL9nRsb0PT0pXTMtBLrbiQ Jul 26 07:28:47.670222 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Id: None Jul 26 07:28:47.670222 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Name: None Jul 26 07:28:47.670222 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Identity-Status: Confirmed Jul 26 07:28:47.670222 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Is-Admin-Project: True Jul 26 07:28:47.670222 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Id: default Jul 26 07:28:47.670222 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Name: Default Jul 26 07:28:47.670222 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Id: 6fc12ef80ee841f5af4bc2d56966cadc Jul 26 07:28:47.670222 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1328426109 Jul 26 07:28:47.670222 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Role: member,reader Jul 26 07:28:47.670222 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Roles: member,reader Jul 26 07:28:47.671775 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6fc12ef80ee841f5af4bc2d56966cadc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6fc12ef80ee841f5af4bc2d56966cadc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6fc12ef80ee841f5af4bc2d56966cadc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6fc12ef80ee841f5af4bc2d56966cadc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:28:47.671775 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant: tempest-VolumesSnapshotTestJSON-1328426109 Jul 26 07:28:47.671775 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Id: 6fc12ef80ee841f5af4bc2d56966cadc Jul 26 07:28:47.671775 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1328426109 Jul 26 07:28:47.671775 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User: tempest-VolumesSnapshotTestJSON-1328426109-project Jul 26 07:28:47.671775 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Id: default Jul 26 07:28:47.671775 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Name: Default Jul 26 07:28:47.671775 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Id: c394476504af4c1d8bea462a5113cebc Jul 26 07:28:47.671775 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Name: tempest-VolumesSnapshotTestJSON-1328426109-project Jul 26 07:28:47.671775 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: method: > Jul 26 07:28:47.671775 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: exception: Instance 4a6929a0-8c3d-4474-8ffa-b2777251fa48 could not be found. Jul 26 07:28:47.671775 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: action_args: {'id': '4a6929a0-8c3d-4474-8ffa-b2777251fa48'} Jul 26 07:28:47.672694 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:28:47.672694 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:28:47.672694 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 07:28:47.672694 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 07:28:47.672694 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 07:28:47.672694 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 07:28:47.672694 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 07:28:47.672694 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 07:28:47.672694 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 07:28:47.672694 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 07:28:47.672694 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a6929a0-8c3d-4474-8ffa-b2777251fa48 could not be found. Jul 26 07:28:47.672694 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:28:47.672694 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:28:47.672694 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:28:47.672694 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:28:47.672694 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:28:47.672694 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:28:47.672694 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:28:47.672694 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:28:47.672694 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:28:47.674172 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:28:47.674172 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 07:28:47.674172 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 07:28:47.674172 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 07:28:47.674172 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 07:28:47.674172 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 07:28:47.674172 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:28:47.674172 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a6929a0-8c3d-4474-8ffa-b2777251fa48 could not be found. Jul 26 07:28:47.674172 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:28:47.674172 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:28:47.674172 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:28:47.674172 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:28:47.674172 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:28:47.674172 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:28:47.674172 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:28:47.674172 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:28:47.674172 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a6929a0-8c3d-4474-8ffa-b2777251fa48 could not be found. Jul 26 07:28:47.674172 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:28:47.675452 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-150bfcd3-8c04-44c5-9e36-b262af4a6086 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Returning 404 to user: Instance 4a6929a0-8c3d-4474-8ffa-b2777251fa48 could not be found. {{(pid=117715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:28:47.675452 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-150bfcd3-8c04-44c5-9e36-b262af4a6086 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48" status: 404 len: 111 microversion: 2.1 time: 0.032103 Jul 26 07:28:47.675452 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 243/443] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:28:47 2022] GET /compute/v2.1/servers/4a6929a0-8c3d-4474-8ffa-b2777251fa48 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 07:28:48.666654 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7724a873-2408-447c-9c16-d9d1a192472a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:48.667277 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7724a873-2408-447c-9c16-d9d1a192472a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:48.674600 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7724a873-2408-447c-9c16-d9d1a192472a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:48.675044 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7724a873-2408-447c-9c16-d9d1a192472a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:48.675825 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7724a873-2408-447c-9c16-d9d1a192472a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:48.676252 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7724a873-2408-447c-9c16-d9d1a192472a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:48.833018 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7724a873-2408-447c-9c16-d9d1a192472a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:48.842554 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7724a873-2408-447c-9c16-d9d1a192472a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:48.844596 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7724a873-2408-447c-9c16-d9d1a192472a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:48.846093 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7724a873-2408-447c-9c16-d9d1a192472a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1810 microversion: 2.20 time: 0.183476 Jul 26 07:28:48.846803 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 201/444] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:48 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1810 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:28:49.870868 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-53d12e04-18c3-4a38-b316-e503bf08656f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:49.871455 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-53d12e04-18c3-4a38-b316-e503bf08656f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:49.878353 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-53d12e04-18c3-4a38-b316-e503bf08656f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:49.878793 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-53d12e04-18c3-4a38-b316-e503bf08656f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:49.879598 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-53d12e04-18c3-4a38-b316-e503bf08656f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:49.880027 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-53d12e04-18c3-4a38-b316-e503bf08656f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:50.030233 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-53d12e04-18c3-4a38-b316-e503bf08656f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:50.040394 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-53d12e04-18c3-4a38-b316-e503bf08656f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:50.041939 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-53d12e04-18c3-4a38-b316-e503bf08656f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:50.043368 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-53d12e04-18c3-4a38-b316-e503bf08656f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1810 microversion: 2.20 time: 0.176401 Jul 26 07:28:50.043976 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 244/445] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:49 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1810 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:28:51.067854 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2e63a7e2-8476-4c32-ab91-3db344e351dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:51.068528 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2e63a7e2-8476-4c32-ab91-3db344e351dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:51.076316 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2e63a7e2-8476-4c32-ab91-3db344e351dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:51.076762 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2e63a7e2-8476-4c32-ab91-3db344e351dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:51.077550 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2e63a7e2-8476-4c32-ab91-3db344e351dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:51.078016 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2e63a7e2-8476-4c32-ab91-3db344e351dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:51.247478 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2e63a7e2-8476-4c32-ab91-3db344e351dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:51.259825 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2e63a7e2-8476-4c32-ab91-3db344e351dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:51.261426 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2e63a7e2-8476-4c32-ab91-3db344e351dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:51.262736 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2e63a7e2-8476-4c32-ab91-3db344e351dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1810 microversion: 2.20 time: 0.199449 Jul 26 07:28:51.263323 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 202/446] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:51 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1810 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 07:28:52.287144 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-cab9b253-0240-428a-a8ee-2f7f520de1d9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:52.287683 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-cab9b253-0240-428a-a8ee-2f7f520de1d9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:52.294071 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cab9b253-0240-428a-a8ee-2f7f520de1d9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:52.294546 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cab9b253-0240-428a-a8ee-2f7f520de1d9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:52.295310 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cab9b253-0240-428a-a8ee-2f7f520de1d9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:52.295735 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cab9b253-0240-428a-a8ee-2f7f520de1d9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:52.438118 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-cab9b253-0240-428a-a8ee-2f7f520de1d9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:52.447206 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-cab9b253-0240-428a-a8ee-2f7f520de1d9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:52.448686 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-cab9b253-0240-428a-a8ee-2f7f520de1d9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:52.449927 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-cab9b253-0240-428a-a8ee-2f7f520de1d9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1810 microversion: 2.20 time: 0.166899 Jul 26 07:28:52.450473 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 245/447] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:52 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:28:53.473794 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-11fac795-a93c-400c-92b1-bd4b4401999e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:53.474410 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-11fac795-a93c-400c-92b1-bd4b4401999e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:53.481707 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-11fac795-a93c-400c-92b1-bd4b4401999e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:53.482296 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-11fac795-a93c-400c-92b1-bd4b4401999e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:53.483110 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-11fac795-a93c-400c-92b1-bd4b4401999e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:53.483549 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-11fac795-a93c-400c-92b1-bd4b4401999e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:53.626929 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-11fac795-a93c-400c-92b1-bd4b4401999e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:53.638929 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-11fac795-a93c-400c-92b1-bd4b4401999e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:53.640446 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-11fac795-a93c-400c-92b1-bd4b4401999e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:53.641675 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-11fac795-a93c-400c-92b1-bd4b4401999e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1810 microversion: 2.20 time: 0.172490 Jul 26 07:28:53.642484 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 203/448] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:53 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:28:54.116465 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-d21e2b79-1c22-4358-9eb8-0ae37fe728e2 req-b64bd6df-abcf-42d0-aedf-d3b900035f85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "990571a8-aa04-4aac-921c-cf071eca1dd0", "name": "network-vif-plugged", "status": "completed", "tag": "06f98651-1a4f-4f3c-a886-1d5aad025305"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:28:54.126808 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-d21e2b79-1c22-4358-9eb8-0ae37fe728e2 req-b64bd6df-abcf-42d0-aedf-d3b900035f85 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:54.127254 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-d21e2b79-1c22-4358-9eb8-0ae37fe728e2 req-b64bd6df-abcf-42d0-aedf-d3b900035f85 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:54.140303 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-d21e2b79-1c22-4358-9eb8-0ae37fe728e2 req-b64bd6df-abcf-42d0-aedf-d3b900035f85 service nova] Creating event network-vif-plugged:06f98651-1a4f-4f3c-a886-1d5aad025305 for instance 990571a8-aa04-4aac-921c-cf071eca1dd0 on hv-cinder-85083 Jul 26 07:28:54.145772 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-d21e2b79-1c22-4358-9eb8-0ae37fe728e2 req-b64bd6df-abcf-42d0-aedf-d3b900035f85 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032990 Jul 26 07:28:54.146380 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 246/449] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 07:28:54.668822 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-39b36f93-1969-4cc1-8adb-5d5275745c75 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:54.669513 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-39b36f93-1969-4cc1-8adb-5d5275745c75 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:54.677708 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-39b36f93-1969-4cc1-8adb-5d5275745c75 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:54.678417 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-39b36f93-1969-4cc1-8adb-5d5275745c75 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:54.679405 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-39b36f93-1969-4cc1-8adb-5d5275745c75 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:54.679852 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-39b36f93-1969-4cc1-8adb-5d5275745c75 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:54.843461 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-39b36f93-1969-4cc1-8adb-5d5275745c75 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:54.853104 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-39b36f93-1969-4cc1-8adb-5d5275745c75 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:54.854773 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-39b36f93-1969-4cc1-8adb-5d5275745c75 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:54.855999 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-39b36f93-1969-4cc1-8adb-5d5275745c75 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1810 microversion: 2.20 time: 0.191605 Jul 26 07:28:54.856562 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 204/450] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:54 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1810 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:28:55.880980 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-540739ca-3077-48c1-a39f-c99abed095d9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:55.881775 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-540739ca-3077-48c1-a39f-c99abed095d9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:55.889023 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-540739ca-3077-48c1-a39f-c99abed095d9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:55.889473 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-540739ca-3077-48c1-a39f-c99abed095d9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:55.890280 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-540739ca-3077-48c1-a39f-c99abed095d9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:55.890715 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-540739ca-3077-48c1-a39f-c99abed095d9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:56.045321 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-540739ca-3077-48c1-a39f-c99abed095d9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:56.055050 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-540739ca-3077-48c1-a39f-c99abed095d9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:56.056631 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-540739ca-3077-48c1-a39f-c99abed095d9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:56.057893 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-540739ca-3077-48c1-a39f-c99abed095d9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1810 microversion: 2.20 time: 0.181810 Jul 26 07:28:56.058470 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 247/451] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:55 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1810 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:28:57.082040 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-84130ae0-3e9b-4b5d-afe3-2f89c8636f70 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:57.082761 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-84130ae0-3e9b-4b5d-afe3-2f89c8636f70 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:57.090707 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-84130ae0-3e9b-4b5d-afe3-2f89c8636f70 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:57.091193 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-84130ae0-3e9b-4b5d-afe3-2f89c8636f70 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:57.092086 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-84130ae0-3e9b-4b5d-afe3-2f89c8636f70 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:57.092879 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-84130ae0-3e9b-4b5d-afe3-2f89c8636f70 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:57.238086 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-84130ae0-3e9b-4b5d-afe3-2f89c8636f70 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:57.254497 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-84130ae0-3e9b-4b5d-afe3-2f89c8636f70 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:57.257570 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-84130ae0-3e9b-4b5d-afe3-2f89c8636f70 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:57.259884 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-84130ae0-3e9b-4b5d-afe3-2f89c8636f70 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1810 microversion: 2.20 time: 0.181914 Jul 26 07:28:57.260912 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 205/452] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:57 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1810 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:28:58.294077 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-281d2908-d455-4daf-90ce-bd0b5117e517 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:58.294737 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-281d2908-d455-4daf-90ce-bd0b5117e517 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:58.301559 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-281d2908-d455-4daf-90ce-bd0b5117e517 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:58.302036 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-281d2908-d455-4daf-90ce-bd0b5117e517 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:58.302875 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-281d2908-d455-4daf-90ce-bd0b5117e517 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:58.303306 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-281d2908-d455-4daf-90ce-bd0b5117e517 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:58.495037 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-281d2908-d455-4daf-90ce-bd0b5117e517 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:58.507366 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-281d2908-d455-4daf-90ce-bd0b5117e517 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:58.509224 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-281d2908-d455-4daf-90ce-bd0b5117e517 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:58.511300 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-281d2908-d455-4daf-90ce-bd0b5117e517 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1810 microversion: 2.20 time: 0.221182 Jul 26 07:28:58.511878 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 248/453] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:58 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1810 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:28:59.543507 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-1e195507-0381-4da6-b900-1e10b3f309fc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:28:59.544545 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-1e195507-0381-4da6-b900-1e10b3f309fc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:28:59.551560 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1e195507-0381-4da6-b900-1e10b3f309fc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:59.552020 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1e195507-0381-4da6-b900-1e10b3f309fc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:59.553025 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1e195507-0381-4da6-b900-1e10b3f309fc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:28:59.553452 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1e195507-0381-4da6-b900-1e10b3f309fc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:28:59.710603 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-1e195507-0381-4da6-b900-1e10b3f309fc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:59.720439 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-1e195507-0381-4da6-b900-1e10b3f309fc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:59.721978 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-1e195507-0381-4da6-b900-1e10b3f309fc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:28:59.723169 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-1e195507-0381-4da6-b900-1e10b3f309fc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1810 microversion: 2.20 time: 0.183853 Jul 26 07:28:59.723736 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 206/454] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:28:59 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1810 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:29:00.746489 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8ccfa20c-01c6-4ef9-8dba-d05ac9a4e271 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:00.747216 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8ccfa20c-01c6-4ef9-8dba-d05ac9a4e271 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:00.749459 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:00.758131 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ccfa20c-01c6-4ef9-8dba-d05ac9a4e271 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:00.758658 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ccfa20c-01c6-4ef9-8dba-d05ac9a4e271 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:00.759454 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ccfa20c-01c6-4ef9-8dba-d05ac9a4e271 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:00.759890 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ccfa20c-01c6-4ef9-8dba-d05ac9a4e271 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:00.849123 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-958cc026-5835-4419-ac90-3d491df6b0e1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-842490637", "imageRef": "b9589773-813f-42af-846a-43bcf9d4d002", "flavorRef": "452", "networks": [{"uuid": "3f043156-d4d9-403b-ac18-d8486e3ebf15"}]}} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:29:00.924262 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.network.neutron [None req-958cc026-5835-4419-ac90-3d491df6b0e1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] validate_networks() for [('3f043156-d4d9-403b-ac18-d8486e3ebf15', None, None, None, None, None)] {{(pid=117716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 07:29:00.941103 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8ccfa20c-01c6-4ef9-8dba-d05ac9a4e271 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:00.950019 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8ccfa20c-01c6-4ef9-8dba-d05ac9a4e271 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:00.951649 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8ccfa20c-01c6-4ef9-8dba-d05ac9a4e271 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:00.952825 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8ccfa20c-01c6-4ef9-8dba-d05ac9a4e271 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1810 microversion: 2.20 time: 0.210479 Jul 26 07:29:00.953416 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 249/455] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:29:00 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1810 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:29:01.313852 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-958cc026-5835-4419-ac90-3d491df6b0e1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Flavor limits 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 07:29:01.314275 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-958cc026-5835-4419-ac90-3d491df6b0e1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Image limits 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 07:29:01.314749 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-958cc026-5835-4419-ac90-3d491df6b0e1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Flavor pref 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 07:29:01.315151 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-958cc026-5835-4419-ac90-3d491df6b0e1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Image pref 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 07:29:01.315562 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-958cc026-5835-4419-ac90-3d491df6b0e1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 07:29:01.325441 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-958cc026-5835-4419-ac90-3d491df6b0e1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:01.325957 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-958cc026-5835-4419-ac90-3d491df6b0e1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:01.326730 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-958cc026-5835-4419-ac90-3d491df6b0e1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:01.327167 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-958cc026-5835-4419-ac90-3d491df6b0e1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:01.346547 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.quota [None req-958cc026-5835-4419-ac90-3d491df6b0e1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Getting quotas for project 6fc12ef80ee841f5af4bc2d56966cadc. Resources: {'instances', 'cores', 'ram'} {{(pid=117716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 07:29:01.351465 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.quota [None req-958cc026-5835-4419-ac90-3d491df6b0e1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Getting quotas for user c394476504af4c1d8bea462a5113cebc and project 6fc12ef80ee841f5af4bc2d56966cadc. Resources: {'instances', 'cores', 'ram'} {{(pid=117716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 07:29:01.365145 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-958cc026-5835-4419-ac90-3d491df6b0e1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Going to run 1 instances... {{(pid=117716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 07:29:01.367524 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-958cc026-5835-4419-ac90-3d491df6b0e1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9589773-813f-42af-846a-43bcf9d4d002',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 07:29:01.420871 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-958cc026-5835-4419-ac90-3d491df6b0e1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.575717 Jul 26 07:29:01.421876 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 207/456] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Jul 26 07:29:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 07:29:01.436540 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3f0ca845-226e-4714-9938-f832459af8f4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:01.437557 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3f0ca845-226e-4714-9938-f832459af8f4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:01.508185 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3f0ca845-226e-4714-9938-f832459af8f4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:01.520882 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3f0ca845-226e-4714-9938-f832459af8f4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1218 microversion: 2.1 time: 0.091201 Jul 26 07:29:01.522196 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 250/457] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:01 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:01.978976 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-79ca15e5-316f-4d55-a7f1-3e0135db5034 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:01.979935 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-79ca15e5-316f-4d55-a7f1-3e0135db5034 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:01.990602 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-79ca15e5-316f-4d55-a7f1-3e0135db5034 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:01.991054 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-79ca15e5-316f-4d55-a7f1-3e0135db5034 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:01.992827 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-79ca15e5-316f-4d55-a7f1-3e0135db5034 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:01.993361 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-79ca15e5-316f-4d55-a7f1-3e0135db5034 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:02.164816 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-79ca15e5-316f-4d55-a7f1-3e0135db5034 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:02.176828 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-79ca15e5-316f-4d55-a7f1-3e0135db5034 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:02.178973 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-79ca15e5-316f-4d55-a7f1-3e0135db5034 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:02.180437 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-79ca15e5-316f-4d55-a7f1-3e0135db5034 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1810 microversion: 2.20 time: 0.207768 Jul 26 07:29:02.181087 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 208/458] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:29:01 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1810 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:29:02.558964 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a06a8734-a4dd-4b4a-aa2e-0b979d3460d6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:02.561002 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a06a8734-a4dd-4b4a-aa2e-0b979d3460d6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:02.572425 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a06a8734-a4dd-4b4a-aa2e-0b979d3460d6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:02.573496 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a06a8734-a4dd-4b4a-aa2e-0b979d3460d6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:02.575158 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a06a8734-a4dd-4b4a-aa2e-0b979d3460d6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:02.576052 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a06a8734-a4dd-4b4a-aa2e-0b979d3460d6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:02.703473 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-a06a8734-a4dd-4b4a-aa2e-0b979d3460d6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:02.722746 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a06a8734-a4dd-4b4a-aa2e-0b979d3460d6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1270 microversion: 2.1 time: 0.170584 Jul 26 07:29:02.733383 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 251/459] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:02 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1270 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:03.204432 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-90711c0f-1313-439b-8fe9-e7f3ce38b487 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:03.205045 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-90711c0f-1313-439b-8fe9-e7f3ce38b487 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:03.207581 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:03.214353 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-90711c0f-1313-439b-8fe9-e7f3ce38b487 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:03.214835 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-90711c0f-1313-439b-8fe9-e7f3ce38b487 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:03.215655 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-90711c0f-1313-439b-8fe9-e7f3ce38b487 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:03.216134 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-90711c0f-1313-439b-8fe9-e7f3ce38b487 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:03.422099 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-90711c0f-1313-439b-8fe9-e7f3ce38b487 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:03.431898 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-90711c0f-1313-439b-8fe9-e7f3ce38b487 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:03.433480 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-90711c0f-1313-439b-8fe9-e7f3ce38b487 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:03.434811 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-90711c0f-1313-439b-8fe9-e7f3ce38b487 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1797 microversion: 2.20 time: 0.234577 Jul 26 07:29:03.445780 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 209/460] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:29:03 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1797 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:29:03.751076 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-fd419044-eddb-4419-a710-77cfa3382353 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:03.751833 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-fd419044-eddb-4419-a710-77cfa3382353 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:03.758666 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fd419044-eddb-4419-a710-77cfa3382353 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:03.759215 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fd419044-eddb-4419-a710-77cfa3382353 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:03.760110 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fd419044-eddb-4419-a710-77cfa3382353 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:03.760619 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fd419044-eddb-4419-a710-77cfa3382353 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:03.916935 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-fd419044-eddb-4419-a710-77cfa3382353 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:03.925324 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-fd419044-eddb-4419-a710-77cfa3382353 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1318 microversion: 2.1 time: 0.178442 Jul 26 07:29:03.926040 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 252/461] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:03 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:04.454646 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-17b3548e-8aeb-4e16-905a-ad889759fcfa req-61a5738b-81f0-45d2-8342-904af828f901 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c87e5af-1321-4b95-86a4-6e094fa1d61f", "tag": "73dd8ccd-92c0-40af-8e88-e8a03c94989c"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:29:04.479582 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-17b3548e-8aeb-4e16-905a-ad889759fcfa req-61a5738b-81f0-45d2-8342-904af828f901 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:04.480056 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-17b3548e-8aeb-4e16-905a-ad889759fcfa req-61a5738b-81f0-45d2-8342-904af828f901 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:04.494039 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-17b3548e-8aeb-4e16-905a-ad889759fcfa req-61a5738b-81f0-45d2-8342-904af828f901 service nova] Creating event network-changed:73dd8ccd-92c0-40af-8e88-e8a03c94989c for instance 8c87e5af-1321-4b95-86a4-6e094fa1d61f on hv-cinder-85083 Jul 26 07:29:04.499520 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-17b3548e-8aeb-4e16-905a-ad889759fcfa req-61a5738b-81f0-45d2-8342-904af828f901 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053293 Jul 26 07:29:04.500556 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 210/462] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:29:04.959421 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-5332d210-722c-4650-b3e5-85bedab0d1eb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:04.960051 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-5332d210-722c-4650-b3e5-85bedab0d1eb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:04.967040 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5332d210-722c-4650-b3e5-85bedab0d1eb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:04.967847 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5332d210-722c-4650-b3e5-85bedab0d1eb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:04.968658 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5332d210-722c-4650-b3e5-85bedab0d1eb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:04.969117 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5332d210-722c-4650-b3e5-85bedab0d1eb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:05.106682 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-5332d210-722c-4650-b3e5-85bedab0d1eb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:05.114691 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-5332d210-722c-4650-b3e5-85bedab0d1eb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1318 microversion: 2.1 time: 0.159103 Jul 26 07:29:05.115274 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 253/463] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:04 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:06.136100 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-24fbd384-c2b1-4be6-9052-08c9aa53a06e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:06.137080 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-24fbd384-c2b1-4be6-9052-08c9aa53a06e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:06.144871 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-24fbd384-c2b1-4be6-9052-08c9aa53a06e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:06.145326 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-24fbd384-c2b1-4be6-9052-08c9aa53a06e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:06.146144 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-24fbd384-c2b1-4be6-9052-08c9aa53a06e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:06.146575 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-24fbd384-c2b1-4be6-9052-08c9aa53a06e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:06.291677 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-24fbd384-c2b1-4be6-9052-08c9aa53a06e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:06.300820 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-24fbd384-c2b1-4be6-9052-08c9aa53a06e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1318 microversion: 2.1 time: 0.168423 Jul 26 07:29:06.312220 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 211/464] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:06 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:07.323670 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a24302c0-d0ad-4cee-816a-64caeed01202 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:07.324896 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a24302c0-d0ad-4cee-816a-64caeed01202 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:07.332542 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a24302c0-d0ad-4cee-816a-64caeed01202 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:07.333305 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a24302c0-d0ad-4cee-816a-64caeed01202 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:07.334464 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a24302c0-d0ad-4cee-816a-64caeed01202 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:07.334932 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a24302c0-d0ad-4cee-816a-64caeed01202 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:07.610648 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-a24302c0-d0ad-4cee-816a-64caeed01202 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:07.619042 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a24302c0-d0ad-4cee-816a-64caeed01202 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1318 microversion: 2.1 time: 0.300724 Jul 26 07:29:07.619627 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 254/465] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:07 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1318 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:08.653268 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-45aec697-777b-4349-8416-f65d32f12d5b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:08.654081 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-45aec697-777b-4349-8416-f65d32f12d5b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:08.661403 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-45aec697-777b-4349-8416-f65d32f12d5b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:08.661915 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-45aec697-777b-4349-8416-f65d32f12d5b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:08.662777 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-45aec697-777b-4349-8416-f65d32f12d5b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:08.663195 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-45aec697-777b-4349-8416-f65d32f12d5b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:08.833608 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-45aec697-777b-4349-8416-f65d32f12d5b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:08.846482 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-45aec697-777b-4349-8416-f65d32f12d5b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1318 microversion: 2.1 time: 0.196857 Jul 26 07:29:08.847536 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 212/466] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:08 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:09.869478 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d0fb0c7f-27f3-4c20-8120-af8599aaec21 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:09.870295 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d0fb0c7f-27f3-4c20-8120-af8599aaec21 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:09.877340 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d0fb0c7f-27f3-4c20-8120-af8599aaec21 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:09.877947 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d0fb0c7f-27f3-4c20-8120-af8599aaec21 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:09.878990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d0fb0c7f-27f3-4c20-8120-af8599aaec21 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:09.879506 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d0fb0c7f-27f3-4c20-8120-af8599aaec21 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:09.901553 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:10.027171 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7799f665-7b23-48e8-afe3-72356536909e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:10.028593 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7799f665-7b23-48e8-afe3-72356536909e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: e5a904a1-f100-432e-8c8c-f3dc187c3a0c] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:10.037199 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7799f665-7b23-48e8-afe3-72356536909e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:10.037199 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7799f665-7b23-48e8-afe3-72356536909e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:10.037944 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7799f665-7b23-48e8-afe3-72356536909e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:10.038667 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7799f665-7b23-48e8-afe3-72356536909e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:10.070125 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7799f665-7b23-48e8-afe3-72356536909e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c/ips" status: 200 len: 149 microversion: 2.1 time: 0.047043 Jul 26 07:29:10.077610 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 213/467] 10.222.0.39 () {58 vars in 1248 bytes} [Tue Jul 26 07:29:10 2022] GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c/ips => generated 149 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:29:10.083429 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-35fbce9a-1292-4218-b7d8-3ddf8907a959 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3118ec4-ef49-472f-8c6a-e76ced59cdf9"}} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:29:10.086294 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-35fbce9a-1292-4218-b7d8-3ddf8907a959 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: e5a904a1-f100-432e-8c8c-f3dc187c3a0c] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:10.093590 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-35fbce9a-1292-4218-b7d8-3ddf8907a959 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:10.094337 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-35fbce9a-1292-4218-b7d8-3ddf8907a959 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:10.095320 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-35fbce9a-1292-4218-b7d8-3ddf8907a959 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:10.095755 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-35fbce9a-1292-4218-b7d8-3ddf8907a959 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:10.110918 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d0fb0c7f-27f3-4c20-8120-af8599aaec21 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:10.125115 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d0fb0c7f-27f3-4c20-8120-af8599aaec21 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1318 microversion: 2.1 time: 0.259510 Jul 26 07:29:10.126822 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 255/468] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:09 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:10.203321 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.wsgi [None req-35fbce9a-1292-4218-b7d8-3ddf8907a959 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] HTTP exception thrown: Invalid volume: volume a3118ec4-ef49-472f-8c6a-e76ced59cdf9 is already attached to instances: c0b50e8b-a23c-4aa8-826e-3e2141006ede Jul 26 07:29:10.205467 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-35fbce9a-1292-4218-b7d8-3ddf8907a959 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Request method failure captured: Jul 26 07:29:10.205467 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: request: POST /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c/os-volume_attachments HTTP/1.1 Jul 26 07:29:10.205467 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept: application/json Jul 26 07:29:10.205467 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept-Encoding: identity Jul 26 07:29:10.205467 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Connection: close Jul 26 07:29:10.205467 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Length: 74 Jul 26 07:29:10.205467 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Type: application/json Jul 26 07:29:10.205467 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Host: 10.222.0.39 Jul 26 07:29:10.205467 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Openstack-System-Scope: None Jul 26 07:29:10.205467 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: User-Agent: python-urllib3/1.26.10 Jul 26 07:29:10.205467 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Auth-Token: gAAAAABi35bp-6MDlHFX6PqBP1JfjI-kDaErGZ8tS4CYMVgobtb4Gv-rSD0l-rBJa-iOQtbMEcv7gnFG6FuqSpAXwRcnDvooOo8YQBTuYFKMeWkJlsSVbvRshSqswhfLq3PM2Jh4Afd8RHIhCtF_ajjZyUKtQPL35KmYg8DZArwcVpy_HW9N5Qc Jul 26 07:29:10.205467 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Id: None Jul 26 07:29:10.205467 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Name: None Jul 26 07:29:10.205467 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Identity-Status: Confirmed Jul 26 07:29:10.205467 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Is-Admin-Project: True Jul 26 07:29:10.205467 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Id: default Jul 26 07:29:10.205467 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Name: Default Jul 26 07:29:10.205467 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Id: 4fa0c5574ef9497ebe29658f8164764c Jul 26 07:29:10.205467 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Name: tempest-AttachVolumeNegativeTest-1485570437 Jul 26 07:29:10.205467 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Role: member,reader Jul 26 07:29:10.205467 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Roles: member,reader Jul 26 07:29:10.206898 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:29:10.206898 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant: tempest-AttachVolumeNegativeTest-1485570437 Jul 26 07:29:10.206898 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Id: 4fa0c5574ef9497ebe29658f8164764c Jul 26 07:29:10.206898 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1485570437 Jul 26 07:29:10.206898 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User: tempest-AttachVolumeNegativeTest-1485570437-project Jul 26 07:29:10.206898 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Id: default Jul 26 07:29:10.206898 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Name: Default Jul 26 07:29:10.206898 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Id: 57029844165f4d83892176fe82594685 Jul 26 07:29:10.206898 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Name: tempest-AttachVolumeNegativeTest-1485570437-project Jul 26 07:29:10.206898 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Jul 26 07:29:10.206898 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: {"volumeAttachment": {"volumeId": "a3118ec4-ef49-472f-8c6a-e76ced59cdf9"}} Jul 26 07:29:10.206898 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: method: > Jul 26 07:29:10.207744 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: exception: Invalid volume: volume a3118ec4-ef49-472f-8c6a-e76ced59cdf9 is already attached to instances: c0b50e8b-a23c-4aa8-826e-3e2141006ede Jul 26 07:29:10.207744 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: action_args: {'server_id': 'e5a904a1-f100-432e-8c8c-f3dc187c3a0c', 'body': {'volumeAttachment': {'volumeId': 'a3118ec4-ef49-472f-8c6a-e76ced59cdf9'}}} Jul 26 07:29:10.207744 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:29:10.207744 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:29:10.207744 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 26 07:29:10.207744 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 26 07:29:10.207744 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 07:29:10.207744 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 07:29:10.207744 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 26 07:29:10.207744 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 07:29:10.207744 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 26 07:29:10.207744 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 26 07:29:10.207744 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 26 07:29:10.207744 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 26 07:29:10.207744 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a3118ec4-ef49-472f-8c6a-e76ced59cdf9 is already attached to instances: c0b50e8b-a23c-4aa8-826e-3e2141006ede Jul 26 07:29:10.207744 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:29:10.207744 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:29:10.207744 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:29:10.207744 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:29:10.208886 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:29:10.208886 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:29:10.208886 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:29:10.208886 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:29:10.208886 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:29:10.208886 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:29:10.208886 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 07:29:10.208886 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 07:29:10.208886 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 07:29:10.208886 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 07:29:10.208886 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 07:29:10.208886 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 07:29:10.208886 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 26 07:29:10.208886 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 26 07:29:10.208886 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a3118ec4-ef49-472f-8c6a-e76ced59cdf9 is already attached to instances: c0b50e8b-a23c-4aa8-826e-3e2141006ede Jul 26 07:29:10.208886 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:29:10.208886 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:29:10.208886 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:29:10.208886 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:29:10.208886 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:29:10.210156 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:29:10.210156 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:29:10.210156 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:29:10.210156 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a3118ec4-ef49-472f-8c6a-e76ced59cdf9 is already attached to instances: c0b50e8b-a23c-4aa8-826e-3e2141006ede Jul 26 07:29:10.210156 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:29:10.212145 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-35fbce9a-1292-4218-b7d8-3ddf8907a959 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Returning 400 to user: Invalid volume: volume a3118ec4-ef49-472f-8c6a-e76ced59cdf9 is already attached to instances: c0b50e8b-a23c-4aa8-826e-3e2141006ede {{(pid=117716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:29:10.213265 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-35fbce9a-1292-4218-b7d8-3ddf8907a959 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "POST /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.134287 Jul 26 07:29:10.214073 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 214/469] 10.222.0.39 () {60 vars in 1323 bytes} [Tue Jul 26 07:29:10 2022] POST /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c/os-volume_attachments => generated 174 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 07:29:10.224080 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-da2712c3-0d04-495d-bc2b-2ad5d6a17e6d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:10.224700 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-da2712c3-0d04-495d-bc2b-2ad5d6a17e6d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: e5a904a1-f100-432e-8c8c-f3dc187c3a0c] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:10.232955 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-da2712c3-0d04-495d-bc2b-2ad5d6a17e6d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:10.233644 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-da2712c3-0d04-495d-bc2b-2ad5d6a17e6d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:10.234764 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-da2712c3-0d04-495d-bc2b-2ad5d6a17e6d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:10.235189 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-da2712c3-0d04-495d-bc2b-2ad5d6a17e6d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:10.265712 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-da2712c3-0d04-495d-bc2b-2ad5d6a17e6d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: e5a904a1-f100-432e-8c8c-f3dc187c3a0c] Going to try to terminate instance {{(pid=117715) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 07:29:10.370956 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-da2712c3-0d04-495d-bc2b-2ad5d6a17e6d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c" status: 204 len: 0 microversion: 2.1 time: 0.150212 Jul 26 07:29:10.375192 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 256/470] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Jul 26 07:29:10 2022] DELETE /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 07:29:10.382644 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c536a1c2-bcdd-4add-9e45-74955a53320f tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:10.383809 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c536a1c2-bcdd-4add-9e45-74955a53320f tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: e5a904a1-f100-432e-8c8c-f3dc187c3a0c] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:10.395031 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c536a1c2-bcdd-4add-9e45-74955a53320f tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:10.395928 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c536a1c2-bcdd-4add-9e45-74955a53320f tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:10.397204 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c536a1c2-bcdd-4add-9e45-74955a53320f tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:10.401039 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c536a1c2-bcdd-4add-9e45-74955a53320f tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:10.450896 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-529d31f1-3cad-43f6-a28a-3b3bf67a6f16 req-1abddf77-887b-464a-ad49-bbbbf830eccf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c87e5af-1321-4b95-86a4-6e094fa1d61f", "name": "network-vif-plugged", "status": "completed", "tag": "73dd8ccd-92c0-40af-8e88-e8a03c94989c"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:29:10.483093 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-529d31f1-3cad-43f6-a28a-3b3bf67a6f16 req-1abddf77-887b-464a-ad49-bbbbf830eccf service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:10.485664 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-529d31f1-3cad-43f6-a28a-3b3bf67a6f16 req-1abddf77-887b-464a-ad49-bbbbf830eccf service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:10.514130 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-529d31f1-3cad-43f6-a28a-3b3bf67a6f16 req-1abddf77-887b-464a-ad49-bbbbf830eccf service nova] Creating event network-vif-plugged:73dd8ccd-92c0-40af-8e88-e8a03c94989c for instance 8c87e5af-1321-4b95-86a4-6e094fa1d61f on hv-cinder-85083 Jul 26 07:29:10.522784 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-529d31f1-3cad-43f6-a28a-3b3bf67a6f16 req-1abddf77-887b-464a-ad49-bbbbf830eccf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086685 Jul 26 07:29:10.523512 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 257/471] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 07:29:10.698885 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-c536a1c2-bcdd-4add-9e45-74955a53320f tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:10.707840 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:10.712498 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c536a1c2-bcdd-4add-9e45-74955a53320f tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c" status: 200 len: 1680 microversion: 2.1 time: 0.334903 Jul 26 07:29:10.713596 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 215/472] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:10 2022] GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c => generated 1680 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:11.148742 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-add76f5c-31b3-4dc5-b5ac-087d75d62b50 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:11.150485 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-add76f5c-31b3-4dc5-b5ac-087d75d62b50 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:11.158944 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-add76f5c-31b3-4dc5-b5ac-087d75d62b50 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:11.159751 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-add76f5c-31b3-4dc5-b5ac-087d75d62b50 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:11.160891 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-add76f5c-31b3-4dc5-b5ac-087d75d62b50 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:11.162314 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-add76f5c-31b3-4dc5-b5ac-087d75d62b50 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:11.410956 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-add76f5c-31b3-4dc5-b5ac-087d75d62b50 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:11.420900 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-add76f5c-31b3-4dc5-b5ac-087d75d62b50 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1318 microversion: 2.1 time: 0.277285 Jul 26 07:29:11.421484 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 258/473] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:11 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:11.739863 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-66083998-7375-42b2-bd3d-6ff3a1d1babb tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:11.741088 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-66083998-7375-42b2-bd3d-6ff3a1d1babb tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: e5a904a1-f100-432e-8c8c-f3dc187c3a0c] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:11.751376 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell0:SELECT=2 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:11.754404 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell0:SELECT=6 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:11.759813 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-66083998-7375-42b2-bd3d-6ff3a1d1babb tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:11.761863 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-66083998-7375-42b2-bd3d-6ff3a1d1babb tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:11.762942 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-66083998-7375-42b2-bd3d-6ff3a1d1babb tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:11.768000 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-66083998-7375-42b2-bd3d-6ff3a1d1babb tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:12.035107 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-66083998-7375-42b2-bd3d-6ff3a1d1babb tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:12.045352 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-66083998-7375-42b2-bd3d-6ff3a1d1babb tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c" status: 200 len: 1680 microversion: 2.1 time: 0.309411 Jul 26 07:29:12.045993 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 216/474] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:11 2022] GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c => generated 1680 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:29:12.452568 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-235f8287-d369-4f87-98c4-664a2ba17eae tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:12.460222 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-235f8287-d369-4f87-98c4-664a2ba17eae tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:12.467102 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell0:SELECT=2 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:12.471210 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-235f8287-d369-4f87-98c4-664a2ba17eae tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:12.471665 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-235f8287-d369-4f87-98c4-664a2ba17eae tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:12.472471 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-235f8287-d369-4f87-98c4-664a2ba17eae tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:12.473122 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-235f8287-d369-4f87-98c4-664a2ba17eae tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:12.804443 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-235f8287-d369-4f87-98c4-664a2ba17eae tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:12.813653 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-235f8287-d369-4f87-98c4-664a2ba17eae tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1318 microversion: 2.1 time: 0.364872 Jul 26 07:29:12.815982 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 259/475] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:12 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1318 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:13.067640 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-06d74608-c697-4696-9773-d69f2e401861 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:13.068380 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-06d74608-c697-4696-9773-d69f2e401861 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: e5a904a1-f100-432e-8c8c-f3dc187c3a0c] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:13.078178 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-06d74608-c697-4696-9773-d69f2e401861 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:13.078738 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-06d74608-c697-4696-9773-d69f2e401861 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:13.079864 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-06d74608-c697-4696-9773-d69f2e401861 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:13.080490 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-06d74608-c697-4696-9773-d69f2e401861 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:13.165704 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-06d74608-c697-4696-9773-d69f2e401861 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:13.176845 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-06d74608-c697-4696-9773-d69f2e401861 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c" status: 200 len: 1613 microversion: 2.1 time: 0.112349 Jul 26 07:29:13.177486 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 217/476] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:13 2022] GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c => generated 1613 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:29:13.839623 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-32e6ee91-7c8d-4aa9-9b8d-d5e0f109b4ac tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:13.840348 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-32e6ee91-7c8d-4aa9-9b8d-d5e0f109b4ac tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:13.853956 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-32e6ee91-7c8d-4aa9-9b8d-d5e0f109b4ac tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:13.854998 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-32e6ee91-7c8d-4aa9-9b8d-d5e0f109b4ac tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:13.856823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-32e6ee91-7c8d-4aa9-9b8d-d5e0f109b4ac tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:13.858752 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-32e6ee91-7c8d-4aa9-9b8d-d5e0f109b4ac tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:13.948057 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-837cc647-2add-4683-87bf-aaf404ab505b req-bf05e230-02b9-408f-8bba-a60aa47ca17f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5a904a1-f100-432e-8c8c-f3dc187c3a0c", "name": "network-vif-deleted", "tag": "05fcdb60-6df8-4eba-b269-358abb08dcc2"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:29:13.972930 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-837cc647-2add-4683-87bf-aaf404ab505b req-bf05e230-02b9-408f-8bba-a60aa47ca17f service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:13.973721 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-837cc647-2add-4683-87bf-aaf404ab505b req-bf05e230-02b9-408f-8bba-a60aa47ca17f service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:14.019085 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-837cc647-2add-4683-87bf-aaf404ab505b req-bf05e230-02b9-408f-8bba-a60aa47ca17f service nova] Creating event network-vif-deleted:05fcdb60-6df8-4eba-b269-358abb08dcc2 for instance e5a904a1-f100-432e-8c8c-f3dc187c3a0c on hv-cinder-85083 Jul 26 07:29:14.033959 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-837cc647-2add-4683-87bf-aaf404ab505b req-bf05e230-02b9-408f-8bba-a60aa47ca17f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089275 Jul 26 07:29:14.037422 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 218/477] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 07:29:14.192836 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-32e6ee91-7c8d-4aa9-9b8d-d5e0f109b4ac tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:14.202785 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6140e7fa-11b7-4497-9c70-b66b76eaac2e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:14.203486 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6140e7fa-11b7-4497-9c70-b66b76eaac2e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: e5a904a1-f100-432e-8c8c-f3dc187c3a0c] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:14.228840 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-32e6ee91-7c8d-4aa9-9b8d-d5e0f109b4ac tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1507 microversion: 2.1 time: 0.396328 Jul 26 07:29:14.229815 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 260/478] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:13 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1507 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:14.236372 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6140e7fa-11b7-4497-9c70-b66b76eaac2e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:14.238858 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6140e7fa-11b7-4497-9c70-b66b76eaac2e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:14.240530 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6140e7fa-11b7-4497-9c70-b66b76eaac2e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:14.241680 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6140e7fa-11b7-4497-9c70-b66b76eaac2e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:14.254708 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-1afa25a1-768b-4e66-b378-c572a040f9d1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77653b38-e5d7-4e98-9024-aff6ece2c671", "device": "/dev/sdb"}} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:29:14.266077 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-1afa25a1-768b-4e66-b378-c572a040f9d1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:14.281769 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1afa25a1-768b-4e66-b378-c572a040f9d1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:14.282544 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1afa25a1-768b-4e66-b378-c572a040f9d1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:14.283497 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1afa25a1-768b-4e66-b378-c572a040f9d1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:14.283939 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1afa25a1-768b-4e66-b378-c572a040f9d1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:14.355409 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6140e7fa-11b7-4497-9c70-b66b76eaac2e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:14.356261 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6140e7fa-11b7-4497-9c70-b66b76eaac2e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:14.357211 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.objects.instance [None req-6140e7fa-11b7-4497-9c70-b66b76eaac2e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lazy-loading 'fault' on Instance uuid e5a904a1-f100-432e-8c8c-f3dc187c3a0c {{(pid=117716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 07:29:14.530441 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6140e7fa-11b7-4497-9c70-b66b76eaac2e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:14.555900 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6140e7fa-11b7-4497-9c70-b66b76eaac2e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c" status: 200 len: 1331 microversion: 2.1 time: 0.357304 Jul 26 07:29:14.557135 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 219/479] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:14 2022] GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c => generated 1331 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:29:14.852181 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-1afa25a1-768b-4e66-b378-c572a040f9d1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "POST /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.602884 Jul 26 07:29:14.853019 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 261/480] 10.222.0.39 () {60 vars in 1323 bytes} [Tue Jul 26 07:29:14 2022] POST /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f/os-volume_attachments => generated 194 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 07:29:15.587539 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a107f251-8940-4a3f-8324-10e26b18d5cc tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:15.588252 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a107f251-8940-4a3f-8324-10e26b18d5cc tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: e5a904a1-f100-432e-8c8c-f3dc187c3a0c] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:15.598902 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a107f251-8940-4a3f-8324-10e26b18d5cc tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:15.599656 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a107f251-8940-4a3f-8324-10e26b18d5cc tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:15.600448 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a107f251-8940-4a3f-8324-10e26b18d5cc tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:15.600881 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a107f251-8940-4a3f-8324-10e26b18d5cc tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:15.628211 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.wsgi [None req-a107f251-8940-4a3f-8324-10e26b18d5cc tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] HTTP exception thrown: Instance e5a904a1-f100-432e-8c8c-f3dc187c3a0c could not be found. Jul 26 07:29:15.632239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a107f251-8940-4a3f-8324-10e26b18d5cc tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Request method failure captured: Jul 26 07:29:15.632239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: request: GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c HTTP/1.1 Jul 26 07:29:15.632239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept: application/json Jul 26 07:29:15.632239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept-Encoding: identity Jul 26 07:29:15.632239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Connection: close Jul 26 07:29:15.632239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Length: 0 Jul 26 07:29:15.632239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Type: application/json Jul 26 07:29:15.632239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Host: 10.222.0.39 Jul 26 07:29:15.632239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Openstack-System-Scope: None Jul 26 07:29:15.632239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: User-Agent: python-urllib3/1.26.10 Jul 26 07:29:15.632239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Auth-Token: gAAAAABi35bp-6MDlHFX6PqBP1JfjI-kDaErGZ8tS4CYMVgobtb4Gv-rSD0l-rBJa-iOQtbMEcv7gnFG6FuqSpAXwRcnDvooOo8YQBTuYFKMeWkJlsSVbvRshSqswhfLq3PM2Jh4Afd8RHIhCtF_ajjZyUKtQPL35KmYg8DZArwcVpy_HW9N5Qc Jul 26 07:29:15.632239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Id: None Jul 26 07:29:15.632239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Name: None Jul 26 07:29:15.632239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Identity-Status: Confirmed Jul 26 07:29:15.632239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Is-Admin-Project: True Jul 26 07:29:15.632239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Id: default Jul 26 07:29:15.632239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Name: Default Jul 26 07:29:15.632239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Id: 4fa0c5574ef9497ebe29658f8164764c Jul 26 07:29:15.632239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Name: tempest-AttachVolumeNegativeTest-1485570437 Jul 26 07:29:15.632239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Role: member,reader Jul 26 07:29:15.632239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Roles: member,reader Jul 26 07:29:15.633719 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:29:15.633719 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant: tempest-AttachVolumeNegativeTest-1485570437 Jul 26 07:29:15.633719 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Id: 4fa0c5574ef9497ebe29658f8164764c Jul 26 07:29:15.633719 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1485570437 Jul 26 07:29:15.633719 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User: tempest-AttachVolumeNegativeTest-1485570437-project Jul 26 07:29:15.633719 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Id: default Jul 26 07:29:15.633719 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Name: Default Jul 26 07:29:15.633719 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Id: 57029844165f4d83892176fe82594685 Jul 26 07:29:15.633719 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Name: tempest-AttachVolumeNegativeTest-1485570437-project Jul 26 07:29:15.633719 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: method: > Jul 26 07:29:15.633719 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: exception: Instance e5a904a1-f100-432e-8c8c-f3dc187c3a0c could not be found. Jul 26 07:29:15.633719 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: action_args: {'id': 'e5a904a1-f100-432e-8c8c-f3dc187c3a0c'} Jul 26 07:29:15.634696 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:29:15.634696 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:29:15.634696 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 07:29:15.634696 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 07:29:15.634696 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 07:29:15.634696 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 07:29:15.634696 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 07:29:15.634696 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 07:29:15.634696 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 07:29:15.634696 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 07:29:15.634696 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5a904a1-f100-432e-8c8c-f3dc187c3a0c could not be found. Jul 26 07:29:15.634696 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:29:15.634696 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:29:15.634696 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:29:15.634696 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:29:15.634696 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:29:15.634696 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:29:15.634696 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:29:15.634696 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:29:15.634696 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:29:15.636121 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:29:15.636121 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 07:29:15.636121 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 07:29:15.636121 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 07:29:15.636121 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 07:29:15.636121 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 07:29:15.636121 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:29:15.636121 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5a904a1-f100-432e-8c8c-f3dc187c3a0c could not be found. Jul 26 07:29:15.636121 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:29:15.636121 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:29:15.636121 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:29:15.636121 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:29:15.636121 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:29:15.636121 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:29:15.636121 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:29:15.636121 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:29:15.636121 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5a904a1-f100-432e-8c8c-f3dc187c3a0c could not be found. Jul 26 07:29:15.636121 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:29:15.643209 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a107f251-8940-4a3f-8324-10e26b18d5cc tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Returning 404 to user: Instance e5a904a1-f100-432e-8c8c-f3dc187c3a0c could not be found. {{(pid=117716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:29:15.644370 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a107f251-8940-4a3f-8324-10e26b18d5cc tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c" status: 404 len: 111 microversion: 2.1 time: 0.060931 Jul 26 07:29:15.645244 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 220/481] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:15 2022] GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 07:29:15.658162 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-662c7a7c-e626-49c6-958e-de8b20048bf7 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '.version_select at 0x7f7f026e7280>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:15.689675 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-662c7a7c-e626-49c6-958e-de8b20048bf7 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-208874891" status: 202 len: 0 microversion: 2.1 time: 0.038758 Jul 26 07:29:15.691617 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 262/482] 10.222.0.39 () {58 vars in 1218 bytes} [Tue Jul 26 07:29:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-208874891 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 07:29:17.582933 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7b9318d9-789a-488f-897f-58991f8966c8 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:17.584092 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7b9318d9-789a-488f-897f-58991f8966c8 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: c0b50e8b-a23c-4aa8-826e-3e2141006ede] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:17.591237 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7b9318d9-789a-488f-897f-58991f8966c8 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:17.591947 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7b9318d9-789a-488f-897f-58991f8966c8 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:17.593298 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7b9318d9-789a-488f-897f-58991f8966c8 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:17.593956 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7b9318d9-789a-488f-897f-58991f8966c8 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:17.780583 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.objects.instance [None req-7b9318d9-789a-488f-897f-58991f8966c8 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lazy-loading 'services' on Instance uuid c0b50e8b-a23c-4aa8-826e-3e2141006ede {{(pid=117716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 07:29:17.946728 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7b9318d9-789a-488f-897f-58991f8966c8 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede/os-volume_attachments/a3118ec4-ef49-472f-8c6a-e76ced59cdf9" status: 202 len: 0 microversion: 2.1 time: 0.366872 Jul 26 07:29:17.948480 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 221/483] 10.222.0.39 () {58 vars in 1416 bytes} [Tue Jul 26 07:29:17 2022] DELETE /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede/os-volume_attachments/a3118ec4-ef49-472f-8c6a-e76ced59cdf9 => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 07:29:17.959835 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-fa7b263c-88e9-4320-b2e8-edd9bec6a293 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:17.963362 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-fa7b263c-88e9-4320-b2e8-edd9bec6a293 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: c0b50e8b-a23c-4aa8-826e-3e2141006ede] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:17.972284 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fa7b263c-88e9-4320-b2e8-edd9bec6a293 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:17.973280 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fa7b263c-88e9-4320-b2e8-edd9bec6a293 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:17.974748 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fa7b263c-88e9-4320-b2e8-edd9bec6a293 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:17.975517 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fa7b263c-88e9-4320-b2e8-edd9bec6a293 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:18.012273 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-fa7b263c-88e9-4320-b2e8-edd9bec6a293 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057073 Jul 26 07:29:18.013992 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 263/484] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:29:17 2022] GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 07:29:19.036453 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a7b9c8f9-8ae7-488c-8575-6596498c0009 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:19.043331 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a7b9c8f9-8ae7-488c-8575-6596498c0009 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: c0b50e8b-a23c-4aa8-826e-3e2141006ede] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:19.054845 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a7b9c8f9-8ae7-488c-8575-6596498c0009 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:19.057564 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a7b9c8f9-8ae7-488c-8575-6596498c0009 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:19.062850 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a7b9c8f9-8ae7-488c-8575-6596498c0009 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:19.063560 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a7b9c8f9-8ae7-488c-8575-6596498c0009 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:19.106371 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a7b9c8f9-8ae7-488c-8575-6596498c0009 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080077 Jul 26 07:29:19.107151 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 222/485] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:29:19 2022] GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:29:19.998878 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f2a0f70f-a9c0-45f3-945b-1f777ddb0f98 tempest-TestShelveInstance-706623057 tempest-TestShelveInstance-706623057-project] Action: 'create', calling method: .version_select at 0x7f7f027a6d30>, body: {"keypair": {"name": "tempest-TestShelveInstance-664511373", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzuFKvm1qCBcUl1AEM4hv8E9dcNGGJ5JfD7G4gzjGgKpa2/7XkOGSa7cCR9n1hDtWDZk9HbIUS4/iRW8JO7LQXzeTkqwb+AwTOnZQoAKcGw+b8cX+QsgWP7c4zTgL+oTA=="}} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:29:20.015901 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.quota [None req-f2a0f70f-a9c0-45f3-945b-1f777ddb0f98 tempest-TestShelveInstance-706623057 tempest-TestShelveInstance-706623057-project] Getting quotas for project c80c8785a6f7482caf8f72d11937d27f. Resources: {'key_pairs'} {{(pid=117715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 07:29:20.020537 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.quota [None req-f2a0f70f-a9c0-45f3-945b-1f777ddb0f98 tempest-TestShelveInstance-706623057 tempest-TestShelveInstance-706623057-project] Getting quotas for user 8714dee8553c47f1b12b999f04058b08 and project c80c8785a6f7482caf8f72d11937d27f. Resources: {'key_pairs'} {{(pid=117715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 07:29:20.047713 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f2a0f70f-a9c0-45f3-945b-1f777ddb0f98 tempest-TestShelveInstance-706623057 tempest-TestShelveInstance-706623057-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.264508 Jul 26 07:29:20.048996 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 264/486] 10.222.0.39 () {60 vars in 1159 bytes} [Tue Jul 26 07:29:19 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:29:20.122953 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2abeb083-b202-4e9d-8d34-ed71ca19a586 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:20.125788 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2abeb083-b202-4e9d-8d34-ed71ca19a586 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: c0b50e8b-a23c-4aa8-826e-3e2141006ede] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:20.135390 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2abeb083-b202-4e9d-8d34-ed71ca19a586 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:20.135664 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2abeb083-b202-4e9d-8d34-ed71ca19a586 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:20.136853 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2abeb083-b202-4e9d-8d34-ed71ca19a586 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:20.136853 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2abeb083-b202-4e9d-8d34-ed71ca19a586 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:20.172313 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2abeb083-b202-4e9d-8d34-ed71ca19a586 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055459 Jul 26 07:29:20.172908 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 223/487] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:29:20 2022] GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:29:21.191393 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d59fc3d7-ab09-40a9-babc-9d6aa86c3df4 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:21.194942 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d59fc3d7-ab09-40a9-babc-9d6aa86c3df4 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: c0b50e8b-a23c-4aa8-826e-3e2141006ede] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:21.207503 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d59fc3d7-ab09-40a9-babc-9d6aa86c3df4 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:21.208495 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d59fc3d7-ab09-40a9-babc-9d6aa86c3df4 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:21.209894 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d59fc3d7-ab09-40a9-babc-9d6aa86c3df4 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:21.210467 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d59fc3d7-ab09-40a9-babc-9d6aa86c3df4 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:21.265878 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d59fc3d7-ab09-40a9-babc-9d6aa86c3df4 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080979 Jul 26 07:29:21.274951 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 265/488] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:29:21 2022] GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:29:22.034712 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ca1df67c-e689-4775-be7d-cd1acb233e5c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee55fc9d-589c-41b9-a688-ef26d365900c"}} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:29:22.037253 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ca1df67c-e689-4775-be7d-cd1acb233e5c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:22.055448 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ca1df67c-e689-4775-be7d-cd1acb233e5c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:22.056041 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ca1df67c-e689-4775-be7d-cd1acb233e5c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:22.057467 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ca1df67c-e689-4775-be7d-cd1acb233e5c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:22.058138 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ca1df67c-e689-4775-be7d-cd1acb233e5c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:22.287547 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ea8c2c4b-ec60-4d88-8fb4-e525de9c6321 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:22.289619 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ea8c2c4b-ec60-4d88-8fb4-e525de9c6321 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: c0b50e8b-a23c-4aa8-826e-3e2141006ede] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:22.296458 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ea8c2c4b-ec60-4d88-8fb4-e525de9c6321 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:22.297193 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ea8c2c4b-ec60-4d88-8fb4-e525de9c6321 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:22.297986 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ea8c2c4b-ec60-4d88-8fb4-e525de9c6321 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:22.298417 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ea8c2c4b-ec60-4d88-8fb4-e525de9c6321 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:22.331938 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ea8c2c4b-ec60-4d88-8fb4-e525de9c6321 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048831 Jul 26 07:29:22.332583 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 266/489] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:29:22 2022] GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:29:22.350874 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ca1df67c-e689-4775-be7d-cd1acb233e5c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "POST /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320472 Jul 26 07:29:22.351502 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 224/490] 10.222.0.39 () {60 vars in 1323 bytes} [Tue Jul 26 07:29:22 2022] POST /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:29:23.347898 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-2517a952-bfd9-47d5-8f7f-f54aef23a2c6 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:23.350190 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2517a952-bfd9-47d5-8f7f-f54aef23a2c6 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: c0b50e8b-a23c-4aa8-826e-3e2141006ede] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:23.358908 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2517a952-bfd9-47d5-8f7f-f54aef23a2c6 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:23.359430 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2517a952-bfd9-47d5-8f7f-f54aef23a2c6 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:23.360224 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2517a952-bfd9-47d5-8f7f-f54aef23a2c6 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:23.360658 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2517a952-bfd9-47d5-8f7f-f54aef23a2c6 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:23.408981 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-2517a952-bfd9-47d5-8f7f-f54aef23a2c6 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065371 Jul 26 07:29:23.409602 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 267/491] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:29:23 2022] GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 07:29:23.493596 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6c57e564-6872-4281-8d7e-8e48da2b8540 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:23.494431 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6c57e564-6872-4281-8d7e-8e48da2b8540 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: c0b50e8b-a23c-4aa8-826e-3e2141006ede] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:23.501384 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6c57e564-6872-4281-8d7e-8e48da2b8540 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:23.501867 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6c57e564-6872-4281-8d7e-8e48da2b8540 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:23.502691 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6c57e564-6872-4281-8d7e-8e48da2b8540 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:23.503127 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6c57e564-6872-4281-8d7e-8e48da2b8540 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:23.537486 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6c57e564-6872-4281-8d7e-8e48da2b8540 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: c0b50e8b-a23c-4aa8-826e-3e2141006ede] Going to try to terminate instance {{(pid=117716) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 07:29:23.659461 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6c57e564-6872-4281-8d7e-8e48da2b8540 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede" status: 204 len: 0 microversion: 2.1 time: 0.175423 Jul 26 07:29:23.660496 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 225/492] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Jul 26 07:29:23 2022] DELETE /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 07:29:23.670988 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-df44532b-152c-4b03-a932-bfc29fe860bc tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:23.671598 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-df44532b-152c-4b03-a932-bfc29fe860bc tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: c0b50e8b-a23c-4aa8-826e-3e2141006ede] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:23.679155 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-df44532b-152c-4b03-a932-bfc29fe860bc tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:23.679606 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-df44532b-152c-4b03-a932-bfc29fe860bc tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:23.680430 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-df44532b-152c-4b03-a932-bfc29fe860bc tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:23.680861 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-df44532b-152c-4b03-a932-bfc29fe860bc tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:23.824956 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-df44532b-152c-4b03-a932-bfc29fe860bc tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:23.832750 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-df44532b-152c-4b03-a932-bfc29fe860bc tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede" status: 200 len: 1679 microversion: 2.1 time: 0.166512 Jul 26 07:29:23.833317 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 268/493] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:23 2022] GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:24.857340 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c61b34c7-79ec-4008-895d-9fb899ef618c tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:24.858337 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c61b34c7-79ec-4008-895d-9fb899ef618c tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: c0b50e8b-a23c-4aa8-826e-3e2141006ede] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:24.865272 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c61b34c7-79ec-4008-895d-9fb899ef618c tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:24.865964 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c61b34c7-79ec-4008-895d-9fb899ef618c tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:24.866975 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c61b34c7-79ec-4008-895d-9fb899ef618c tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:24.867598 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c61b34c7-79ec-4008-895d-9fb899ef618c tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:25.025846 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-c61b34c7-79ec-4008-895d-9fb899ef618c tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:25.034291 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c61b34c7-79ec-4008-895d-9fb899ef618c tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede" status: 200 len: 1679 microversion: 2.1 time: 0.181512 Jul 26 07:29:25.035067 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 226/494] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:24 2022] GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede => generated 1679 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:26.057386 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-54328160-7f43-40e4-82dc-b4a61e14a427 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:26.058051 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-54328160-7f43-40e4-82dc-b4a61e14a427 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: c0b50e8b-a23c-4aa8-826e-3e2141006ede] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:26.066007 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-54328160-7f43-40e4-82dc-b4a61e14a427 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:26.066454 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-54328160-7f43-40e4-82dc-b4a61e14a427 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:26.067408 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-54328160-7f43-40e4-82dc-b4a61e14a427 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:26.068217 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-54328160-7f43-40e4-82dc-b4a61e14a427 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:26.156325 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-54328160-7f43-40e4-82dc-b4a61e14a427 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:26.166615 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-54328160-7f43-40e4-82dc-b4a61e14a427 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede" status: 200 len: 1612 microversion: 2.1 time: 0.113591 Jul 26 07:29:26.167386 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 269/495] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:26 2022] GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede => generated 1612 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:26.405257 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-52982b51-66a0-472d-8bb7-6291707318ee req-74d8c4fb-1e6f-4e6a-835a-c4a182a484c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0b50e8b-a23c-4aa8-826e-3e2141006ede", "name": "network-vif-deleted", "tag": "f69a186f-e6f8-40ec-a78d-a7da3701a72b"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:29:26.418194 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-52982b51-66a0-472d-8bb7-6291707318ee req-74d8c4fb-1e6f-4e6a-835a-c4a182a484c4 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:26.418895 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-52982b51-66a0-472d-8bb7-6291707318ee req-74d8c4fb-1e6f-4e6a-835a-c4a182a484c4 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:26.452986 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-52982b51-66a0-472d-8bb7-6291707318ee req-74d8c4fb-1e6f-4e6a-835a-c4a182a484c4 service nova] Creating event network-vif-deleted:f69a186f-e6f8-40ec-a78d-a7da3701a72b for instance c0b50e8b-a23c-4aa8-826e-3e2141006ede on hv-cinder-85083 Jul 26 07:29:26.458709 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-52982b51-66a0-472d-8bb7-6291707318ee req-74d8c4fb-1e6f-4e6a-835a-c4a182a484c4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060627 Jul 26 07:29:26.459566 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 227/496] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:29:27.191051 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ad6ade1d-4477-45ec-aa6e-9e799e5c109c tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:27.191661 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ad6ade1d-4477-45ec-aa6e-9e799e5c109c tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: c0b50e8b-a23c-4aa8-826e-3e2141006ede] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:27.198748 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ad6ade1d-4477-45ec-aa6e-9e799e5c109c tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:27.199187 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ad6ade1d-4477-45ec-aa6e-9e799e5c109c tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:27.199952 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ad6ade1d-4477-45ec-aa6e-9e799e5c109c tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:27.200375 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ad6ade1d-4477-45ec-aa6e-9e799e5c109c tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:27.215299 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.wsgi [None req-ad6ade1d-4477-45ec-aa6e-9e799e5c109c tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] HTTP exception thrown: Instance c0b50e8b-a23c-4aa8-826e-3e2141006ede could not be found. Jul 26 07:29:27.216990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ad6ade1d-4477-45ec-aa6e-9e799e5c109c tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Request method failure captured: Jul 26 07:29:27.216990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: request: GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede HTTP/1.1 Jul 26 07:29:27.216990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept: application/json Jul 26 07:29:27.216990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept-Encoding: identity Jul 26 07:29:27.216990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Connection: close Jul 26 07:29:27.216990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Length: 0 Jul 26 07:29:27.216990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Type: application/json Jul 26 07:29:27.216990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Host: 10.222.0.39 Jul 26 07:29:27.216990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Openstack-System-Scope: None Jul 26 07:29:27.216990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: User-Agent: python-urllib3/1.26.10 Jul 26 07:29:27.216990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Auth-Token: gAAAAABi35bp-6MDlHFX6PqBP1JfjI-kDaErGZ8tS4CYMVgobtb4Gv-rSD0l-rBJa-iOQtbMEcv7gnFG6FuqSpAXwRcnDvooOo8YQBTuYFKMeWkJlsSVbvRshSqswhfLq3PM2Jh4Afd8RHIhCtF_ajjZyUKtQPL35KmYg8DZArwcVpy_HW9N5Qc Jul 26 07:29:27.216990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Id: None Jul 26 07:29:27.216990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Name: None Jul 26 07:29:27.216990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Identity-Status: Confirmed Jul 26 07:29:27.216990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Is-Admin-Project: True Jul 26 07:29:27.216990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Id: default Jul 26 07:29:27.216990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Name: Default Jul 26 07:29:27.216990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Id: 4fa0c5574ef9497ebe29658f8164764c Jul 26 07:29:27.216990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Name: tempest-AttachVolumeNegativeTest-1485570437 Jul 26 07:29:27.216990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Role: member,reader Jul 26 07:29:27.216990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Roles: member,reader Jul 26 07:29:27.219189 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:29:27.219189 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant: tempest-AttachVolumeNegativeTest-1485570437 Jul 26 07:29:27.219189 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Id: 4fa0c5574ef9497ebe29658f8164764c Jul 26 07:29:27.219189 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1485570437 Jul 26 07:29:27.219189 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User: tempest-AttachVolumeNegativeTest-1485570437-project Jul 26 07:29:27.219189 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Id: default Jul 26 07:29:27.219189 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Name: Default Jul 26 07:29:27.219189 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Id: 57029844165f4d83892176fe82594685 Jul 26 07:29:27.219189 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Name: tempest-AttachVolumeNegativeTest-1485570437-project Jul 26 07:29:27.219189 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: method: > Jul 26 07:29:27.219189 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: exception: Instance c0b50e8b-a23c-4aa8-826e-3e2141006ede could not be found. Jul 26 07:29:27.219189 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: action_args: {'id': 'c0b50e8b-a23c-4aa8-826e-3e2141006ede'} Jul 26 07:29:27.220545 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:29:27.220545 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:29:27.220545 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 07:29:27.220545 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 07:29:27.220545 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 07:29:27.220545 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 07:29:27.220545 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 07:29:27.220545 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 07:29:27.220545 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 07:29:27.220545 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 07:29:27.220545 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0b50e8b-a23c-4aa8-826e-3e2141006ede could not be found. Jul 26 07:29:27.220545 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:29:27.220545 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:29:27.220545 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:29:27.220545 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:29:27.220545 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:29:27.220545 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:29:27.220545 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:29:27.220545 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:29:27.220545 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:29:27.223230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:29:27.223230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 07:29:27.223230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 07:29:27.223230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 07:29:27.223230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 07:29:27.223230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 07:29:27.223230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:29:27.223230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0b50e8b-a23c-4aa8-826e-3e2141006ede could not be found. Jul 26 07:29:27.223230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:29:27.223230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:29:27.223230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:29:27.223230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:29:27.223230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:29:27.223230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:29:27.223230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:29:27.223230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:29:27.223230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0b50e8b-a23c-4aa8-826e-3e2141006ede could not be found. Jul 26 07:29:27.223230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:29:27.225677 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ad6ade1d-4477-45ec-aa6e-9e799e5c109c tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Returning 404 to user: Instance c0b50e8b-a23c-4aa8-826e-3e2141006ede could not be found. {{(pid=117715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:29:27.225677 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ad6ade1d-4477-45ec-aa6e-9e799e5c109c tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede" status: 404 len: 111 microversion: 2.1 time: 0.033075 Jul 26 07:29:27.225677 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 270/497] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:27 2022] GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 07:29:27.235066 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-dd7bc28d-8abd-47e5-bf26-2f80faa04634 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '.version_select at 0x7f7f0279d430>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:27.257690 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-dd7bc28d-8abd-47e5-bf26-2f80faa04634 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-785816003" status: 202 len: 0 microversion: 2.1 time: 0.026812 Jul 26 07:29:27.258307 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 228/498] 10.222.0.39 () {58 vars in 1218 bytes} [Tue Jul 26 07:29:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-785816003 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 07:29:27.987247 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-20bbb38b-cadf-4f72-8901-197863cf7860 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Action: 'create', calling method: .version_select at 0x7f7f02771700>, body: {"keypair": {"name": "tempest-keypair-77659213", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEkiyL3BZkv3JE5N8w9bB6Hy+FSArx/2n2qBA5t+3BHe08NSAuxgiMjJQT7c8TTt9ut1siOSNs20X+CFsRdkrSeTAqFU957ue23/lCV978ws37tYFXplQcEv5u9MHV6p6w=="}} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:29:28.004487 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.quota [None req-20bbb38b-cadf-4f72-8901-197863cf7860 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Getting quotas for project 4fa0c5574ef9497ebe29658f8164764c. Resources: {'key_pairs'} {{(pid=117715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 07:29:28.009047 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.quota [None req-20bbb38b-cadf-4f72-8901-197863cf7860 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Getting quotas for user 57029844165f4d83892176fe82594685 and project 4fa0c5574ef9497ebe29658f8164764c. Resources: {'key_pairs'} {{(pid=117715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 07:29:28.033042 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-20bbb38b-cadf-4f72-8901-197863cf7860 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.049980 Jul 26 07:29:28.033649 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 271/499] 10.222.0.39 () {60 vars in 1159 bytes} [Tue Jul 26 07:29:27 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 07:29:29.549527 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8a334307-e0f0-4844-8a91-55a09538218a tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-944365928", "imageRef": "b9589773-813f-42af-846a-43bcf9d4d002", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4aa6648c-5052-41c3-a55b-aea07445bb59"}], "security_groups": [{"name": "tempest-securitygroup--1745727131"}], "key_name": "tempest-keypair-77659213", "user_data": "}} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:29:29.691808 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.network.neutron [None req-8a334307-e0f0-4844-8a91-55a09538218a tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] validate_networks() for [('4aa6648c-5052-41c3-a55b-aea07445bb59', None, None, None, None, None)] {{(pid=117716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 07:29:30.108572 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-8a334307-e0f0-4844-8a91-55a09538218a tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Flavor limits 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 07:29:30.108985 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-8a334307-e0f0-4844-8a91-55a09538218a tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Image limits 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 07:29:30.109547 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-8a334307-e0f0-4844-8a91-55a09538218a tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Flavor pref 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 07:29:30.110407 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-8a334307-e0f0-4844-8a91-55a09538218a tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Image pref 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 07:29:30.111148 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-8a334307-e0f0-4844-8a91-55a09538218a tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 07:29:30.123248 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8a334307-e0f0-4844-8a91-55a09538218a tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:30.123829 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8a334307-e0f0-4844-8a91-55a09538218a tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:30.124825 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8a334307-e0f0-4844-8a91-55a09538218a tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:30.125285 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8a334307-e0f0-4844-8a91-55a09538218a tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:30.144200 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.quota [None req-8a334307-e0f0-4844-8a91-55a09538218a tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Getting quotas for project 4fa0c5574ef9497ebe29658f8164764c. Resources: {'instances', 'cores', 'ram'} {{(pid=117716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 07:29:30.148834 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.quota [None req-8a334307-e0f0-4844-8a91-55a09538218a tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Getting quotas for user 57029844165f4d83892176fe82594685 and project 4fa0c5574ef9497ebe29658f8164764c. Resources: {'instances', 'cores', 'ram'} {{(pid=117716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 07:29:30.168286 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8a334307-e0f0-4844-8a91-55a09538218a tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Going to run 1 instances... {{(pid=117716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 07:29:30.171614 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8a334307-e0f0-4844-8a91-55a09538218a tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9589773-813f-42af-846a-43bcf9d4d002',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 07:29:30.222115 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8a334307-e0f0-4844-8a91-55a09538218a tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.679553 Jul 26 07:29:30.225944 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 229/500] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Jul 26 07:29:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 07:29:30.234580 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f2f5dd00-8628-45ab-bb35-26173a48d501 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:30.235326 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f2f5dd00-8628-45ab-bb35-26173a48d501 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:30.294292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f2f5dd00-8628-45ab-bb35-26173a48d501 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:30.303236 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f2f5dd00-8628-45ab-bb35-26173a48d501 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1239 microversion: 2.1 time: 0.073122 Jul 26 07:29:30.304088 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 272/501] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:30 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1239 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:31.325254 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-3efa4c15-8b94-41fd-9563-804930a13712 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:31.325896 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-3efa4c15-8b94-41fd-9563-804930a13712 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:31.333031 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3efa4c15-8b94-41fd-9563-804930a13712 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:31.333477 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3efa4c15-8b94-41fd-9563-804930a13712 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:31.334284 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3efa4c15-8b94-41fd-9563-804930a13712 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:31.334721 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3efa4c15-8b94-41fd-9563-804930a13712 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:31.408161 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-3efa4c15-8b94-41fd-9563-804930a13712 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:31.419616 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-3efa4c15-8b94-41fd-9563-804930a13712 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.098734 Jul 26 07:29:31.420187 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 230/502] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:31 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:32.441021 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6f05186f-0e89-4c0c-9bae-f7954b8212a6 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:32.441593 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-6f05186f-0e89-4c0c-9bae-f7954b8212a6 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:32.444227 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:32.449985 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6f05186f-0e89-4c0c-9bae-f7954b8212a6 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:32.450423 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6f05186f-0e89-4c0c-9bae-f7954b8212a6 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:32.451181 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6f05186f-0e89-4c0c-9bae-f7954b8212a6 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:32.451625 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6f05186f-0e89-4c0c-9bae-f7954b8212a6 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:32.523862 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-6f05186f-0e89-4c0c-9bae-f7954b8212a6 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:32.542476 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6f05186f-0e89-4c0c-9bae-f7954b8212a6 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.098258 Jul 26 07:29:32.542476 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 273/503] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:32 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:33.557475 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-29a9a6f6-61c4-4f2c-b02d-05f086338e7e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:33.558118 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-29a9a6f6-61c4-4f2c-b02d-05f086338e7e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:33.560745 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:33.566843 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-29a9a6f6-61c4-4f2c-b02d-05f086338e7e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:33.567288 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-29a9a6f6-61c4-4f2c-b02d-05f086338e7e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:33.568175 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-29a9a6f6-61c4-4f2c-b02d-05f086338e7e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:33.568607 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-29a9a6f6-61c4-4f2c-b02d-05f086338e7e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:33.637702 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-29a9a6f6-61c4-4f2c-b02d-05f086338e7e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:33.645866 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-29a9a6f6-61c4-4f2c-b02d-05f086338e7e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.092353 Jul 26 07:29:33.646455 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 231/504] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:33 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:34.671620 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8461871a-cc4d-4ae0-9c3d-2b53db9e836d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:34.672745 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8461871a-cc4d-4ae0-9c3d-2b53db9e836d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:34.684119 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8461871a-cc4d-4ae0-9c3d-2b53db9e836d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:34.684649 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8461871a-cc4d-4ae0-9c3d-2b53db9e836d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:34.685476 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8461871a-cc4d-4ae0-9c3d-2b53db9e836d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:34.686008 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8461871a-cc4d-4ae0-9c3d-2b53db9e836d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:34.707884 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:34.761440 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8461871a-cc4d-4ae0-9c3d-2b53db9e836d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:34.771429 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8461871a-cc4d-4ae0-9c3d-2b53db9e836d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.107450 Jul 26 07:29:34.772035 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 274/505] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:34 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:35.793275 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-e3ed62c4-c745-4c45-961f-bf714aa29b63 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:35.793928 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-e3ed62c4-c745-4c45-961f-bf714aa29b63 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:35.801188 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e3ed62c4-c745-4c45-961f-bf714aa29b63 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:35.801623 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e3ed62c4-c745-4c45-961f-bf714aa29b63 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:35.802419 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e3ed62c4-c745-4c45-961f-bf714aa29b63 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:35.802851 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e3ed62c4-c745-4c45-961f-bf714aa29b63 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:35.805703 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:35.869995 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-e3ed62c4-c745-4c45-961f-bf714aa29b63 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:35.878789 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-e3ed62c4-c745-4c45-961f-bf714aa29b63 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.089437 Jul 26 07:29:35.879381 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 232/506] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:35 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:36.901150 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-442b2013-04e2-4d03-88e2-1dc8929ad503 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:36.901802 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-442b2013-04e2-4d03-88e2-1dc8929ad503 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:36.909539 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-442b2013-04e2-4d03-88e2-1dc8929ad503 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:36.910028 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-442b2013-04e2-4d03-88e2-1dc8929ad503 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:36.911121 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-442b2013-04e2-4d03-88e2-1dc8929ad503 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:36.911558 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-442b2013-04e2-4d03-88e2-1dc8929ad503 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:36.982871 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-442b2013-04e2-4d03-88e2-1dc8929ad503 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:36.990910 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-442b2013-04e2-4d03-88e2-1dc8929ad503 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.094064 Jul 26 07:29:36.991487 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 275/507] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:36 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:38.013019 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-3796928b-c86e-46b0-8396-7df3bd7f5e21 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:38.013823 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-3796928b-c86e-46b0-8396-7df3bd7f5e21 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:38.021192 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3796928b-c86e-46b0-8396-7df3bd7f5e21 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:38.021639 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3796928b-c86e-46b0-8396-7df3bd7f5e21 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:38.022405 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3796928b-c86e-46b0-8396-7df3bd7f5e21 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:38.022841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3796928b-c86e-46b0-8396-7df3bd7f5e21 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:38.086671 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-3796928b-c86e-46b0-8396-7df3bd7f5e21 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:38.094945 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-3796928b-c86e-46b0-8396-7df3bd7f5e21 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.086131 Jul 26 07:29:38.095522 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 233/508] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:38 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:39.117489 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d26327a5-3789-49c2-817e-3fd30b8cfbeb tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:39.118095 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d26327a5-3789-49c2-817e-3fd30b8cfbeb tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:39.125258 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d26327a5-3789-49c2-817e-3fd30b8cfbeb tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:39.125669 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d26327a5-3789-49c2-817e-3fd30b8cfbeb tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:39.126487 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d26327a5-3789-49c2-817e-3fd30b8cfbeb tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:39.126898 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d26327a5-3789-49c2-817e-3fd30b8cfbeb tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:39.191955 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d26327a5-3789-49c2-817e-3fd30b8cfbeb tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:39.200163 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d26327a5-3789-49c2-817e-3fd30b8cfbeb tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.087085 Jul 26 07:29:39.200757 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 276/509] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:39 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:40.164696 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7dcacb5e-eeb9-43a9-bc64-ceb4b2d63d58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:40.165323 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7dcacb5e-eeb9-43a9-bc64-ceb4b2d63d58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:40.167772 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell0:SELECT=2 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:40.168457 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell0:SELECT=6 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:40.177696 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7dcacb5e-eeb9-43a9-bc64-ceb4b2d63d58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:40.178591 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7dcacb5e-eeb9-43a9-bc64-ceb4b2d63d58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:40.179679 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7dcacb5e-eeb9-43a9-bc64-ceb4b2d63d58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:40.180451 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7dcacb5e-eeb9-43a9-bc64-ceb4b2d63d58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:40.213487 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7dcacb5e-eeb9-43a9-bc64-ceb4b2d63d58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments/fa6e6b55-17eb-4f19-b707-afbc384fcd1b" status: 200 len: 194 microversion: 2.20 time: 0.052791 Jul 26 07:29:40.214210 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 234/510] 10.222.0.39 () {60 vars in 1454 bytes} [Tue Jul 26 07:29:40 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments/fa6e6b55-17eb-4f19-b707-afbc384fcd1b => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:29:40.222783 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d7c2350f-d4f4-407a-97db-9f04cdff5931 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:40.224237 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d7c2350f-d4f4-407a-97db-9f04cdff5931 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:40.232675 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d7c2350f-d4f4-407a-97db-9f04cdff5931 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:40.233184 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d7c2350f-d4f4-407a-97db-9f04cdff5931 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:40.234075 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d7c2350f-d4f4-407a-97db-9f04cdff5931 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:40.234565 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d7c2350f-d4f4-407a-97db-9f04cdff5931 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:40.300617 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell0:SELECT=10 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:40.312180 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d7c2350f-d4f4-407a-97db-9f04cdff5931 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:40.315896 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d7c2350f-d4f4-407a-97db-9f04cdff5931 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.097191 Jul 26 07:29:40.316475 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 277/511] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:40 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:40.324843 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-1e0f84b4-326c-4df0-adc4-9844ccc0fa86 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:40.325379 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-1e0f84b4-326c-4df0-adc4-9844ccc0fa86 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:40.331936 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1e0f84b4-326c-4df0-adc4-9844ccc0fa86 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:40.332381 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1e0f84b4-326c-4df0-adc4-9844ccc0fa86 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:40.333230 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1e0f84b4-326c-4df0-adc4-9844ccc0fa86 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:40.333575 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1e0f84b4-326c-4df0-adc4-9844ccc0fa86 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:40.431940 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.objects.instance [None req-1e0f84b4-326c-4df0-adc4-9844ccc0fa86 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lazy-loading 'services' on Instance uuid 990571a8-aa04-4aac-921c-cf071eca1dd0 {{(pid=117716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 07:29:40.519258 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-1e0f84b4-326c-4df0-adc4-9844ccc0fa86 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "DELETE /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments/fa6e6b55-17eb-4f19-b707-afbc384fcd1b" status: 202 len: 0 microversion: 2.20 time: 0.198029 Jul 26 07:29:40.520139 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 235/512] 10.222.0.39 () {60 vars in 1457 bytes} [Tue Jul 26 07:29:40 2022] DELETE /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments/fa6e6b55-17eb-4f19-b707-afbc384fcd1b => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 07:29:40.529459 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f7f6ab96-f462-47db-908a-1ed9ea485caa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:40.532581 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f7f6ab96-f462-47db-908a-1ed9ea485caa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:40.540311 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f7f6ab96-f462-47db-908a-1ed9ea485caa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:40.541036 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f7f6ab96-f462-47db-908a-1ed9ea485caa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:40.542754 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f7f6ab96-f462-47db-908a-1ed9ea485caa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:40.543795 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f7f6ab96-f462-47db-908a-1ed9ea485caa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:40.584174 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f7f6ab96-f462-47db-908a-1ed9ea485caa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059420 Jul 26 07:29:40.584769 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 278/513] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:29:40 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 07:29:41.341294 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-3b424332-a378-41d9-bcd8-f604e53989c7 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:41.342028 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-3b424332-a378-41d9-bcd8-f604e53989c7 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:41.349310 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3b424332-a378-41d9-bcd8-f604e53989c7 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:41.349779 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3b424332-a378-41d9-bcd8-f604e53989c7 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:41.350555 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3b424332-a378-41d9-bcd8-f604e53989c7 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:41.350985 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3b424332-a378-41d9-bcd8-f604e53989c7 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:41.422304 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-3b424332-a378-41d9-bcd8-f604e53989c7 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:41.429935 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-3b424332-a378-41d9-bcd8-f604e53989c7 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.093379 Jul 26 07:29:41.430498 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 236/514] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:41 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:41.597632 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-1b1daaf2-dee0-40f2-9220-4ccfae673a55 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:41.599772 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-1b1daaf2-dee0-40f2-9220-4ccfae673a55 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:41.607111 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1b1daaf2-dee0-40f2-9220-4ccfae673a55 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:41.607573 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1b1daaf2-dee0-40f2-9220-4ccfae673a55 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:41.608353 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1b1daaf2-dee0-40f2-9220-4ccfae673a55 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:41.608772 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1b1daaf2-dee0-40f2-9220-4ccfae673a55 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:41.639958 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-1b1daaf2-dee0-40f2-9220-4ccfae673a55 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046484 Jul 26 07:29:41.640540 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 279/515] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:29:41 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:29:42.451779 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-66191a97-a0ce-40a9-9a50-c5c582a2cece tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:42.452416 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-66191a97-a0ce-40a9-9a50-c5c582a2cece tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:42.459688 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-66191a97-a0ce-40a9-9a50-c5c582a2cece tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:42.460405 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-66191a97-a0ce-40a9-9a50-c5c582a2cece tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:42.461371 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-66191a97-a0ce-40a9-9a50-c5c582a2cece tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:42.461973 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-66191a97-a0ce-40a9-9a50-c5c582a2cece tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:42.542996 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-66191a97-a0ce-40a9-9a50-c5c582a2cece tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:42.552684 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-66191a97-a0ce-40a9-9a50-c5c582a2cece tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.105188 Jul 26 07:29:42.553423 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 237/516] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:42 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:42.653964 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e9307c99-8ab8-48c7-83ae-19c4eb212006 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:42.656232 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e9307c99-8ab8-48c7-83ae-19c4eb212006 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:42.663834 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e9307c99-8ab8-48c7-83ae-19c4eb212006 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:42.664541 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e9307c99-8ab8-48c7-83ae-19c4eb212006 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:42.665067 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e9307c99-8ab8-48c7-83ae-19c4eb212006 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:42.665490 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e9307c99-8ab8-48c7-83ae-19c4eb212006 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:42.704221 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e9307c99-8ab8-48c7-83ae-19c4eb212006 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054494 Jul 26 07:29:42.704766 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 280/517] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:29:42 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 07:29:43.574493 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-fedbddca-a95e-4797-ac43-9e9685d9f040 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:43.575187 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-fedbddca-a95e-4797-ac43-9e9685d9f040 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:43.587944 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fedbddca-a95e-4797-ac43-9e9685d9f040 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:43.588706 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fedbddca-a95e-4797-ac43-9e9685d9f040 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:43.590103 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fedbddca-a95e-4797-ac43-9e9685d9f040 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:43.590853 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fedbddca-a95e-4797-ac43-9e9685d9f040 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:43.683301 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-fedbddca-a95e-4797-ac43-9e9685d9f040 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:43.691657 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-fedbddca-a95e-4797-ac43-9e9685d9f040 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.121053 Jul 26 07:29:43.692315 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 238/518] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:43 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:43.718076 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-5f58a988-6567-492e-83e8-dc90b193e4d0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:43.720409 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-5f58a988-6567-492e-83e8-dc90b193e4d0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:43.727902 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5f58a988-6567-492e-83e8-dc90b193e4d0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:43.728483 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5f58a988-6567-492e-83e8-dc90b193e4d0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:43.729353 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5f58a988-6567-492e-83e8-dc90b193e4d0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:43.729853 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5f58a988-6567-492e-83e8-dc90b193e4d0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:43.763509 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-5f58a988-6567-492e-83e8-dc90b193e4d0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049857 Jul 26 07:29:43.764102 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 281/519] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:29:43 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:29:44.714487 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8d8517c9-fdec-4645-b52a-81e1e4cca9ba tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:44.715264 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8d8517c9-fdec-4645-b52a-81e1e4cca9ba tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:44.724686 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8d8517c9-fdec-4645-b52a-81e1e4cca9ba tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:44.725130 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8d8517c9-fdec-4645-b52a-81e1e4cca9ba tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:44.725949 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8d8517c9-fdec-4645-b52a-81e1e4cca9ba tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:44.726375 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8d8517c9-fdec-4645-b52a-81e1e4cca9ba tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:44.776081 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d84eb5a3-f727-40c8-a782-877a9cf2039b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:44.778240 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d84eb5a3-f727-40c8-a782-877a9cf2039b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:44.784604 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d84eb5a3-f727-40c8-a782-877a9cf2039b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:44.785049 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d84eb5a3-f727-40c8-a782-877a9cf2039b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:44.785837 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d84eb5a3-f727-40c8-a782-877a9cf2039b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:44.786254 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d84eb5a3-f727-40c8-a782-877a9cf2039b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:44.794194 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8d8517c9-fdec-4645-b52a-81e1e4cca9ba tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:44.801818 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8d8517c9-fdec-4645-b52a-81e1e4cca9ba tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.092036 Jul 26 07:29:44.802380 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 239/520] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:44 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:44.818984 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d84eb5a3-f727-40c8-a782-877a9cf2039b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047389 Jul 26 07:29:44.819539 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 282/521] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:29:44 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:29:45.823350 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a38e3d78-0222-4b76-8d6c-529134468136 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:45.823983 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a38e3d78-0222-4b76-8d6c-529134468136 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:45.830976 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a38e3d78-0222-4b76-8d6c-529134468136 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:45.831455 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a38e3d78-0222-4b76-8d6c-529134468136 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:45.831693 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7a083025-378f-44b3-8c58-ff2cc4bc0051 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:45.832196 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a38e3d78-0222-4b76-8d6c-529134468136 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:45.832710 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a38e3d78-0222-4b76-8d6c-529134468136 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:45.833887 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7a083025-378f-44b3-8c58-ff2cc4bc0051 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:45.840450 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7a083025-378f-44b3-8c58-ff2cc4bc0051 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:45.840897 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7a083025-378f-44b3-8c58-ff2cc4bc0051 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:45.841657 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7a083025-378f-44b3-8c58-ff2cc4bc0051 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:45.842119 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7a083025-378f-44b3-8c58-ff2cc4bc0051 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:45.880102 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7a083025-378f-44b3-8c58-ff2cc4bc0051 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052381 Jul 26 07:29:45.880992 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 283/522] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:29:45 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:29:45.911765 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a38e3d78-0222-4b76-8d6c-529134468136 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:45.923067 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a38e3d78-0222-4b76-8d6c-529134468136 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.102596 Jul 26 07:29:45.923664 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 240/523] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:45 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:46.893152 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f8df878c-2652-491b-8fb8-a0208906176b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:46.895381 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f8df878c-2652-491b-8fb8-a0208906176b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:46.902738 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f8df878c-2652-491b-8fb8-a0208906176b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:46.903176 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f8df878c-2652-491b-8fb8-a0208906176b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:46.903962 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f8df878c-2652-491b-8fb8-a0208906176b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:46.904402 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f8df878c-2652-491b-8fb8-a0208906176b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:46.938544 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f8df878c-2652-491b-8fb8-a0208906176b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049582 Jul 26 07:29:46.939026 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 284/524] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:29:46 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:29:46.950339 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c1601c43-849f-4c84-8fa6-4a321b9ad746 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:46.951297 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c1601c43-849f-4c84-8fa6-4a321b9ad746 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:46.958142 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c1601c43-849f-4c84-8fa6-4a321b9ad746 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:46.958579 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c1601c43-849f-4c84-8fa6-4a321b9ad746 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:46.959355 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c1601c43-849f-4c84-8fa6-4a321b9ad746 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:46.959782 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c1601c43-849f-4c84-8fa6-4a321b9ad746 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:47.023717 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-c1601c43-849f-4c84-8fa6-4a321b9ad746 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:47.031701 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c1601c43-849f-4c84-8fa6-4a321b9ad746 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.085174 Jul 26 07:29:47.032296 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 241/525] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:46 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:29:47.954887 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-69bba475-4119-4a38-a2a5-f3e69b86601e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:47.957858 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-69bba475-4119-4a38-a2a5-f3e69b86601e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:47.968115 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-69bba475-4119-4a38-a2a5-f3e69b86601e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:47.968632 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-69bba475-4119-4a38-a2a5-f3e69b86601e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:47.969928 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-69bba475-4119-4a38-a2a5-f3e69b86601e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:47.970473 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-69bba475-4119-4a38-a2a5-f3e69b86601e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:48.019130 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-69bba475-4119-4a38-a2a5-f3e69b86601e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.069573 Jul 26 07:29:48.019735 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 285/526] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:29:47 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:29:48.054540 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-fcd0ab7a-3ef6-4e98-9e17-bfc6a54e9bfa tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:48.055620 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-fcd0ab7a-3ef6-4e98-9e17-bfc6a54e9bfa tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:48.063753 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fcd0ab7a-3ef6-4e98-9e17-bfc6a54e9bfa tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:48.064197 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fcd0ab7a-3ef6-4e98-9e17-bfc6a54e9bfa tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:48.065014 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fcd0ab7a-3ef6-4e98-9e17-bfc6a54e9bfa tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:48.065520 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fcd0ab7a-3ef6-4e98-9e17-bfc6a54e9bfa tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:48.148909 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-fcd0ab7a-3ef6-4e98-9e17-bfc6a54e9bfa tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:48.157198 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-fcd0ab7a-3ef6-4e98-9e17-bfc6a54e9bfa tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.107780 Jul 26 07:29:48.157817 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 242/527] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:48 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:49.032745 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3a51ec21-17ff-4f06-9c04-4a0a9a1ee7ce tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:49.034973 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3a51ec21-17ff-4f06-9c04-4a0a9a1ee7ce tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:49.042352 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3a51ec21-17ff-4f06-9c04-4a0a9a1ee7ce tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:49.042790 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3a51ec21-17ff-4f06-9c04-4a0a9a1ee7ce tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:49.043565 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3a51ec21-17ff-4f06-9c04-4a0a9a1ee7ce tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:49.043992 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3a51ec21-17ff-4f06-9c04-4a0a9a1ee7ce tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:49.080598 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3a51ec21-17ff-4f06-9c04-4a0a9a1ee7ce tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051915 Jul 26 07:29:49.081208 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 286/528] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:29:49 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:29:49.179316 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c4aa397c-5848-49f9-add1-c144af5a4345 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:49.180238 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c4aa397c-5848-49f9-add1-c144af5a4345 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:49.187502 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c4aa397c-5848-49f9-add1-c144af5a4345 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:49.188000 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c4aa397c-5848-49f9-add1-c144af5a4345 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:49.188900 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c4aa397c-5848-49f9-add1-c144af5a4345 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:49.189487 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c4aa397c-5848-49f9-add1-c144af5a4345 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:49.257068 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-c4aa397c-5848-49f9-add1-c144af5a4345 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:49.266151 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c4aa397c-5848-49f9-add1-c144af5a4345 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.090757 Jul 26 07:29:49.266787 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 243/529] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:49 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:50.097905 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a4255c04-713d-46c5-8a5e-6afdf83e09c9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:50.101499 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a4255c04-713d-46c5-8a5e-6afdf83e09c9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:50.113322 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a4255c04-713d-46c5-8a5e-6afdf83e09c9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:50.114235 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a4255c04-713d-46c5-8a5e-6afdf83e09c9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:50.115617 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a4255c04-713d-46c5-8a5e-6afdf83e09c9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:50.116377 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a4255c04-713d-46c5-8a5e-6afdf83e09c9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:50.162032 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a4255c04-713d-46c5-8a5e-6afdf83e09c9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072253 Jul 26 07:29:50.162990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 287/530] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:29:50 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:29:50.294120 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-42a70079-c8a3-468c-8bcb-ef2b44893639 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:50.295192 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-42a70079-c8a3-468c-8bcb-ef2b44893639 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:50.305005 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-42a70079-c8a3-468c-8bcb-ef2b44893639 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:50.305534 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-42a70079-c8a3-468c-8bcb-ef2b44893639 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:50.306783 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-42a70079-c8a3-468c-8bcb-ef2b44893639 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:50.307277 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-42a70079-c8a3-468c-8bcb-ef2b44893639 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:50.381030 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-42a70079-c8a3-468c-8bcb-ef2b44893639 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:50.389617 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-42a70079-c8a3-468c-8bcb-ef2b44893639 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.103515 Jul 26 07:29:50.390620 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 244/531] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:50 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:51.177587 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-84e336fe-ad77-4f3b-9eb0-251952b66a8f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:51.179966 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-84e336fe-ad77-4f3b-9eb0-251952b66a8f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:51.187572 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-84e336fe-ad77-4f3b-9eb0-251952b66a8f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:51.188067 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-84e336fe-ad77-4f3b-9eb0-251952b66a8f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:51.188864 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-84e336fe-ad77-4f3b-9eb0-251952b66a8f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:51.189292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-84e336fe-ad77-4f3b-9eb0-251952b66a8f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:51.233029 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-84e336fe-ad77-4f3b-9eb0-251952b66a8f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059124 Jul 26 07:29:51.234073 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 288/532] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:29:51 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:29:51.412433 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f373c171-7ecb-4b2e-ab67-5aeceaa98abe tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:51.413038 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-f373c171-7ecb-4b2e-ab67-5aeceaa98abe tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:51.420674 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f373c171-7ecb-4b2e-ab67-5aeceaa98abe tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:51.421122 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f373c171-7ecb-4b2e-ab67-5aeceaa98abe tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:51.421999 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f373c171-7ecb-4b2e-ab67-5aeceaa98abe tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:51.422441 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f373c171-7ecb-4b2e-ab67-5aeceaa98abe tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:51.492565 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-f373c171-7ecb-4b2e-ab67-5aeceaa98abe tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:51.501406 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f373c171-7ecb-4b2e-ab67-5aeceaa98abe tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.093522 Jul 26 07:29:51.502075 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 245/533] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:51 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:52.249810 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b05477bc-cc2f-4373-ba38-49a8fe02c248 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:52.251934 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b05477bc-cc2f-4373-ba38-49a8fe02c248 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:52.259439 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b05477bc-cc2f-4373-ba38-49a8fe02c248 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:52.259891 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b05477bc-cc2f-4373-ba38-49a8fe02c248 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:52.260744 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b05477bc-cc2f-4373-ba38-49a8fe02c248 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:52.261193 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b05477bc-cc2f-4373-ba38-49a8fe02c248 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:52.296334 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b05477bc-cc2f-4373-ba38-49a8fe02c248 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050658 Jul 26 07:29:52.296941 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 289/534] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:29:52 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:29:52.525331 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-033e6b95-a3ff-4d6e-bb47-492f6e74289d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:52.525829 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-033e6b95-a3ff-4d6e-bb47-492f6e74289d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:52.533378 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-033e6b95-a3ff-4d6e-bb47-492f6e74289d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:52.533895 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-033e6b95-a3ff-4d6e-bb47-492f6e74289d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:52.534740 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-033e6b95-a3ff-4d6e-bb47-492f6e74289d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:52.535178 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-033e6b95-a3ff-4d6e-bb47-492f6e74289d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:52.604888 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-033e6b95-a3ff-4d6e-bb47-492f6e74289d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:52.613158 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-033e6b95-a3ff-4d6e-bb47-492f6e74289d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.092018 Jul 26 07:29:52.614042 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 246/535] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:52 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:53.310584 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d8f17fdc-acc1-4a3b-8845-d500d5abf7e8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:53.312865 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d8f17fdc-acc1-4a3b-8845-d500d5abf7e8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:53.321169 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d8f17fdc-acc1-4a3b-8845-d500d5abf7e8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:53.321633 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d8f17fdc-acc1-4a3b-8845-d500d5abf7e8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:53.322428 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d8f17fdc-acc1-4a3b-8845-d500d5abf7e8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:53.323000 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d8f17fdc-acc1-4a3b-8845-d500d5abf7e8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:53.356939 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d8f17fdc-acc1-4a3b-8845-d500d5abf7e8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050456 Jul 26 07:29:53.357551 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 290/536] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:29:53 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:29:53.635967 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7cdd56f4-6c82-4d11-969a-95a5bb55380a tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:53.636533 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7cdd56f4-6c82-4d11-969a-95a5bb55380a tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:53.643516 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7cdd56f4-6c82-4d11-969a-95a5bb55380a tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:53.643997 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7cdd56f4-6c82-4d11-969a-95a5bb55380a tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:53.645051 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7cdd56f4-6c82-4d11-969a-95a5bb55380a tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:53.645824 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7cdd56f4-6c82-4d11-969a-95a5bb55380a tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:53.715581 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7cdd56f4-6c82-4d11-969a-95a5bb55380a tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:53.724349 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7cdd56f4-6c82-4d11-969a-95a5bb55380a tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.092302 Jul 26 07:29:53.725298 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 247/537] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:53 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:54.373550 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-804f808f-249d-45cc-93fc-4b379d2b3fe8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:54.375784 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-804f808f-249d-45cc-93fc-4b379d2b3fe8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:54.382989 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-804f808f-249d-45cc-93fc-4b379d2b3fe8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:54.383438 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-804f808f-249d-45cc-93fc-4b379d2b3fe8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:54.384217 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-804f808f-249d-45cc-93fc-4b379d2b3fe8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:54.384651 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-804f808f-249d-45cc-93fc-4b379d2b3fe8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:54.388926 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:54.429982 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-804f808f-249d-45cc-93fc-4b379d2b3fe8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060518 Jul 26 07:29:54.431064 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 291/538] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:29:54 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:29:54.758752 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9d8fd974-faab-43f7-a9b1-62014f7d1746 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:54.759519 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-9d8fd974-faab-43f7-a9b1-62014f7d1746 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:54.767972 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9d8fd974-faab-43f7-a9b1-62014f7d1746 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:54.768494 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9d8fd974-faab-43f7-a9b1-62014f7d1746 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:54.769295 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9d8fd974-faab-43f7-a9b1-62014f7d1746 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:54.769768 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9d8fd974-faab-43f7-a9b1-62014f7d1746 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:54.773496 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:54.839693 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-9d8fd974-faab-43f7-a9b1-62014f7d1746 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:54.847840 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-9d8fd974-faab-43f7-a9b1-62014f7d1746 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.094571 Jul 26 07:29:54.848524 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 248/539] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:54 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:55.450706 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-cd907dea-bd23-41ee-a447-3c4d16c22519 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:55.454444 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-cd907dea-bd23-41ee-a447-3c4d16c22519 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:55.465884 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cd907dea-bd23-41ee-a447-3c4d16c22519 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:55.466674 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cd907dea-bd23-41ee-a447-3c4d16c22519 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:55.468195 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cd907dea-bd23-41ee-a447-3c4d16c22519 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:55.468775 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cd907dea-bd23-41ee-a447-3c4d16c22519 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:55.508166 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-cd907dea-bd23-41ee-a447-3c4d16c22519 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064921 Jul 26 07:29:55.509057 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 292/540] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:29:55 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:29:55.868622 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-15b8e2c7-036f-42fb-99f5-95d2d5417dae tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:55.869238 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-15b8e2c7-036f-42fb-99f5-95d2d5417dae tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:55.876270 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-15b8e2c7-036f-42fb-99f5-95d2d5417dae tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:55.876711 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-15b8e2c7-036f-42fb-99f5-95d2d5417dae tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:55.877511 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-15b8e2c7-036f-42fb-99f5-95d2d5417dae tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:55.877975 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-15b8e2c7-036f-42fb-99f5-95d2d5417dae tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:55.941340 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-15b8e2c7-036f-42fb-99f5-95d2d5417dae tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:55.949149 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-15b8e2c7-036f-42fb-99f5-95d2d5417dae tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.084516 Jul 26 07:29:55.949711 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 249/541] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:55 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:56.525925 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7b7c1548-e399-4d89-bd49-e2b27df1a589 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:56.528220 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7b7c1548-e399-4d89-bd49-e2b27df1a589 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:56.535838 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7b7c1548-e399-4d89-bd49-e2b27df1a589 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:56.536349 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7b7c1548-e399-4d89-bd49-e2b27df1a589 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:56.537207 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7b7c1548-e399-4d89-bd49-e2b27df1a589 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:56.537791 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7b7c1548-e399-4d89-bd49-e2b27df1a589 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:56.575376 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7b7c1548-e399-4d89-bd49-e2b27df1a589 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053437 Jul 26 07:29:56.576173 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 293/542] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:29:56 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:29:56.971434 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-e6b8133f-d201-41b0-b594-61c10b49199c tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:56.972177 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-e6b8133f-d201-41b0-b594-61c10b49199c tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:56.980065 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e6b8133f-d201-41b0-b594-61c10b49199c tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:56.980632 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e6b8133f-d201-41b0-b594-61c10b49199c tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:56.981450 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e6b8133f-d201-41b0-b594-61c10b49199c tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:56.982012 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e6b8133f-d201-41b0-b594-61c10b49199c tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:57.051408 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-e6b8133f-d201-41b0-b594-61c10b49199c tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:57.060603 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-e6b8133f-d201-41b0-b594-61c10b49199c tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.093574 Jul 26 07:29:57.061174 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 250/543] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:56 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:57.589250 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-96940d42-5957-46df-9a0d-16deef6f159f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:57.591632 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-96940d42-5957-46df-9a0d-16deef6f159f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:57.599611 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-96940d42-5957-46df-9a0d-16deef6f159f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:57.600096 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-96940d42-5957-46df-9a0d-16deef6f159f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:57.600870 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-96940d42-5957-46df-9a0d-16deef6f159f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:57.601295 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-96940d42-5957-46df-9a0d-16deef6f159f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:57.635804 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-96940d42-5957-46df-9a0d-16deef6f159f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050684 Jul 26 07:29:57.636408 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 294/544] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:29:57 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:29:58.095275 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-3274059e-d849-4f7b-a6b2-b53ebad63b5b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:58.096022 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-3274059e-d849-4f7b-a6b2-b53ebad63b5b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:58.104143 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3274059e-d849-4f7b-a6b2-b53ebad63b5b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:58.104756 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3274059e-d849-4f7b-a6b2-b53ebad63b5b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:58.105666 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3274059e-d849-4f7b-a6b2-b53ebad63b5b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:58.106222 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3274059e-d849-4f7b-a6b2-b53ebad63b5b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:58.177628 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-3274059e-d849-4f7b-a6b2-b53ebad63b5b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:58.186298 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-3274059e-d849-4f7b-a6b2-b53ebad63b5b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.095291 Jul 26 07:29:58.186924 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 251/545] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:58 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:58.651545 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6538011c-5078-422f-a268-5af3cf806ab8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:58.653842 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-6538011c-5078-422f-a268-5af3cf806ab8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:58.661393 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6538011c-5078-422f-a268-5af3cf806ab8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:58.661883 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6538011c-5078-422f-a268-5af3cf806ab8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:58.662678 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6538011c-5078-422f-a268-5af3cf806ab8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:58.663110 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6538011c-5078-422f-a268-5af3cf806ab8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:58.695496 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6538011c-5078-422f-a268-5af3cf806ab8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047966 Jul 26 07:29:58.696099 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 295/546] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:29:58 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:29:59.208303 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-3dbe12ff-8718-4037-adaa-7db29d8dbcbe tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:59.209161 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-3dbe12ff-8718-4037-adaa-7db29d8dbcbe tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:59.216347 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3dbe12ff-8718-4037-adaa-7db29d8dbcbe tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:59.216795 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3dbe12ff-8718-4037-adaa-7db29d8dbcbe tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:59.217979 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3dbe12ff-8718-4037-adaa-7db29d8dbcbe tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:59.218415 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3dbe12ff-8718-4037-adaa-7db29d8dbcbe tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:59.286835 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-3dbe12ff-8718-4037-adaa-7db29d8dbcbe tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:29:59.295019 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-3dbe12ff-8718-4037-adaa-7db29d8dbcbe tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.090930 Jul 26 07:29:59.295599 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 252/547] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:29:59 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:29:59.708899 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-eda6f4c7-4df0-4fe7-a06c-7135b246da58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:29:59.711061 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-eda6f4c7-4df0-4fe7-a06c-7135b246da58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:29:59.718781 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-eda6f4c7-4df0-4fe7-a06c-7135b246da58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:59.719225 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-eda6f4c7-4df0-4fe7-a06c-7135b246da58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:59.720012 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-eda6f4c7-4df0-4fe7-a06c-7135b246da58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:29:59.720446 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-eda6f4c7-4df0-4fe7-a06c-7135b246da58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:29:59.752490 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-eda6f4c7-4df0-4fe7-a06c-7135b246da58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047921 Jul 26 07:29:59.753041 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 296/548] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:29:59 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:00.323186 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ddbbd022-a078-43cd-8833-f8087f25353e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:00.324009 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ddbbd022-a078-43cd-8833-f8087f25353e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:00.330842 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ddbbd022-a078-43cd-8833-f8087f25353e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:00.331280 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ddbbd022-a078-43cd-8833-f8087f25353e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:00.332017 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ddbbd022-a078-43cd-8833-f8087f25353e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:00.332469 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ddbbd022-a078-43cd-8833-f8087f25353e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:00.398584 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ddbbd022-a078-43cd-8833-f8087f25353e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:00.407276 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ddbbd022-a078-43cd-8833-f8087f25353e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.087925 Jul 26 07:30:00.407881 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 253/549] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:00 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:30:00.769290 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-bdab61ba-76c0-4c71-955e-1f96d8b0714f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:00.772663 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-bdab61ba-76c0-4c71-955e-1f96d8b0714f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:00.782670 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bdab61ba-76c0-4c71-955e-1f96d8b0714f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:00.783275 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bdab61ba-76c0-4c71-955e-1f96d8b0714f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:00.784181 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bdab61ba-76c0-4c71-955e-1f96d8b0714f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:00.785241 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bdab61ba-76c0-4c71-955e-1f96d8b0714f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:00.823460 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-bdab61ba-76c0-4c71-955e-1f96d8b0714f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062014 Jul 26 07:30:00.824041 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 297/550] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:00 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:01.430148 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-1ccc6825-f8d2-42b3-abfb-439378044bc9 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:01.431023 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-1ccc6825-f8d2-42b3-abfb-439378044bc9 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:01.438293 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1ccc6825-f8d2-42b3-abfb-439378044bc9 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:01.438714 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1ccc6825-f8d2-42b3-abfb-439378044bc9 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:01.439490 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1ccc6825-f8d2-42b3-abfb-439378044bc9 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:01.439915 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1ccc6825-f8d2-42b3-abfb-439378044bc9 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:01.506782 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-1ccc6825-f8d2-42b3-abfb-439378044bc9 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:01.515126 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-1ccc6825-f8d2-42b3-abfb-439378044bc9 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.089655 Jul 26 07:30:01.515736 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 254/551] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:01 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:30:01.837442 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-10815131-d4b2-4429-99c2-938be461ca48 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:01.839758 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-10815131-d4b2-4429-99c2-938be461ca48 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:01.848419 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-10815131-d4b2-4429-99c2-938be461ca48 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:01.848867 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-10815131-d4b2-4429-99c2-938be461ca48 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:01.849853 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-10815131-d4b2-4429-99c2-938be461ca48 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:01.850338 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-10815131-d4b2-4429-99c2-938be461ca48 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:01.888779 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-10815131-d4b2-4429-99c2-938be461ca48 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055562 Jul 26 07:30:01.889719 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 298/552] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:01 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:02.538862 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-796a41b8-4901-4cca-a68d-1f5c0c086441 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:02.539785 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-796a41b8-4901-4cca-a68d-1f5c0c086441 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:02.546880 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-796a41b8-4901-4cca-a68d-1f5c0c086441 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:02.547319 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-796a41b8-4901-4cca-a68d-1f5c0c086441 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:02.548105 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-796a41b8-4901-4cca-a68d-1f5c0c086441 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:02.548531 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-796a41b8-4901-4cca-a68d-1f5c0c086441 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:02.639632 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-796a41b8-4901-4cca-a68d-1f5c0c086441 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:02.654174 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-796a41b8-4901-4cca-a68d-1f5c0c086441 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.118782 Jul 26 07:30:02.655208 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 255/553] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:02 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:30:02.902785 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-70ca11c5-0159-4ee9-9f13-a28cea8e7ba7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:02.905019 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-70ca11c5-0159-4ee9-9f13-a28cea8e7ba7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:02.907574 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=52 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:30:02.913623 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-70ca11c5-0159-4ee9-9f13-a28cea8e7ba7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:02.914188 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-70ca11c5-0159-4ee9-9f13-a28cea8e7ba7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:02.915071 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-70ca11c5-0159-4ee9-9f13-a28cea8e7ba7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:02.915498 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-70ca11c5-0159-4ee9-9f13-a28cea8e7ba7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:02.952438 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-70ca11c5-0159-4ee9-9f13-a28cea8e7ba7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053802 Jul 26 07:30:02.953048 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 299/554] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:02 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 07:30:03.689707 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9222a776-a17a-4db7-82a1-45a378df823e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:03.690387 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-9222a776-a17a-4db7-82a1-45a378df823e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:03.692812 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=50 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:30:03.698587 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9222a776-a17a-4db7-82a1-45a378df823e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:03.699036 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9222a776-a17a-4db7-82a1-45a378df823e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:03.699814 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9222a776-a17a-4db7-82a1-45a378df823e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:03.700245 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9222a776-a17a-4db7-82a1-45a378df823e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:03.799916 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-9222a776-a17a-4db7-82a1-45a378df823e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:03.810766 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-9222a776-a17a-4db7-82a1-45a378df823e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.125032 Jul 26 07:30:03.811494 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 256/555] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:03 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:30:03.965973 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-1309b733-2ee1-45f9-b698-06f14c97d24a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:03.968607 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-1309b733-2ee1-45f9-b698-06f14c97d24a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:03.976502 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1309b733-2ee1-45f9-b698-06f14c97d24a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:03.976945 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1309b733-2ee1-45f9-b698-06f14c97d24a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:03.977698 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1309b733-2ee1-45f9-b698-06f14c97d24a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:03.978194 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1309b733-2ee1-45f9-b698-06f14c97d24a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:04.035381 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-1309b733-2ee1-45f9-b698-06f14c97d24a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073368 Jul 26 07:30:04.036467 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 300/556] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:03 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:04.832292 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-968903fb-efe1-4627-b3df-056cf94c1d52 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:04.833121 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-968903fb-efe1-4627-b3df-056cf94c1d52 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:04.839971 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-968903fb-efe1-4627-b3df-056cf94c1d52 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:04.840418 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-968903fb-efe1-4627-b3df-056cf94c1d52 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:04.841196 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-968903fb-efe1-4627-b3df-056cf94c1d52 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:04.841628 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-968903fb-efe1-4627-b3df-056cf94c1d52 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:04.911876 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-968903fb-efe1-4627-b3df-056cf94c1d52 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:04.919886 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-968903fb-efe1-4627-b3df-056cf94c1d52 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.091551 Jul 26 07:30:04.920472 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 257/557] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:04 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:30:05.049145 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-80ff78db-73bf-4dd0-9c00-15536c7cfd45 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:05.051593 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-80ff78db-73bf-4dd0-9c00-15536c7cfd45 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:05.059224 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-80ff78db-73bf-4dd0-9c00-15536c7cfd45 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:05.059755 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-80ff78db-73bf-4dd0-9c00-15536c7cfd45 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:05.060676 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-80ff78db-73bf-4dd0-9c00-15536c7cfd45 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:05.061176 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-80ff78db-73bf-4dd0-9c00-15536c7cfd45 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:05.096916 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-80ff78db-73bf-4dd0-9c00-15536c7cfd45 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051877 Jul 26 07:30:05.097848 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 301/558] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:05 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:05.943500 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b81ea8f8-ded4-4a88-9142-f503664d4898 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:05.944533 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-b81ea8f8-ded4-4a88-9142-f503664d4898 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:05.954279 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b81ea8f8-ded4-4a88-9142-f503664d4898 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:05.955013 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b81ea8f8-ded4-4a88-9142-f503664d4898 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:05.956292 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b81ea8f8-ded4-4a88-9142-f503664d4898 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:05.956731 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b81ea8f8-ded4-4a88-9142-f503664d4898 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:06.036449 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-b81ea8f8-ded4-4a88-9142-f503664d4898 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:06.049680 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b81ea8f8-ded4-4a88-9142-f503664d4898 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.111735 Jul 26 07:30:06.050761 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 258/559] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:05 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:30:06.109978 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-733c4886-c7f6-42e9-a329-e745c9e3c072 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:06.112148 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-733c4886-c7f6-42e9-a329-e745c9e3c072 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:06.119197 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-733c4886-c7f6-42e9-a329-e745c9e3c072 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:06.119626 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-733c4886-c7f6-42e9-a329-e745c9e3c072 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:06.120411 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-733c4886-c7f6-42e9-a329-e745c9e3c072 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:06.120847 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-733c4886-c7f6-42e9-a329-e745c9e3c072 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:06.154455 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-733c4886-c7f6-42e9-a329-e745c9e3c072 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048721 Jul 26 07:30:06.155042 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 302/560] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:06 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:07.086902 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-895185a4-7f3f-4e00-857a-3b42509063e5 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:07.087502 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-895185a4-7f3f-4e00-857a-3b42509063e5 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:07.095084 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-895185a4-7f3f-4e00-857a-3b42509063e5 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:07.095701 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-895185a4-7f3f-4e00-857a-3b42509063e5 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:07.096656 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-895185a4-7f3f-4e00-857a-3b42509063e5 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:07.097121 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-895185a4-7f3f-4e00-857a-3b42509063e5 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:07.163568 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-895185a4-7f3f-4e00-857a-3b42509063e5 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:07.167355 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-346aaac4-d067-4dd9-9ffe-83ecd1e5773b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:07.169535 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-346aaac4-d067-4dd9-9ffe-83ecd1e5773b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:07.171958 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-895185a4-7f3f-4e00-857a-3b42509063e5 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.090898 Jul 26 07:30:07.172518 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 259/561] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:07 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:30:07.177643 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-346aaac4-d067-4dd9-9ffe-83ecd1e5773b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:07.178125 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-346aaac4-d067-4dd9-9ffe-83ecd1e5773b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:07.178924 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-346aaac4-d067-4dd9-9ffe-83ecd1e5773b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:07.179353 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-346aaac4-d067-4dd9-9ffe-83ecd1e5773b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:07.209955 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-346aaac4-d067-4dd9-9ffe-83ecd1e5773b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046527 Jul 26 07:30:07.210530 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 303/562] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:07 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:08.194163 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a7d9ce26-586a-430a-9db3-848317c3035e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:08.194839 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a7d9ce26-586a-430a-9db3-848317c3035e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:08.202153 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a7d9ce26-586a-430a-9db3-848317c3035e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:08.202581 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a7d9ce26-586a-430a-9db3-848317c3035e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:08.203371 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a7d9ce26-586a-430a-9db3-848317c3035e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:08.203796 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a7d9ce26-586a-430a-9db3-848317c3035e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:08.224326 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f0877fbd-c271-4687-b597-4a72f9e1035a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:08.226917 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f0877fbd-c271-4687-b597-4a72f9e1035a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:08.234845 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f0877fbd-c271-4687-b597-4a72f9e1035a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:08.235290 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f0877fbd-c271-4687-b597-4a72f9e1035a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:08.237775 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f0877fbd-c271-4687-b597-4a72f9e1035a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:08.238198 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f0877fbd-c271-4687-b597-4a72f9e1035a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:08.275085 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a7d9ce26-586a-430a-9db3-848317c3035e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:08.276064 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f0877fbd-c271-4687-b597-4a72f9e1035a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056749 Jul 26 07:30:08.276668 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 304/563] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:08 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:08.286473 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a7d9ce26-586a-430a-9db3-848317c3035e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.095952 Jul 26 07:30:08.287469 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 260/564] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:08 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:30:09.289174 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a29891d6-584c-4680-9983-6473b609890c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:09.291473 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a29891d6-584c-4680-9983-6473b609890c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:09.298797 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a29891d6-584c-4680-9983-6473b609890c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:09.299239 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a29891d6-584c-4680-9983-6473b609890c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:09.300046 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a29891d6-584c-4680-9983-6473b609890c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:09.300497 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a29891d6-584c-4680-9983-6473b609890c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:09.311656 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-5f9ddd69-10b1-419b-a9c2-e013bcbba301 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:09.312509 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-5f9ddd69-10b1-419b-a9c2-e013bcbba301 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:09.319766 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5f9ddd69-10b1-419b-a9c2-e013bcbba301 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:09.320391 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5f9ddd69-10b1-419b-a9c2-e013bcbba301 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:09.321346 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5f9ddd69-10b1-419b-a9c2-e013bcbba301 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:09.322319 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5f9ddd69-10b1-419b-a9c2-e013bcbba301 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:09.335361 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a29891d6-584c-4680-9983-6473b609890c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050435 Jul 26 07:30:09.336063 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 305/565] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:09 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:09.396748 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-5f9ddd69-10b1-419b-a9c2-e013bcbba301 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:09.411570 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-5f9ddd69-10b1-419b-a9c2-e013bcbba301 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.103504 Jul 26 07:30:09.412683 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 261/566] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:09 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:30:10.349626 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-5af219f8-ecef-4455-80e6-5d60f8f23875 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:10.351944 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-5af219f8-ecef-4455-80e6-5d60f8f23875 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:10.359909 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5af219f8-ecef-4455-80e6-5d60f8f23875 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:10.360473 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5af219f8-ecef-4455-80e6-5d60f8f23875 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:10.361296 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5af219f8-ecef-4455-80e6-5d60f8f23875 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:10.361860 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5af219f8-ecef-4455-80e6-5d60f8f23875 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:10.395995 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-5af219f8-ecef-4455-80e6-5d60f8f23875 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050390 Jul 26 07:30:10.396733 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 306/567] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:10 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:10.444240 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-fb31a055-043a-4a2d-a573-a8c428e93646 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:10.445086 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-fb31a055-043a-4a2d-a573-a8c428e93646 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:10.452475 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fb31a055-043a-4a2d-a573-a8c428e93646 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:10.452893 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fb31a055-043a-4a2d-a573-a8c428e93646 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:10.453666 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fb31a055-043a-4a2d-a573-a8c428e93646 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:10.454204 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fb31a055-043a-4a2d-a573-a8c428e93646 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:10.532010 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-fb31a055-043a-4a2d-a573-a8c428e93646 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:10.546634 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-fb31a055-043a-4a2d-a573-a8c428e93646 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.106092 Jul 26 07:30:10.547517 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 262/568] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:10 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:30:11.409647 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ebe5cca6-38aa-4e41-85d8-765e80cf265f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:11.411971 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ebe5cca6-38aa-4e41-85d8-765e80cf265f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:11.419670 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ebe5cca6-38aa-4e41-85d8-765e80cf265f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:11.420103 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ebe5cca6-38aa-4e41-85d8-765e80cf265f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:11.420873 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ebe5cca6-38aa-4e41-85d8-765e80cf265f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:11.421297 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ebe5cca6-38aa-4e41-85d8-765e80cf265f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:11.452448 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:30:11.458395 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ebe5cca6-38aa-4e41-85d8-765e80cf265f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053167 Jul 26 07:30:11.459664 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 307/569] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:11 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:11.577200 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-34726c70-e539-4aaa-8bc2-89e383b79120 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:11.578236 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-34726c70-e539-4aaa-8bc2-89e383b79120 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:11.588231 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-34726c70-e539-4aaa-8bc2-89e383b79120 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:11.588728 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-34726c70-e539-4aaa-8bc2-89e383b79120 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:11.589635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-34726c70-e539-4aaa-8bc2-89e383b79120 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:11.590413 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-34726c70-e539-4aaa-8bc2-89e383b79120 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:11.670442 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-34726c70-e539-4aaa-8bc2-89e383b79120 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:11.679270 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-34726c70-e539-4aaa-8bc2-89e383b79120 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.106272 Jul 26 07:30:11.679880 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 263/570] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:11 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:30:12.474291 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3b8e3f49-2e3e-4c9f-a835-2359e0237305 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:12.476578 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3b8e3f49-2e3e-4c9f-a835-2359e0237305 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:12.484445 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3b8e3f49-2e3e-4c9f-a835-2359e0237305 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:12.484885 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3b8e3f49-2e3e-4c9f-a835-2359e0237305 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:12.485664 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3b8e3f49-2e3e-4c9f-a835-2359e0237305 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:12.486124 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3b8e3f49-2e3e-4c9f-a835-2359e0237305 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:12.521414 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3b8e3f49-2e3e-4c9f-a835-2359e0237305 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051807 Jul 26 07:30:12.522322 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 308/571] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:12 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:12.701201 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ac3278b5-d1db-4457-86fe-7dfad0c1be13 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:12.701831 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ac3278b5-d1db-4457-86fe-7dfad0c1be13 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:12.710082 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ac3278b5-d1db-4457-86fe-7dfad0c1be13 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:12.710580 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ac3278b5-d1db-4457-86fe-7dfad0c1be13 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:12.711406 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ac3278b5-d1db-4457-86fe-7dfad0c1be13 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:12.711874 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ac3278b5-d1db-4457-86fe-7dfad0c1be13 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:12.783843 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ac3278b5-d1db-4457-86fe-7dfad0c1be13 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:12.786378 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:30:12.794067 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ac3278b5-d1db-4457-86fe-7dfad0c1be13 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.097059 Jul 26 07:30:12.794736 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 264/572] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:12 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:30:13.541284 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8becc142-83dc-4af0-9c93-92c11afc4575 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:13.545035 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8becc142-83dc-4af0-9c93-92c11afc4575 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:13.562311 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8becc142-83dc-4af0-9c93-92c11afc4575 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:13.562956 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8becc142-83dc-4af0-9c93-92c11afc4575 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:13.564131 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8becc142-83dc-4af0-9c93-92c11afc4575 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:13.564882 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8becc142-83dc-4af0-9c93-92c11afc4575 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:13.610752 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8becc142-83dc-4af0-9c93-92c11afc4575 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077120 Jul 26 07:30:13.611556 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 309/573] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:13 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:13.816356 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7cdec196-ab4c-49f6-ac42-872c52d0356b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:13.817141 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7cdec196-ab4c-49f6-ac42-872c52d0356b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:13.824288 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7cdec196-ab4c-49f6-ac42-872c52d0356b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:13.824737 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7cdec196-ab4c-49f6-ac42-872c52d0356b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:13.825514 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7cdec196-ab4c-49f6-ac42-872c52d0356b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:13.825988 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7cdec196-ab4c-49f6-ac42-872c52d0356b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:13.890799 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7cdec196-ab4c-49f6-ac42-872c52d0356b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:13.899310 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7cdec196-ab4c-49f6-ac42-872c52d0356b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.087098 Jul 26 07:30:13.899885 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 265/574] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:13 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:30:14.623831 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-fa1e5e47-440d-4b15-b108-07ba816a7804 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:14.626289 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-fa1e5e47-440d-4b15-b108-07ba816a7804 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:14.633492 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fa1e5e47-440d-4b15-b108-07ba816a7804 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:14.633948 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fa1e5e47-440d-4b15-b108-07ba816a7804 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:14.634753 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fa1e5e47-440d-4b15-b108-07ba816a7804 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:14.635173 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fa1e5e47-440d-4b15-b108-07ba816a7804 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:14.668100 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-fa1e5e47-440d-4b15-b108-07ba816a7804 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048245 Jul 26 07:30:14.668692 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 310/575] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:14 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:14.921474 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2c6ea5ba-ae2f-4abf-8ecb-f316b75dce64 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:14.922169 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2c6ea5ba-ae2f-4abf-8ecb-f316b75dce64 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:14.929461 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2c6ea5ba-ae2f-4abf-8ecb-f316b75dce64 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:14.929947 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2c6ea5ba-ae2f-4abf-8ecb-f316b75dce64 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:14.930741 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2c6ea5ba-ae2f-4abf-8ecb-f316b75dce64 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:14.931169 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2c6ea5ba-ae2f-4abf-8ecb-f316b75dce64 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:15.010046 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2c6ea5ba-ae2f-4abf-8ecb-f316b75dce64 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:15.023820 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2c6ea5ba-ae2f-4abf-8ecb-f316b75dce64 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.105987 Jul 26 07:30:15.024733 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 266/576] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:14 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:30:15.681145 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6023ccdf-e58e-4952-9e02-0179fd0fb811 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:15.683340 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-6023ccdf-e58e-4952-9e02-0179fd0fb811 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:15.690599 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6023ccdf-e58e-4952-9e02-0179fd0fb811 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:15.691080 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6023ccdf-e58e-4952-9e02-0179fd0fb811 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:15.691848 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6023ccdf-e58e-4952-9e02-0179fd0fb811 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:15.692275 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6023ccdf-e58e-4952-9e02-0179fd0fb811 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:15.726880 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6023ccdf-e58e-4952-9e02-0179fd0fb811 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049685 Jul 26 07:30:15.727348 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 311/577] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:15 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:16.046876 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-09ece19f-8929-4572-b319-e68f381a878e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:16.047817 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-09ece19f-8929-4572-b319-e68f381a878e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:16.054504 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-09ece19f-8929-4572-b319-e68f381a878e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:16.054961 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-09ece19f-8929-4572-b319-e68f381a878e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:16.055998 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-09ece19f-8929-4572-b319-e68f381a878e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:16.056488 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-09ece19f-8929-4572-b319-e68f381a878e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:16.127374 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-09ece19f-8929-4572-b319-e68f381a878e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:16.136160 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-09ece19f-8929-4572-b319-e68f381a878e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.094226 Jul 26 07:30:16.136839 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 267/578] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:16 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:30:16.740537 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-034887a0-d0dc-4145-9675-79991a81f93c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:16.742832 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-034887a0-d0dc-4145-9675-79991a81f93c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:16.750403 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-034887a0-d0dc-4145-9675-79991a81f93c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:16.750855 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-034887a0-d0dc-4145-9675-79991a81f93c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:16.751636 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-034887a0-d0dc-4145-9675-79991a81f93c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:16.752067 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-034887a0-d0dc-4145-9675-79991a81f93c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:16.796348 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-034887a0-d0dc-4145-9675-79991a81f93c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060273 Jul 26 07:30:16.796944 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 312/579] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:16 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:17.159467 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-898b92b2-b52e-4690-a68b-93de625efb77 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:17.160217 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-898b92b2-b52e-4690-a68b-93de625efb77 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:17.167963 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-898b92b2-b52e-4690-a68b-93de625efb77 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:17.168414 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-898b92b2-b52e-4690-a68b-93de625efb77 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:17.169215 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-898b92b2-b52e-4690-a68b-93de625efb77 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:17.169648 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-898b92b2-b52e-4690-a68b-93de625efb77 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:17.240488 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-898b92b2-b52e-4690-a68b-93de625efb77 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:17.249218 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-898b92b2-b52e-4690-a68b-93de625efb77 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.093673 Jul 26 07:30:17.249936 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 268/580] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:17 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:30:17.809510 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-adaf67f2-ad7f-43a8-a3aa-7c0c9eb683f7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:17.811803 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-adaf67f2-ad7f-43a8-a3aa-7c0c9eb683f7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:17.819478 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-adaf67f2-ad7f-43a8-a3aa-7c0c9eb683f7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:17.819932 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-adaf67f2-ad7f-43a8-a3aa-7c0c9eb683f7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:17.820732 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-adaf67f2-ad7f-43a8-a3aa-7c0c9eb683f7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:17.821188 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-adaf67f2-ad7f-43a8-a3aa-7c0c9eb683f7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:17.859059 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-adaf67f2-ad7f-43a8-a3aa-7c0c9eb683f7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053594 Jul 26 07:30:17.859887 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 313/581] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:17 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:18.272320 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-26082212-d1da-41a4-a2a5-503ec92725cb tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:18.272922 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-26082212-d1da-41a4-a2a5-503ec92725cb tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:18.279925 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-26082212-d1da-41a4-a2a5-503ec92725cb tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:18.280362 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-26082212-d1da-41a4-a2a5-503ec92725cb tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:18.281146 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-26082212-d1da-41a4-a2a5-503ec92725cb tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:18.281572 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-26082212-d1da-41a4-a2a5-503ec92725cb tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:18.356157 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-26082212-d1da-41a4-a2a5-503ec92725cb tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:18.365473 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-26082212-d1da-41a4-a2a5-503ec92725cb tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1243 microversion: 2.1 time: 0.097000 Jul 26 07:30:18.366125 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 269/582] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:18 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1243 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:30:18.876889 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7c756f7f-7e01-4d97-94cf-5954840fadbe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:18.884147 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7c756f7f-7e01-4d97-94cf-5954840fadbe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:18.905701 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7c756f7f-7e01-4d97-94cf-5954840fadbe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:18.906192 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7c756f7f-7e01-4d97-94cf-5954840fadbe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:18.907011 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7c756f7f-7e01-4d97-94cf-5954840fadbe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:18.907454 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7c756f7f-7e01-4d97-94cf-5954840fadbe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:18.946852 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7c756f7f-7e01-4d97-94cf-5954840fadbe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077257 Jul 26 07:30:18.947848 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 314/583] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:18 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:19.390111 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f44ec0f8-e049-400c-885e-db55ed61cb38 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:19.391003 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-f44ec0f8-e049-400c-885e-db55ed61cb38 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:19.398925 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f44ec0f8-e049-400c-885e-db55ed61cb38 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:19.399655 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f44ec0f8-e049-400c-885e-db55ed61cb38 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:19.400470 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f44ec0f8-e049-400c-885e-db55ed61cb38 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:19.400909 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f44ec0f8-e049-400c-885e-db55ed61cb38 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:19.481907 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-f44ec0f8-e049-400c-885e-db55ed61cb38 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:19.490586 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f44ec0f8-e049-400c-885e-db55ed61cb38 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1291 microversion: 2.1 time: 0.106301 Jul 26 07:30:19.491379 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 270/584] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:19 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1291 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:30:19.964416 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-204c875e-730e-4dea-9072-99adbba3d3bc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:19.968089 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-204c875e-730e-4dea-9072-99adbba3d3bc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:19.992916 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-204c875e-730e-4dea-9072-99adbba3d3bc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:20.000120 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-204c875e-730e-4dea-9072-99adbba3d3bc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:20.006293 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-204c875e-730e-4dea-9072-99adbba3d3bc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:20.007382 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-204c875e-730e-4dea-9072-99adbba3d3bc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:20.066134 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-204c875e-730e-4dea-9072-99adbba3d3bc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.107302 Jul 26 07:30:20.067614 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 315/585] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:19 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:20.352189 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ca6d0da3-27be-4a80-8a45-029ac6228bb5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:30:20.355423 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ca6d0da3-27be-4a80-8a45-029ac6228bb5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:20.370981 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ca6d0da3-27be-4a80-8a45-029ac6228bb5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:20.371444 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ca6d0da3-27be-4a80-8a45-029ac6228bb5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:20.376683 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ca6d0da3-27be-4a80-8a45-029ac6228bb5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:20.377490 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ca6d0da3-27be-4a80-8a45-029ac6228bb5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:20.432756 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.objects.instance [None req-ca6d0da3-27be-4a80-8a45-029ac6228bb5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lazy-loading 'flavor' on Instance uuid 8172b67c-005b-4f1f-91f0-f6ce67a50ab1 {{(pid=117716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 07:30:20.518191 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-29db5a57-32b5-4e75-af72-a48affa56650 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:20.519273 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-29db5a57-32b5-4e75-af72-a48affa56650 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:20.527833 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-29db5a57-32b5-4e75-af72-a48affa56650 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:20.528824 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-29db5a57-32b5-4e75-af72-a48affa56650 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:20.530042 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-29db5a57-32b5-4e75-af72-a48affa56650 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:20.530714 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-29db5a57-32b5-4e75-af72-a48affa56650 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:20.635516 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-29db5a57-32b5-4e75-af72-a48affa56650 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:20.644409 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-29db5a57-32b5-4e75-af72-a48affa56650 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1297 microversion: 2.1 time: 0.133805 Jul 26 07:30:20.646009 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 316/586] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:20 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1297 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:30:20.672523 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ca6d0da3-27be-4a80-8a45-029ac6228bb5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "POST /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/action" status: 200 len: 32 microversion: 2.1 time: 0.325603 Jul 26 07:30:20.673873 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 271/587] 10.222.0.39 () {60 vars in 1278 bytes} [Tue Jul 26 07:30:20 2022] POST /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/action => generated 32 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 07:30:20.686129 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-baad75bb-86ff-4368-9143-5c4c509a4204 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:20.687062 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-baad75bb-86ff-4368-9143-5c4c509a4204 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:20.696245 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-baad75bb-86ff-4368-9143-5c4c509a4204 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:20.697025 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-baad75bb-86ff-4368-9143-5c4c509a4204 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:20.698800 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-baad75bb-86ff-4368-9143-5c4c509a4204 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:20.699678 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-baad75bb-86ff-4368-9143-5c4c509a4204 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:20.995064 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-baad75bb-86ff-4368-9143-5c4c509a4204 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:21.019156 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-baad75bb-86ff-4368-9143-5c4c509a4204 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.337095 Jul 26 07:30:21.021999 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 317/588] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:20 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:30:21.080179 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7ada1c25-2d50-4f16-81d3-3accf401adc6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:21.083602 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7ada1c25-2d50-4f16-81d3-3accf401adc6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:21.090894 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7ada1c25-2d50-4f16-81d3-3accf401adc6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:21.091537 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7ada1c25-2d50-4f16-81d3-3accf401adc6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:21.092832 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7ada1c25-2d50-4f16-81d3-3accf401adc6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:21.093379 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7ada1c25-2d50-4f16-81d3-3accf401adc6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:21.129672 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7ada1c25-2d50-4f16-81d3-3accf401adc6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053880 Jul 26 07:30:21.136227 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 272/589] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:21 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:21.676314 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-75b38a57-140a-4448-bd85-e74b6b399379 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:21.676919 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-75b38a57-140a-4448-bd85-e74b6b399379 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:21.692867 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-75b38a57-140a-4448-bd85-e74b6b399379 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:21.693678 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-75b38a57-140a-4448-bd85-e74b6b399379 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:21.695209 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-75b38a57-140a-4448-bd85-e74b6b399379 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:21.695959 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-75b38a57-140a-4448-bd85-e74b6b399379 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:21.918519 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-75b38a57-140a-4448-bd85-e74b6b399379 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:21.932594 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-75b38a57-140a-4448-bd85-e74b6b399379 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1365 microversion: 2.1 time: 0.260737 Jul 26 07:30:21.933661 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 318/590] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:21 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1365 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:30:22.048698 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-439d55c0-8518-4f6c-ab6f-0923ca895a52 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:22.049776 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-439d55c0-8518-4f6c-ab6f-0923ca895a52 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:22.062333 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-439d55c0-8518-4f6c-ab6f-0923ca895a52 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:22.063157 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-439d55c0-8518-4f6c-ab6f-0923ca895a52 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:22.064611 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-439d55c0-8518-4f6c-ab6f-0923ca895a52 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:22.065329 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-439d55c0-8518-4f6c-ab6f-0923ca895a52 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:22.143948 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-1ec0eae1-94a7-4cfe-ad2f-d8ffe7ea510e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:22.146928 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-1ec0eae1-94a7-4cfe-ad2f-d8ffe7ea510e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:22.155382 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1ec0eae1-94a7-4cfe-ad2f-d8ffe7ea510e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:22.156061 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1ec0eae1-94a7-4cfe-ad2f-d8ffe7ea510e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:22.157183 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1ec0eae1-94a7-4cfe-ad2f-d8ffe7ea510e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:22.157884 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1ec0eae1-94a7-4cfe-ad2f-d8ffe7ea510e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:22.197074 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-1ec0eae1-94a7-4cfe-ad2f-d8ffe7ea510e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057582 Jul 26 07:30:22.197888 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 319/591] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:22 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 07:30:22.472013 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-439d55c0-8518-4f6c-ab6f-0923ca895a52 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:22.487221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-439d55c0-8518-4f6c-ab6f-0923ca895a52 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.445955 Jul 26 07:30:22.494003 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 273/592] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:22 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:30:22.946306 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-1af52d81-e183-46a0-ba5c-b6c7c8761755 req-4227b227-4527-41b6-8aa4-7c883f1f52a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88ea2e0b-57a1-4a83-9324-6f6f6f000641", "tag": "809ec1cc-1c2d-4cc5-99de-57dfa200139f"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:30:22.960447 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-02a05ad6-a21c-4b08-ba28-8965a9b567d1 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:22.967994 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-02a05ad6-a21c-4b08-ba28-8965a9b567d1 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:22.968970 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-1af52d81-e183-46a0-ba5c-b6c7c8761755 req-4227b227-4527-41b6-8aa4-7c883f1f52a4 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:22.969430 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-1af52d81-e183-46a0-ba5c-b6c7c8761755 req-4227b227-4527-41b6-8aa4-7c883f1f52a4 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:22.988623 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-02a05ad6-a21c-4b08-ba28-8965a9b567d1 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:22.989309 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-02a05ad6-a21c-4b08-ba28-8965a9b567d1 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:22.990414 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-02a05ad6-a21c-4b08-ba28-8965a9b567d1 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:22.991015 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-02a05ad6-a21c-4b08-ba28-8965a9b567d1 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:23.004561 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-1af52d81-e183-46a0-ba5c-b6c7c8761755 req-4227b227-4527-41b6-8aa4-7c883f1f52a4 service nova] Creating event network-changed:809ec1cc-1c2d-4cc5-99de-57dfa200139f for instance 88ea2e0b-57a1-4a83-9324-6f6f6f000641 on hv-cinder-85083 Jul 26 07:30:23.029121 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-1af52d81-e183-46a0-ba5c-b6c7c8761755 req-4227b227-4527-41b6-8aa4-7c883f1f52a4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082662 Jul 26 07:30:23.031020 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 320/593] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 07:30:23.214322 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6d55709b-b3f0-45b8-8675-9beea018fc54 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:23.218091 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-6d55709b-b3f0-45b8-8675-9beea018fc54 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:23.225702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6d55709b-b3f0-45b8-8675-9beea018fc54 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:23.226094 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6d55709b-b3f0-45b8-8675-9beea018fc54 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:23.226888 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6d55709b-b3f0-45b8-8675-9beea018fc54 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:23.227382 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6d55709b-b3f0-45b8-8675-9beea018fc54 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:23.264962 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6d55709b-b3f0-45b8-8675-9beea018fc54 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055444 Jul 26 07:30:23.265835 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 321/594] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:23 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:23.266998 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-02a05ad6-a21c-4b08-ba28-8965a9b567d1 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:23.279080 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-02a05ad6-a21c-4b08-ba28-8965a9b567d1 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1365 microversion: 2.1 time: 0.327208 Jul 26 07:30:23.279681 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 274/595] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:22 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1365 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:30:23.513178 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-2455e0f4-a324-4c9f-b608-7c1c750db215 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:23.513819 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2455e0f4-a324-4c9f-b608-7c1c750db215 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:23.520678 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2455e0f4-a324-4c9f-b608-7c1c750db215 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:23.521124 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2455e0f4-a324-4c9f-b608-7c1c750db215 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:23.521938 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2455e0f4-a324-4c9f-b608-7c1c750db215 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:23.522370 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2455e0f4-a324-4c9f-b608-7c1c750db215 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:23.667083 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2455e0f4-a324-4c9f-b608-7c1c750db215 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:23.675827 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-2455e0f4-a324-4c9f-b608-7c1c750db215 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.167053 Jul 26 07:30:23.676472 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 322/596] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:23 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:30:24.278387 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-23b10a50-0782-48a4-a3fd-355c77b2aa54 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:24.280686 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-23b10a50-0782-48a4-a3fd-355c77b2aa54 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:24.287654 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-23b10a50-0782-48a4-a3fd-355c77b2aa54 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:24.288094 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-23b10a50-0782-48a4-a3fd-355c77b2aa54 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:24.288847 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-23b10a50-0782-48a4-a3fd-355c77b2aa54 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:24.289291 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-23b10a50-0782-48a4-a3fd-355c77b2aa54 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:24.300941 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7001bbd1-9577-4bb5-8256-50180a5c7236 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:24.303786 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7001bbd1-9577-4bb5-8256-50180a5c7236 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:24.309317 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7001bbd1-9577-4bb5-8256-50180a5c7236 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:24.309792 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7001bbd1-9577-4bb5-8256-50180a5c7236 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:24.310599 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7001bbd1-9577-4bb5-8256-50180a5c7236 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:24.311025 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7001bbd1-9577-4bb5-8256-50180a5c7236 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:24.328681 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-23b10a50-0782-48a4-a3fd-355c77b2aa54 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054402 Jul 26 07:30:24.329603 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 275/597] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:24 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:24.594177 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7001bbd1-9577-4bb5-8256-50180a5c7236 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:24.604139 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7001bbd1-9577-4bb5-8256-50180a5c7236 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1365 microversion: 2.1 time: 0.307224 Jul 26 07:30:24.604914 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 323/598] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:24 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1365 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:30:24.701004 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c0a8f701-e9f2-4be9-8090-8a746e687680 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:24.702546 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c0a8f701-e9f2-4be9-8090-8a746e687680 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:24.714483 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c0a8f701-e9f2-4be9-8090-8a746e687680 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:24.715326 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c0a8f701-e9f2-4be9-8090-8a746e687680 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:24.716810 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c0a8f701-e9f2-4be9-8090-8a746e687680 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:24.718037 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c0a8f701-e9f2-4be9-8090-8a746e687680 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:25.071573 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-c0a8f701-e9f2-4be9-8090-8a746e687680 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:25.081935 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c0a8f701-e9f2-4be9-8090-8a746e687680 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.386854 Jul 26 07:30:25.082641 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 276/599] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:24 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:30:25.345892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-bdbffed6-7204-477c-b9a7-7226e1f7f4b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:25.348119 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-bdbffed6-7204-477c-b9a7-7226e1f7f4b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:25.355526 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bdbffed6-7204-477c-b9a7-7226e1f7f4b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:25.355945 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bdbffed6-7204-477c-b9a7-7226e1f7f4b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:25.357068 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bdbffed6-7204-477c-b9a7-7226e1f7f4b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:25.357586 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bdbffed6-7204-477c-b9a7-7226e1f7f4b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:25.391952 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-bdbffed6-7204-477c-b9a7-7226e1f7f4b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051034 Jul 26 07:30:25.392541 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 324/600] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:25 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:25.638471 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-5ee00b4d-7bc9-47e3-b9d8-7dc545012264 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:25.639266 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-5ee00b4d-7bc9-47e3-b9d8-7dc545012264 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:25.648498 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5ee00b4d-7bc9-47e3-b9d8-7dc545012264 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:25.648945 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5ee00b4d-7bc9-47e3-b9d8-7dc545012264 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:25.649927 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5ee00b4d-7bc9-47e3-b9d8-7dc545012264 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:25.650223 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5ee00b4d-7bc9-47e3-b9d8-7dc545012264 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:25.853867 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-5ee00b4d-7bc9-47e3-b9d8-7dc545012264 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:25.862245 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-5ee00b4d-7bc9-47e3-b9d8-7dc545012264 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1365 microversion: 2.1 time: 0.228736 Jul 26 07:30:25.862853 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 277/601] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:25 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1365 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:30:26.105073 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-08d39859-f12b-4d1c-9594-ef46b5af87b0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:26.105763 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-08d39859-f12b-4d1c-9594-ef46b5af87b0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:26.113189 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-08d39859-f12b-4d1c-9594-ef46b5af87b0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:26.113707 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-08d39859-f12b-4d1c-9594-ef46b5af87b0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:26.114649 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-08d39859-f12b-4d1c-9594-ef46b5af87b0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:26.115093 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-08d39859-f12b-4d1c-9594-ef46b5af87b0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:26.120146 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:30:26.287935 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-08d39859-f12b-4d1c-9594-ef46b5af87b0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:26.297733 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-08d39859-f12b-4d1c-9594-ef46b5af87b0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.196881 Jul 26 07:30:26.298376 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 325/602] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:26 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:30:26.405414 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-4f96230c-9119-4a7a-a445-1b6950b3e31c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:26.407590 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-4f96230c-9119-4a7a-a445-1b6950b3e31c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:26.414934 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4f96230c-9119-4a7a-a445-1b6950b3e31c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:26.415381 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4f96230c-9119-4a7a-a445-1b6950b3e31c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:26.416169 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4f96230c-9119-4a7a-a445-1b6950b3e31c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:26.416585 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4f96230c-9119-4a7a-a445-1b6950b3e31c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:26.454655 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-4f96230c-9119-4a7a-a445-1b6950b3e31c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053446 Jul 26 07:30:26.455268 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 278/603] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:26 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:26.885059 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9ee204a8-5b3c-4b07-a330-342ba4b5f0c2 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:26.885996 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-9ee204a8-5b3c-4b07-a330-342ba4b5f0c2 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:26.894066 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9ee204a8-5b3c-4b07-a330-342ba4b5f0c2 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:26.894896 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9ee204a8-5b3c-4b07-a330-342ba4b5f0c2 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:26.896265 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9ee204a8-5b3c-4b07-a330-342ba4b5f0c2 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:26.896984 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9ee204a8-5b3c-4b07-a330-342ba4b5f0c2 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:27.066905 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-9ee204a8-5b3c-4b07-a330-342ba4b5f0c2 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:27.076539 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-9ee204a8-5b3c-4b07-a330-342ba4b5f0c2 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1365 microversion: 2.1 time: 0.195702 Jul 26 07:30:27.077426 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 326/604] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:26 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1365 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:30:27.333505 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d2851e18-3b76-484c-bd0b-6b40395cac9d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:27.334586 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d2851e18-3b76-484c-bd0b-6b40395cac9d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:27.343257 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d2851e18-3b76-484c-bd0b-6b40395cac9d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:27.343890 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d2851e18-3b76-484c-bd0b-6b40395cac9d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:27.344969 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d2851e18-3b76-484c-bd0b-6b40395cac9d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:27.345449 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d2851e18-3b76-484c-bd0b-6b40395cac9d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:27.363201 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:30:27.468901 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-dd681e42-e3dc-485c-bcf7-92fbc1fddb3a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:27.471602 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-dd681e42-e3dc-485c-bcf7-92fbc1fddb3a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:27.480201 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dd681e42-e3dc-485c-bcf7-92fbc1fddb3a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:27.480748 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dd681e42-e3dc-485c-bcf7-92fbc1fddb3a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:27.481831 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dd681e42-e3dc-485c-bcf7-92fbc1fddb3a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:27.482427 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dd681e42-e3dc-485c-bcf7-92fbc1fddb3a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:27.530917 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-dd681e42-e3dc-485c-bcf7-92fbc1fddb3a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066795 Jul 26 07:30:27.531758 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 327/605] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:27 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 07:30:27.542097 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d2851e18-3b76-484c-bd0b-6b40395cac9d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:27.552835 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d2851e18-3b76-484c-bd0b-6b40395cac9d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.223804 Jul 26 07:30:27.553630 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 279/606] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:27 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:30:28.111050 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-0d01e334-d137-493f-a08a-4c12916d877b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:28.112231 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-0d01e334-d137-493f-a08a-4c12916d877b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:28.123085 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0d01e334-d137-493f-a08a-4c12916d877b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:28.123806 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0d01e334-d137-493f-a08a-4c12916d877b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:28.125152 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0d01e334-d137-493f-a08a-4c12916d877b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:28.125799 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0d01e334-d137-493f-a08a-4c12916d877b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:28.343353 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-0d01e334-d137-493f-a08a-4c12916d877b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:28.351865 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-0d01e334-d137-493f-a08a-4c12916d877b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1365 microversion: 2.1 time: 0.248093 Jul 26 07:30:28.352547 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 328/607] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:28 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1365 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:30:28.545438 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-214d7819-5697-414b-bbaf-2b3310a59934 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:28.548363 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-214d7819-5697-414b-bbaf-2b3310a59934 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:28.558491 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-214d7819-5697-414b-bbaf-2b3310a59934 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:28.559249 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-214d7819-5697-414b-bbaf-2b3310a59934 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:28.560608 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-214d7819-5697-414b-bbaf-2b3310a59934 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:28.561625 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-214d7819-5697-414b-bbaf-2b3310a59934 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:28.578565 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3e9a2a40-2927-4e15-860f-15231fd48b29 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:28.579536 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3e9a2a40-2927-4e15-860f-15231fd48b29 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:28.588826 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3e9a2a40-2927-4e15-860f-15231fd48b29 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:28.589783 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3e9a2a40-2927-4e15-860f-15231fd48b29 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:28.591620 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3e9a2a40-2927-4e15-860f-15231fd48b29 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:28.593058 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3e9a2a40-2927-4e15-860f-15231fd48b29 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:28.617969 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-214d7819-5697-414b-bbaf-2b3310a59934 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077180 Jul 26 07:30:28.619229 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 280/608] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:28 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 07:30:28.747936 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-379b3a01-ae66-4336-abc8-137f741bedd0 req-563bab40-ffa1-47ca-928b-a513ae6da170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88ea2e0b-57a1-4a83-9324-6f6f6f000641", "name": "network-vif-plugged", "status": "completed", "tag": "809ec1cc-1c2d-4cc5-99de-57dfa200139f"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:30:28.757809 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3e9a2a40-2927-4e15-860f-15231fd48b29 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:28.768019 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-379b3a01-ae66-4336-abc8-137f741bedd0 req-563bab40-ffa1-47ca-928b-a513ae6da170 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:28.768742 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-379b3a01-ae66-4336-abc8-137f741bedd0 req-563bab40-ffa1-47ca-928b-a513ae6da170 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:28.775941 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3e9a2a40-2927-4e15-860f-15231fd48b29 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.202811 Jul 26 07:30:28.777278 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 329/609] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:28 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:30:28.795164 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-379b3a01-ae66-4336-abc8-137f741bedd0 req-563bab40-ffa1-47ca-928b-a513ae6da170 service nova] Creating event network-vif-plugged:809ec1cc-1c2d-4cc5-99de-57dfa200139f for instance 88ea2e0b-57a1-4a83-9324-6f6f6f000641 on hv-cinder-85083 Jul 26 07:30:28.800849 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-379b3a01-ae66-4336-abc8-137f741bedd0 req-563bab40-ffa1-47ca-928b-a513ae6da170 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061615 Jul 26 07:30:28.801522 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 281/610] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 07:30:29.373430 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-68415542-cc25-44b9-855d-a379e69e2eb9 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:29.374449 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-68415542-cc25-44b9-855d-a379e69e2eb9 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:29.382308 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-68415542-cc25-44b9-855d-a379e69e2eb9 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:29.382926 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-68415542-cc25-44b9-855d-a379e69e2eb9 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:29.383758 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-68415542-cc25-44b9-855d-a379e69e2eb9 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:29.384237 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-68415542-cc25-44b9-855d-a379e69e2eb9 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:29.542811 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-68415542-cc25-44b9-855d-a379e69e2eb9 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:29.551760 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-68415542-cc25-44b9-855d-a379e69e2eb9 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1365 microversion: 2.1 time: 0.182546 Jul 26 07:30:29.552368 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 330/611] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:29 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:30:29.633154 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-53dde6b9-8f74-4644-8bb7-4396fe13b209 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:29.635721 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-53dde6b9-8f74-4644-8bb7-4396fe13b209 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:29.648982 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-53dde6b9-8f74-4644-8bb7-4396fe13b209 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:29.649440 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-53dde6b9-8f74-4644-8bb7-4396fe13b209 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:29.650283 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-53dde6b9-8f74-4644-8bb7-4396fe13b209 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:29.650722 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-53dde6b9-8f74-4644-8bb7-4396fe13b209 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:29.689149 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-53dde6b9-8f74-4644-8bb7-4396fe13b209 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060780 Jul 26 07:30:29.689923 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 282/612] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:29 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:29.798284 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-2cc9e068-9fc3-451a-985e-d3beac007624 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:29.798879 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2cc9e068-9fc3-451a-985e-d3beac007624 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:29.805808 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2cc9e068-9fc3-451a-985e-d3beac007624 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:29.806252 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2cc9e068-9fc3-451a-985e-d3beac007624 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:29.807043 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2cc9e068-9fc3-451a-985e-d3beac007624 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:29.807475 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2cc9e068-9fc3-451a-985e-d3beac007624 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:29.976679 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2cc9e068-9fc3-451a-985e-d3beac007624 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:29.985480 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-2cc9e068-9fc3-451a-985e-d3beac007624 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.191270 Jul 26 07:30:29.986120 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 331/613] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:29 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:30:30.651050 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-27daec38-58f0-4385-800f-f8f60d1c1753 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:30.651983 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-27daec38-58f0-4385-800f-f8f60d1c1753 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:30.662911 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-27daec38-58f0-4385-800f-f8f60d1c1753 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:30.663673 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-27daec38-58f0-4385-800f-f8f60d1c1753 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:30.665083 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-27daec38-58f0-4385-800f-f8f60d1c1753 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:30.665914 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-27daec38-58f0-4385-800f-f8f60d1c1753 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:30.710853 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-845291ea-f3fe-4b02-ad49-0dfbd4d8fd04 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:30.719216 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-845291ea-f3fe-4b02-ad49-0dfbd4d8fd04 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:30.738048 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-845291ea-f3fe-4b02-ad49-0dfbd4d8fd04 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:30.739211 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-845291ea-f3fe-4b02-ad49-0dfbd4d8fd04 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:30.740808 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-845291ea-f3fe-4b02-ad49-0dfbd4d8fd04 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:30.741506 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-845291ea-f3fe-4b02-ad49-0dfbd4d8fd04 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:30.804360 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-845291ea-f3fe-4b02-ad49-0dfbd4d8fd04 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.105651 Jul 26 07:30:30.805371 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 332/614] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:30 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 07:30:30.923044 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-27daec38-58f0-4385-800f-f8f60d1c1753 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:30.936302 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-27daec38-58f0-4385-800f-f8f60d1c1753 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1365 microversion: 2.1 time: 0.365516 Jul 26 07:30:30.937319 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 283/615] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:30 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1365 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:30:31.008987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d15eddf7-4a0d-4aeb-82ce-d76cb23561cd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:31.009822 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d15eddf7-4a0d-4aeb-82ce-d76cb23561cd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:31.020248 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d15eddf7-4a0d-4aeb-82ce-d76cb23561cd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:31.020963 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d15eddf7-4a0d-4aeb-82ce-d76cb23561cd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:31.022624 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d15eddf7-4a0d-4aeb-82ce-d76cb23561cd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:31.023562 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d15eddf7-4a0d-4aeb-82ce-d76cb23561cd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:31.225318 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d15eddf7-4a0d-4aeb-82ce-d76cb23561cd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:31.234918 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d15eddf7-4a0d-4aeb-82ce-d76cb23561cd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.230192 Jul 26 07:30:31.240099 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 333/616] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:31 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:30:31.818009 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-3333249e-2cf4-4898-b5c3-8a99133cb16c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:31.820368 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-3333249e-2cf4-4898-b5c3-8a99133cb16c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:31.827548 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3333249e-2cf4-4898-b5c3-8a99133cb16c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:31.827992 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3333249e-2cf4-4898-b5c3-8a99133cb16c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:31.828768 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3333249e-2cf4-4898-b5c3-8a99133cb16c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:31.829194 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3333249e-2cf4-4898-b5c3-8a99133cb16c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:31.867591 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-3333249e-2cf4-4898-b5c3-8a99133cb16c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054155 Jul 26 07:30:31.868465 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 284/617] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:31 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:31.966639 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-cde05557-bb24-4dea-9562-c5b959b5d8ff tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:31.967752 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-cde05557-bb24-4dea-9562-c5b959b5d8ff tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:31.975496 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cde05557-bb24-4dea-9562-c5b959b5d8ff tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:31.975936 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cde05557-bb24-4dea-9562-c5b959b5d8ff tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:31.976718 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cde05557-bb24-4dea-9562-c5b959b5d8ff tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:31.977140 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cde05557-bb24-4dea-9562-c5b959b5d8ff tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:32.160204 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-cde05557-bb24-4dea-9562-c5b959b5d8ff tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:32.172653 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-cde05557-bb24-4dea-9562-c5b959b5d8ff tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1556 microversion: 2.1 time: 0.209723 Jul 26 07:30:32.173476 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 334/618] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:31 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1556 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:30:32.196556 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-e303c285-1b5f-47e6-bd30-7726d767e9a9 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:32.197044 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-e303c285-1b5f-47e6-bd30-7726d767e9a9 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:32.206290 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e303c285-1b5f-47e6-bd30-7726d767e9a9 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:32.207054 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e303c285-1b5f-47e6-bd30-7726d767e9a9 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:32.207903 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e303c285-1b5f-47e6-bd30-7726d767e9a9 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:32.208503 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e303c285-1b5f-47e6-bd30-7726d767e9a9 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:32.267283 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9024f3b7-b2e4-4999-aae4-b7fa8c2f673f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:32.271352 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-9024f3b7-b2e4-4999-aae4-b7fa8c2f673f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:32.282974 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9024f3b7-b2e4-4999-aae4-b7fa8c2f673f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:32.283781 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9024f3b7-b2e4-4999-aae4-b7fa8c2f673f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:32.285397 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9024f3b7-b2e4-4999-aae4-b7fa8c2f673f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:32.286710 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9024f3b7-b2e4-4999-aae4-b7fa8c2f673f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:32.305154 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-e303c285-1b5f-47e6-bd30-7726d767e9a9 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.110678 Jul 26 07:30:32.313791 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 285/619] 10.222.0.39 () {58 vars in 1275 bytes} [Tue Jul 26 07:30:32 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641/os-interface => generated 285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 07:30:32.674432 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-9024f3b7-b2e4-4999-aae4-b7fa8c2f673f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:32.684520 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-9024f3b7-b2e4-4999-aae4-b7fa8c2f673f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.430921 Jul 26 07:30:32.699101 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 335/620] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:32 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:30:32.887479 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ba32c194-a3bd-4d09-ac10-adefe04e010f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:32.891619 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ba32c194-a3bd-4d09-ac10-adefe04e010f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:32.903286 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ba32c194-a3bd-4d09-ac10-adefe04e010f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:32.904047 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ba32c194-a3bd-4d09-ac10-adefe04e010f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:32.905392 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ba32c194-a3bd-4d09-ac10-adefe04e010f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:32.906175 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ba32c194-a3bd-4d09-ac10-adefe04e010f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:32.961897 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ba32c194-a3bd-4d09-ac10-adefe04e010f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082641 Jul 26 07:30:32.962837 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 286/621] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:32 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:33.613652 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-b7f19cdf-9b19-4f6d-acc9-f3b6016148dd req-bae13e8e-0502-4c2c-aea6-66cb4dd808f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88ea2e0b-57a1-4a83-9324-6f6f6f000641", "tag": "809ec1cc-1c2d-4cc5-99de-57dfa200139f"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:30:33.619410 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=74 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:30:33.626088 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-b7f19cdf-9b19-4f6d-acc9-f3b6016148dd req-bae13e8e-0502-4c2c-aea6-66cb4dd808f3 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:33.626541 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-b7f19cdf-9b19-4f6d-acc9-f3b6016148dd req-bae13e8e-0502-4c2c-aea6-66cb4dd808f3 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:33.641570 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-b7f19cdf-9b19-4f6d-acc9-f3b6016148dd req-bae13e8e-0502-4c2c-aea6-66cb4dd808f3 service nova] Creating event network-changed:809ec1cc-1c2d-4cc5-99de-57dfa200139f for instance 88ea2e0b-57a1-4a83-9324-6f6f6f000641 on hv-cinder-85083 Jul 26 07:30:33.647546 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-b7f19cdf-9b19-4f6d-acc9-f3b6016148dd req-bae13e8e-0502-4c2c-aea6-66cb4dd808f3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037622 Jul 26 07:30:33.648171 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 336/622] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:30:33.706773 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d5a8b752-4f98-42f9-aa76-76c42f030561 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:33.707436 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d5a8b752-4f98-42f9-aa76-76c42f030561 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:33.709584 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=62 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:30:33.715306 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d5a8b752-4f98-42f9-aa76-76c42f030561 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:33.715738 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d5a8b752-4f98-42f9-aa76-76c42f030561 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:33.716532 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d5a8b752-4f98-42f9-aa76-76c42f030561 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:33.716961 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d5a8b752-4f98-42f9-aa76-76c42f030561 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:33.979757 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9404f57f-b693-4046-96a4-365563efabf9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:33.983514 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-9404f57f-b693-4046-96a4-365563efabf9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:33.996500 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9404f57f-b693-4046-96a4-365563efabf9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:33.997677 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9404f57f-b693-4046-96a4-365563efabf9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:33.999596 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9404f57f-b693-4046-96a4-365563efabf9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:33.999916 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9404f57f-b693-4046-96a4-365563efabf9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:34.062390 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-9404f57f-b693-4046-96a4-365563efabf9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.089195 Jul 26 07:30:34.069683 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 337/623] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:33 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 07:30:34.124074 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d5a8b752-4f98-42f9-aa76-76c42f030561 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:34.133399 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d5a8b752-4f98-42f9-aa76-76c42f030561 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.430890 Jul 26 07:30:34.134703 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 287/624] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:33 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:30:35.080833 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-afc7be37-6c08-4d93-bc1a-48e0f6ca4a3b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:35.084864 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-afc7be37-6c08-4d93-bc1a-48e0f6ca4a3b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:35.096154 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-afc7be37-6c08-4d93-bc1a-48e0f6ca4a3b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:35.096935 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-afc7be37-6c08-4d93-bc1a-48e0f6ca4a3b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:35.098405 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-afc7be37-6c08-4d93-bc1a-48e0f6ca4a3b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:35.099133 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-afc7be37-6c08-4d93-bc1a-48e0f6ca4a3b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:35.154783 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-afc7be37-6c08-4d93-bc1a-48e0f6ca4a3b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.080359 Jul 26 07:30:35.155835 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 338/625] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:35 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:35.168080 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-fa69aadf-8a7f-4b88-ac4f-a5d049e00a48 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:35.168697 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-fa69aadf-8a7f-4b88-ac4f-a5d049e00a48 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:35.176429 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fa69aadf-8a7f-4b88-ac4f-a5d049e00a48 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:35.176883 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fa69aadf-8a7f-4b88-ac4f-a5d049e00a48 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:35.177685 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fa69aadf-8a7f-4b88-ac4f-a5d049e00a48 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:35.178170 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fa69aadf-8a7f-4b88-ac4f-a5d049e00a48 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:35.334459 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-fa69aadf-8a7f-4b88-ac4f-a5d049e00a48 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:35.344140 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-fa69aadf-8a7f-4b88-ac4f-a5d049e00a48 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.180198 Jul 26 07:30:35.344750 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 288/626] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:35 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:30:36.169295 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-694ee4fa-1af9-4de0-9ffe-561f86f9016d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:36.171759 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-694ee4fa-1af9-4de0-9ffe-561f86f9016d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:36.179389 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-694ee4fa-1af9-4de0-9ffe-561f86f9016d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:36.179834 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-694ee4fa-1af9-4de0-9ffe-561f86f9016d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:36.180620 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-694ee4fa-1af9-4de0-9ffe-561f86f9016d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:36.181051 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-694ee4fa-1af9-4de0-9ffe-561f86f9016d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:36.216013 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-694ee4fa-1af9-4de0-9ffe-561f86f9016d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051118 Jul 26 07:30:36.216601 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 339/627] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:36 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:36.366753 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-564009db-1b78-41e8-affa-c18a695def45 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:36.367441 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-564009db-1b78-41e8-affa-c18a695def45 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:36.375493 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-564009db-1b78-41e8-affa-c18a695def45 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:36.375947 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-564009db-1b78-41e8-affa-c18a695def45 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:36.376718 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-564009db-1b78-41e8-affa-c18a695def45 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:36.377162 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-564009db-1b78-41e8-affa-c18a695def45 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:36.544979 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-564009db-1b78-41e8-affa-c18a695def45 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:36.555342 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-564009db-1b78-41e8-affa-c18a695def45 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1715 microversion: 2.1 time: 0.192185 Jul 26 07:30:36.555537 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 289/628] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:36 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1715 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:30:36.719446 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c612f87c-c96d-400a-a76d-08ed5df1bb65 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:36.719940 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c612f87c-c96d-400a-a76d-08ed5df1bb65 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:36.726831 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c612f87c-c96d-400a-a76d-08ed5df1bb65 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:36.727281 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c612f87c-c96d-400a-a76d-08ed5df1bb65 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:36.728066 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c612f87c-c96d-400a-a76d-08ed5df1bb65 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:36.728493 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c612f87c-c96d-400a-a76d-08ed5df1bb65 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:36.820811 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.wsgi [None req-c612f87c-c96d-400a-a76d-08ed5df1bb65 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] HTTP exception thrown: Cannot 'detach_volume' instance 8172b67c-005b-4f1f-91f0-f6ce67a50ab1 while it is in vm_state rescued Jul 26 07:30:36.822499 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c612f87c-c96d-400a-a76d-08ed5df1bb65 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Request method failure captured: Jul 26 07:30:36.822499 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: request: DELETE /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments/ee55fc9d-589c-41b9-a688-ef26d365900c HTTP/1.1 Jul 26 07:30:36.822499 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept: application/json Jul 26 07:30:36.822499 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept-Encoding: identity Jul 26 07:30:36.822499 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Connection: close Jul 26 07:30:36.822499 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Length: 0 Jul 26 07:30:36.822499 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Type: application/json Jul 26 07:30:36.822499 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Host: 10.222.0.39 Jul 26 07:30:36.822499 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Openstack-System-Scope: None Jul 26 07:30:36.822499 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: User-Agent: python-urllib3/1.26.10 Jul 26 07:30:36.822499 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Auth-Token: gAAAAABi35b0t1LoOclOQiICyH7DfI9hTlCmo6suXwXRkCJi3MOM6RoKV-npsPapEw2uaIZ5CDpBRV73e8bEa0KMo_SVyclOzKbXE-MGMa484BeADltPBu8Mv7x89PigpBRQ6AvYL7hJKXltVglq5g-su4TtRmSS4VgBmr5HVZ4x5obXr-WQPfA Jul 26 07:30:36.822499 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Id: None Jul 26 07:30:36.822499 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Name: None Jul 26 07:30:36.822499 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Identity-Status: Confirmed Jul 26 07:30:36.822499 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Is-Admin-Project: True Jul 26 07:30:36.822499 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Id: default Jul 26 07:30:36.822499 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Name: Default Jul 26 07:30:36.822499 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Id: 02e545f0c2784698a35cd8dcb1b02395 Jul 26 07:30:36.822499 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1083850303 Jul 26 07:30:36.822499 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Role: member,reader Jul 26 07:30:36.822499 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Roles: member,reader Jul 26 07:30:36.824758 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/02e545f0c2784698a35cd8dcb1b02395"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_02e545f0c2784698a35cd8dcb1b02395"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/02e545f0c2784698a35cd8dcb1b02395"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/02e545f0c2784698a35cd8dcb1b02395"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:30:36.824758 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1083850303 Jul 26 07:30:36.824758 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Id: 02e545f0c2784698a35cd8dcb1b02395 Jul 26 07:30:36.824758 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1083850303 Jul 26 07:30:36.824758 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User: tempest-ServerRescueNegativeTestJSON-1083850303-project Jul 26 07:30:36.824758 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Id: default Jul 26 07:30:36.824758 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Name: Default Jul 26 07:30:36.824758 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Id: 886151888fc84ccf890d609ba62da9e1 Jul 26 07:30:36.824758 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1083850303-project Jul 26 07:30:36.824758 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: method: > Jul 26 07:30:36.824758 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: exception: Cannot 'detach_volume' instance 8172b67c-005b-4f1f-91f0-f6ce67a50ab1 while it is in vm_state rescued Jul 26 07:30:36.826110 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: action_args: {'server_id': '8172b67c-005b-4f1f-91f0-f6ce67a50ab1', 'id': 'ee55fc9d-589c-41b9-a688-ef26d365900c'} Jul 26 07:30:36.826110 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:30:36.826110 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:30:36.826110 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 26 07:30:36.826110 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 26 07:30:36.826110 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 07:30:36.826110 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 07:30:36.826110 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 07:30:36.826110 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 07:30:36.826110 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8172b67c-005b-4f1f-91f0-f6ce67a50ab1 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 26 07:30:36.826110 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:30:36.826110 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:30:36.826110 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:30:36.826110 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:30:36.826110 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:30:36.826110 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:30:36.826110 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:30:36.826110 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:30:36.826110 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:30:36.826110 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:30:36.828835 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 26 07:30:36.828835 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 07:30:36.828835 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 07:30:36.828835 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 07:30:36.828835 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 8172b67c-005b-4f1f-91f0-f6ce67a50ab1 while it is in vm_state rescued Jul 26 07:30:36.828835 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:30:36.828835 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:30:36.828835 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:30:36.828835 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:30:36.828835 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:30:36.828835 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:30:36.828835 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:30:36.828835 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:30:36.828835 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 8172b67c-005b-4f1f-91f0-f6ce67a50ab1 while it is in vm_state rescued Jul 26 07:30:36.828835 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:30:36.828835 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c612f87c-c96d-400a-a76d-08ed5df1bb65 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Returning 409 to user: Cannot 'detach_volume' instance 8172b67c-005b-4f1f-91f0-f6ce67a50ab1 while it is in vm_state rescued {{(pid=117715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:30:36.831283 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c612f87c-c96d-400a-a76d-08ed5df1bb65 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments/ee55fc9d-589c-41b9-a688-ef26d365900c" status: 409 len: 152 microversion: 2.1 time: 0.109147 Jul 26 07:30:36.831283 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 340/629] 10.222.0.39 () {58 vars in 1416 bytes} [Tue Jul 26 07:30:36 2022] DELETE /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments/ee55fc9d-589c-41b9-a688-ef26d365900c => generated 152 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 07:30:36.835374 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6e5b231e-f083-42f7-8600-554ce7dede0e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:30:36.835906 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6e5b231e-f083-42f7-8600-554ce7dede0e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:36.842864 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6e5b231e-f083-42f7-8600-554ce7dede0e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:36.843383 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6e5b231e-f083-42f7-8600-554ce7dede0e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:36.844127 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6e5b231e-f083-42f7-8600-554ce7dede0e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:36.844565 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6e5b231e-f083-42f7-8600-554ce7dede0e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:36.928674 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6e5b231e-f083-42f7-8600-554ce7dede0e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "POST /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/action" status: 202 len: 0 microversion: 2.1 time: 0.097810 Jul 26 07:30:36.933102 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 290/630] 10.222.0.39 () {60 vars in 1278 bytes} [Tue Jul 26 07:30:36 2022] POST /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 07:30:36.939273 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-66c6ac8e-42c4-4e8e-a528-25954baf6d98 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:36.939913 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-66c6ac8e-42c4-4e8e-a528-25954baf6d98 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:36.947802 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-66c6ac8e-42c4-4e8e-a528-25954baf6d98 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:36.948331 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-66c6ac8e-42c4-4e8e-a528-25954baf6d98 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:36.949058 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-66c6ac8e-42c4-4e8e-a528-25954baf6d98 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:36.949498 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-66c6ac8e-42c4-4e8e-a528-25954baf6d98 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:37.026583 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 07:30:37.027048 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Tue Jul 26 07:30:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 (ip 10.222.0.39) !!! Jul 26 07:30:37.132522 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-66c6ac8e-42c4-4e8e-a528-25954baf6d98 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:37.141539 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-66c6ac8e-42c4-4e8e-a528-25954baf6d98 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1723 microversion: 2.1 time: 0.206776 Jul 26 07:30:37.142180 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 341/631] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:36 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:30:37.387450 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ae96cba2-d621-4894-9944-01d8f99584e0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:37.390394 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ae96cba2-d621-4894-9944-01d8f99584e0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:37.397713 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ae96cba2-d621-4894-9944-01d8f99584e0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:37.398255 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ae96cba2-d621-4894-9944-01d8f99584e0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:37.399124 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ae96cba2-d621-4894-9944-01d8f99584e0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:37.399629 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ae96cba2-d621-4894-9944-01d8f99584e0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:37.435584 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ae96cba2-d621-4894-9944-01d8f99584e0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.209652 Jul 26 07:30:37.440567 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 291/632] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:37 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:38.166327 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a7cd9371-e872-48bc-8186-86935d25aa89 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:38.167000 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a7cd9371-e872-48bc-8186-86935d25aa89 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:38.174569 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a7cd9371-e872-48bc-8186-86935d25aa89 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:38.175009 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a7cd9371-e872-48bc-8186-86935d25aa89 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:38.175791 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a7cd9371-e872-48bc-8186-86935d25aa89 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:38.176310 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a7cd9371-e872-48bc-8186-86935d25aa89 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:38.200202 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:30:38.326183 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-a7cd9371-e872-48bc-8186-86935d25aa89 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:38.334926 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a7cd9371-e872-48bc-8186-86935d25aa89 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1723 microversion: 2.1 time: 0.172608 Jul 26 07:30:38.335511 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 342/633] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:38 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:30:38.448877 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-adfc5a2a-ebac-4516-9445-ecb86860e663 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:38.451314 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-adfc5a2a-ebac-4516-9445-ecb86860e663 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:38.458721 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-adfc5a2a-ebac-4516-9445-ecb86860e663 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:38.459167 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-adfc5a2a-ebac-4516-9445-ecb86860e663 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:38.459985 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-adfc5a2a-ebac-4516-9445-ecb86860e663 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:38.460425 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-adfc5a2a-ebac-4516-9445-ecb86860e663 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:38.494477 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-adfc5a2a-ebac-4516-9445-ecb86860e663 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049645 Jul 26 07:30:38.495071 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 292/634] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:38 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:39.357099 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6009c48c-c2de-41cb-891b-df71c0c5b20e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:39.357727 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-6009c48c-c2de-41cb-891b-df71c0c5b20e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:39.365164 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6009c48c-c2de-41cb-891b-df71c0c5b20e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:39.365622 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6009c48c-c2de-41cb-891b-df71c0c5b20e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:39.366447 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6009c48c-c2de-41cb-891b-df71c0c5b20e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:39.366875 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6009c48c-c2de-41cb-891b-df71c0c5b20e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:39.510719 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d65bddd2-66ef-455d-809b-00b3c520ad20 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:39.513237 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d65bddd2-66ef-455d-809b-00b3c520ad20 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:39.524779 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d65bddd2-66ef-455d-809b-00b3c520ad20 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:39.525610 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d65bddd2-66ef-455d-809b-00b3c520ad20 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:39.526911 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d65bddd2-66ef-455d-809b-00b3c520ad20 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:39.527871 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d65bddd2-66ef-455d-809b-00b3c520ad20 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:39.536836 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-6009c48c-c2de-41cb-891b-df71c0c5b20e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:39.546265 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6009c48c-c2de-41cb-891b-df71c0c5b20e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1723 microversion: 2.1 time: 0.193182 Jul 26 07:30:39.546878 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 343/635] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:39 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:30:39.575299 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d65bddd2-66ef-455d-809b-00b3c520ad20 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068852 Jul 26 07:30:39.575906 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 293/636] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:39 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 07:30:40.569183 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-1e996c5e-79b3-4503-94c5-ea9b47d7aa24 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:40.570237 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-1e996c5e-79b3-4503-94c5-ea9b47d7aa24 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:40.577957 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1e996c5e-79b3-4503-94c5-ea9b47d7aa24 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:40.578407 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1e996c5e-79b3-4503-94c5-ea9b47d7aa24 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:40.579200 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1e996c5e-79b3-4503-94c5-ea9b47d7aa24 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:40.579634 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1e996c5e-79b3-4503-94c5-ea9b47d7aa24 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:40.589004 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0d452d68-ce7d-4671-8f03-2e5bfa0c203a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:40.591835 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0d452d68-ce7d-4671-8f03-2e5bfa0c203a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:40.601042 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0d452d68-ce7d-4671-8f03-2e5bfa0c203a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:40.601472 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0d452d68-ce7d-4671-8f03-2e5bfa0c203a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:40.602312 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0d452d68-ce7d-4671-8f03-2e5bfa0c203a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:40.602749 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0d452d68-ce7d-4671-8f03-2e5bfa0c203a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:40.640033 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0d452d68-ce7d-4671-8f03-2e5bfa0c203a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055119 Jul 26 07:30:40.640926 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 294/637] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:40 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 07:30:40.744438 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-1e996c5e-79b3-4503-94c5-ea9b47d7aa24 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:30:40.754994 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-1e996c5e-79b3-4503-94c5-ea9b47d7aa24 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1729 microversion: 2.1 time: 0.189987 Jul 26 07:30:40.755586 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 344/638] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:30:40 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1729 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:30:40.789272 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7cb70af6-580c-4fa1-bb6d-ed0b5091e838 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:40.790046 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7cb70af6-580c-4fa1-bb6d-ed0b5091e838 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:40.801218 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7cb70af6-580c-4fa1-bb6d-ed0b5091e838 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:40.802966 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7cb70af6-580c-4fa1-bb6d-ed0b5091e838 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:40.804430 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7cb70af6-580c-4fa1-bb6d-ed0b5091e838 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:40.805169 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7cb70af6-580c-4fa1-bb6d-ed0b5091e838 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:40.928187 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7cb70af6-580c-4fa1-bb6d-ed0b5091e838 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.145515 Jul 26 07:30:40.929050 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 295/639] 10.222.0.39 () {58 vars in 1275 bytes} [Tue Jul 26 07:30:40 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-interface => generated 285 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:30:41.654343 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7bd0cf66-8923-4521-9c7f-f3cb7d0b3ca4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:41.656642 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7bd0cf66-8923-4521-9c7f-f3cb7d0b3ca4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:41.663951 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7bd0cf66-8923-4521-9c7f-f3cb7d0b3ca4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:41.664374 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7bd0cf66-8923-4521-9c7f-f3cb7d0b3ca4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:41.665176 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7bd0cf66-8923-4521-9c7f-f3cb7d0b3ca4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:41.665612 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7bd0cf66-8923-4521-9c7f-f3cb7d0b3ca4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:41.698585 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7bd0cf66-8923-4521-9c7f-f3cb7d0b3ca4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048187 Jul 26 07:30:41.699088 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 345/640] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:41 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 07:30:41.894416 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-4c9b0ce0-5aa2-4581-b32c-43e003d31f07 req-878892d1-a94c-423c-87a1-8d835187213f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8172b67c-005b-4f1f-91f0-f6ce67a50ab1", "tag": "643ec2f5-7bcc-4a3c-9ca2-bb545c332e35"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:30:41.908116 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-4c9b0ce0-5aa2-4581-b32c-43e003d31f07 req-878892d1-a94c-423c-87a1-8d835187213f service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:41.908831 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-4c9b0ce0-5aa2-4581-b32c-43e003d31f07 req-878892d1-a94c-423c-87a1-8d835187213f service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:41.931384 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-4c9b0ce0-5aa2-4581-b32c-43e003d31f07 req-878892d1-a94c-423c-87a1-8d835187213f service nova] Creating event network-changed:643ec2f5-7bcc-4a3c-9ca2-bb545c332e35 for instance 8172b67c-005b-4f1f-91f0-f6ce67a50ab1 on hv-cinder-85083 Jul 26 07:30:41.941390 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-4c9b0ce0-5aa2-4581-b32c-43e003d31f07 req-878892d1-a94c-423c-87a1-8d835187213f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052314 Jul 26 07:30:41.943142 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 296/641] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:30:42.713497 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-df6e331e-541a-488a-b198-3763125315c0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:42.717785 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-df6e331e-541a-488a-b198-3763125315c0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:42.726454 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-df6e331e-541a-488a-b198-3763125315c0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:42.727108 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-df6e331e-541a-488a-b198-3763125315c0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:42.728055 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-df6e331e-541a-488a-b198-3763125315c0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:42.728680 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-df6e331e-541a-488a-b198-3763125315c0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:42.763550 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-df6e331e-541a-488a-b198-3763125315c0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054984 Jul 26 07:30:42.764552 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 346/642] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:42 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 07:30:43.778514 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b49a56b7-8eae-452a-8334-695a0dcdc52b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:43.780887 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-b49a56b7-8eae-452a-8334-695a0dcdc52b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:43.788023 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b49a56b7-8eae-452a-8334-695a0dcdc52b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:43.788476 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b49a56b7-8eae-452a-8334-695a0dcdc52b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:43.789275 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b49a56b7-8eae-452a-8334-695a0dcdc52b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:43.789712 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b49a56b7-8eae-452a-8334-695a0dcdc52b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:43.792652 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:30:43.824125 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b49a56b7-8eae-452a-8334-695a0dcdc52b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050576 Jul 26 07:30:43.824913 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 297/643] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:43 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:43.957668 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-e0ae5cf7-5baf-427c-8e29-2d0e966e4a86 req-443bb91d-2b8f-4fd2-bda0-16848b74308f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8172b67c-005b-4f1f-91f0-f6ce67a50ab1", "tag": "643ec2f5-7bcc-4a3c-9ca2-bb545c332e35"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:30:43.969104 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-e0ae5cf7-5baf-427c-8e29-2d0e966e4a86 req-443bb91d-2b8f-4fd2-bda0-16848b74308f service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:43.969518 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-e0ae5cf7-5baf-427c-8e29-2d0e966e4a86 req-443bb91d-2b8f-4fd2-bda0-16848b74308f service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:43.981898 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-e0ae5cf7-5baf-427c-8e29-2d0e966e4a86 req-443bb91d-2b8f-4fd2-bda0-16848b74308f service nova] Creating event network-changed:643ec2f5-7bcc-4a3c-9ca2-bb545c332e35 for instance 8172b67c-005b-4f1f-91f0-f6ce67a50ab1 on hv-cinder-85083 Jul 26 07:30:43.988622 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-e0ae5cf7-5baf-427c-8e29-2d0e966e4a86 req-443bb91d-2b8f-4fd2-bda0-16848b74308f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034316 Jul 26 07:30:43.989989 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 347/644] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:30:44.839693 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0d10899c-05c6-4401-b420-302f631f02fa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:44.842674 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0d10899c-05c6-4401-b420-302f631f02fa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:44.850316 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0d10899c-05c6-4401-b420-302f631f02fa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:44.850767 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0d10899c-05c6-4401-b420-302f631f02fa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:44.851570 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0d10899c-05c6-4401-b420-302f631f02fa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:44.852004 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0d10899c-05c6-4401-b420-302f631f02fa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:44.888932 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0d10899c-05c6-4401-b420-302f631f02fa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054914 Jul 26 07:30:44.889903 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 298/645] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:44 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:45.903858 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a7c30dbd-ba76-473d-939c-0683ef6e39f5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:45.906315 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a7c30dbd-ba76-473d-939c-0683ef6e39f5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:45.913218 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a7c30dbd-ba76-473d-939c-0683ef6e39f5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:45.913661 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a7c30dbd-ba76-473d-939c-0683ef6e39f5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:45.914488 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a7c30dbd-ba76-473d-939c-0683ef6e39f5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:45.914917 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a7c30dbd-ba76-473d-939c-0683ef6e39f5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:45.949318 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a7c30dbd-ba76-473d-939c-0683ef6e39f5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049913 Jul 26 07:30:45.949318 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 348/646] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:45 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:46.961915 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c5166a48-7b45-4f2d-954b-181e6847f02e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:46.964167 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c5166a48-7b45-4f2d-954b-181e6847f02e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:46.971907 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c5166a48-7b45-4f2d-954b-181e6847f02e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:46.972352 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c5166a48-7b45-4f2d-954b-181e6847f02e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:46.973198 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c5166a48-7b45-4f2d-954b-181e6847f02e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:46.973624 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c5166a48-7b45-4f2d-954b-181e6847f02e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:47.008010 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c5166a48-7b45-4f2d-954b-181e6847f02e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050252 Jul 26 07:30:47.008855 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 299/647] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:46 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:48.021407 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b8927643-7e17-4ddd-8c23-fbf17858b7c8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:48.023733 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b8927643-7e17-4ddd-8c23-fbf17858b7c8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:48.030966 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b8927643-7e17-4ddd-8c23-fbf17858b7c8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:48.031425 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b8927643-7e17-4ddd-8c23-fbf17858b7c8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:48.032226 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b8927643-7e17-4ddd-8c23-fbf17858b7c8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:48.032658 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b8927643-7e17-4ddd-8c23-fbf17858b7c8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:48.074968 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b8927643-7e17-4ddd-8c23-fbf17858b7c8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057773 Jul 26 07:30:48.075639 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 349/648] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:48 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:49.091414 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-01774a51-b6a8-4740-a85c-b8c05f696666 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:49.094016 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-01774a51-b6a8-4740-a85c-b8c05f696666 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:49.102854 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-01774a51-b6a8-4740-a85c-b8c05f696666 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:49.103750 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-01774a51-b6a8-4740-a85c-b8c05f696666 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:49.105250 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-01774a51-b6a8-4740-a85c-b8c05f696666 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:49.106019 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-01774a51-b6a8-4740-a85c-b8c05f696666 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:49.143898 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-01774a51-b6a8-4740-a85c-b8c05f696666 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056551 Jul 26 07:30:49.144507 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 300/649] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:49 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 07:30:50.160998 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-2be56a0d-a560-449f-948f-e4f1154fbe12 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:50.164661 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2be56a0d-a560-449f-948f-e4f1154fbe12 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:50.176656 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2be56a0d-a560-449f-948f-e4f1154fbe12 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:50.177498 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2be56a0d-a560-449f-948f-e4f1154fbe12 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:50.178529 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2be56a0d-a560-449f-948f-e4f1154fbe12 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:50.178977 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2be56a0d-a560-449f-948f-e4f1154fbe12 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:50.211917 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-2be56a0d-a560-449f-948f-e4f1154fbe12 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058161 Jul 26 07:30:50.212498 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 350/650] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:50 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 07:30:51.224753 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2514721d-c0be-4862-bf10-866bca2299da tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:51.227023 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2514721d-c0be-4862-bf10-866bca2299da tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:51.234263 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2514721d-c0be-4862-bf10-866bca2299da tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:51.234706 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2514721d-c0be-4862-bf10-866bca2299da tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:51.235483 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2514721d-c0be-4862-bf10-866bca2299da tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:51.235913 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2514721d-c0be-4862-bf10-866bca2299da tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:51.269781 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2514721d-c0be-4862-bf10-866bca2299da tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049081 Jul 26 07:30:51.270358 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 301/651] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:51 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:52.284322 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-5d89e154-08e6-496e-8acd-5dc149a22c42 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:52.286539 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-5d89e154-08e6-496e-8acd-5dc149a22c42 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:52.293841 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5d89e154-08e6-496e-8acd-5dc149a22c42 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:52.294311 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5d89e154-08e6-496e-8acd-5dc149a22c42 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:52.295318 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5d89e154-08e6-496e-8acd-5dc149a22c42 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:52.295755 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5d89e154-08e6-496e-8acd-5dc149a22c42 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:52.338120 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-5d89e154-08e6-496e-8acd-5dc149a22c42 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057924 Jul 26 07:30:52.338717 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 351/652] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:52 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:53.351581 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-65456861-a818-4164-a5ef-afd119546696 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:53.353766 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-65456861-a818-4164-a5ef-afd119546696 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:53.360882 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-65456861-a818-4164-a5ef-afd119546696 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:53.361323 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-65456861-a818-4164-a5ef-afd119546696 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:53.362144 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-65456861-a818-4164-a5ef-afd119546696 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:53.362570 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-65456861-a818-4164-a5ef-afd119546696 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:53.393351 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-65456861-a818-4164-a5ef-afd119546696 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045878 Jul 26 07:30:53.393921 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 302/653] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:53 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:54.407078 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a204b498-7b3e-4e9b-83f9-39ec6de25231 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:54.409384 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a204b498-7b3e-4e9b-83f9-39ec6de25231 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:54.416563 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a204b498-7b3e-4e9b-83f9-39ec6de25231 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:54.417063 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a204b498-7b3e-4e9b-83f9-39ec6de25231 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:54.417895 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a204b498-7b3e-4e9b-83f9-39ec6de25231 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:54.418322 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a204b498-7b3e-4e9b-83f9-39ec6de25231 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:54.462299 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a204b498-7b3e-4e9b-83f9-39ec6de25231 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059458 Jul 26 07:30:54.462895 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 352/654] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:54 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:55.475743 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7bd1edc9-a007-4c7c-9448-7a9860b204b9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:55.477797 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7bd1edc9-a007-4c7c-9448-7a9860b204b9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:55.484668 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7bd1edc9-a007-4c7c-9448-7a9860b204b9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:55.485119 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7bd1edc9-a007-4c7c-9448-7a9860b204b9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:55.485940 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7bd1edc9-a007-4c7c-9448-7a9860b204b9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:55.486346 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7bd1edc9-a007-4c7c-9448-7a9860b204b9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:55.519317 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7bd1edc9-a007-4c7c-9448-7a9860b204b9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047392 Jul 26 07:30:55.520295 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 303/655] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:55 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:56.535914 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-bf9f0c05-75bd-4197-aa2f-02c2b0543c24 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:56.539871 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-bf9f0c05-75bd-4197-aa2f-02c2b0543c24 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:56.549310 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bf9f0c05-75bd-4197-aa2f-02c2b0543c24 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:56.549799 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bf9f0c05-75bd-4197-aa2f-02c2b0543c24 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:56.550609 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bf9f0c05-75bd-4197-aa2f-02c2b0543c24 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:56.551066 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bf9f0c05-75bd-4197-aa2f-02c2b0543c24 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:56.585290 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-bf9f0c05-75bd-4197-aa2f-02c2b0543c24 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056287 Jul 26 07:30:56.586198 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 353/656] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:56 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:57.602220 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-52e75452-c630-43f2-bb24-06eba3b38796 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:57.604752 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-52e75452-c630-43f2-bb24-06eba3b38796 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:57.611756 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-52e75452-c630-43f2-bb24-06eba3b38796 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:57.612185 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-52e75452-c630-43f2-bb24-06eba3b38796 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:57.612961 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-52e75452-c630-43f2-bb24-06eba3b38796 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:57.613405 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-52e75452-c630-43f2-bb24-06eba3b38796 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:57.645341 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-52e75452-c630-43f2-bb24-06eba3b38796 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050665 Jul 26 07:30:57.645944 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 304/657] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:57 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:58.658422 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-50a1b1a2-449e-4b13-bd61-d3f3b6e87239 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:58.660770 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-50a1b1a2-449e-4b13-bd61-d3f3b6e87239 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:58.668056 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-50a1b1a2-449e-4b13-bd61-d3f3b6e87239 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:58.668508 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-50a1b1a2-449e-4b13-bd61-d3f3b6e87239 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:58.669290 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-50a1b1a2-449e-4b13-bd61-d3f3b6e87239 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:58.669781 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-50a1b1a2-449e-4b13-bd61-d3f3b6e87239 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:58.703388 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-50a1b1a2-449e-4b13-bd61-d3f3b6e87239 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049421 Jul 26 07:30:58.703953 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 354/658] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:58 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:30:59.720556 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-80496139-2faa-42d0-9e58-103710ef9257 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:30:59.724455 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-80496139-2faa-42d0-9e58-103710ef9257 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:30:59.735702 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-80496139-2faa-42d0-9e58-103710ef9257 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:59.736442 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-80496139-2faa-42d0-9e58-103710ef9257 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:59.737771 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-80496139-2faa-42d0-9e58-103710ef9257 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:30:59.738520 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-80496139-2faa-42d0-9e58-103710ef9257 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:30:59.776075 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-80496139-2faa-42d0-9e58-103710ef9257 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063135 Jul 26 07:30:59.776668 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 305/659] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:30:59 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:00.790554 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-1dc00873-2d6c-440e-8d53-db6cd0355431 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:00.792899 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-1dc00873-2d6c-440e-8d53-db6cd0355431 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:00.800762 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1dc00873-2d6c-440e-8d53-db6cd0355431 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:00.801387 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1dc00873-2d6c-440e-8d53-db6cd0355431 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:00.802232 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1dc00873-2d6c-440e-8d53-db6cd0355431 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:00.802671 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1dc00873-2d6c-440e-8d53-db6cd0355431 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:00.837885 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-1dc00873-2d6c-440e-8d53-db6cd0355431 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051463 Jul 26 07:31:00.838295 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 355/660] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:00 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:01.852028 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-10e80e6a-0060-4681-bc2b-540d572b841a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:01.854718 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-10e80e6a-0060-4681-bc2b-540d572b841a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:01.862877 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-10e80e6a-0060-4681-bc2b-540d572b841a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:01.863468 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-10e80e6a-0060-4681-bc2b-540d572b841a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:01.864332 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-10e80e6a-0060-4681-bc2b-540d572b841a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:01.864881 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-10e80e6a-0060-4681-bc2b-540d572b841a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:01.902157 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-10e80e6a-0060-4681-bc2b-540d572b841a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053953 Jul 26 07:31:01.903185 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 306/661] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:01 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:02.915857 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-23473164-a388-449f-9f4c-ac95364ef748 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:02.918124 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-23473164-a388-449f-9f4c-ac95364ef748 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:02.926158 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-23473164-a388-449f-9f4c-ac95364ef748 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:02.926695 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-23473164-a388-449f-9f4c-ac95364ef748 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:02.927530 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-23473164-a388-449f-9f4c-ac95364ef748 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:02.927994 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-23473164-a388-449f-9f4c-ac95364ef748 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:02.964310 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-23473164-a388-449f-9f4c-ac95364ef748 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052751 Jul 26 07:31:02.964985 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 356/662] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:02 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:03.978540 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-71af4672-ab64-43dc-b60f-896ef16cb507 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:03.980950 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-71af4672-ab64-43dc-b60f-896ef16cb507 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:03.983828 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=40 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:31:03.990369 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-71af4672-ab64-43dc-b60f-896ef16cb507 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:03.990812 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-71af4672-ab64-43dc-b60f-896ef16cb507 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:03.991601 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-71af4672-ab64-43dc-b60f-896ef16cb507 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:03.992036 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-71af4672-ab64-43dc-b60f-896ef16cb507 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:04.028593 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-71af4672-ab64-43dc-b60f-896ef16cb507 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054774 Jul 26 07:31:04.029179 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 307/663] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:03 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:05.044761 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-97f85851-1527-4210-85f1-ba03b68fcb34 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:05.047020 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-97f85851-1527-4210-85f1-ba03b68fcb34 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:05.050068 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=42 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:31:05.056341 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-97f85851-1527-4210-85f1-ba03b68fcb34 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:05.056783 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-97f85851-1527-4210-85f1-ba03b68fcb34 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:05.057576 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-97f85851-1527-4210-85f1-ba03b68fcb34 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:05.058041 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-97f85851-1527-4210-85f1-ba03b68fcb34 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:05.094728 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-97f85851-1527-4210-85f1-ba03b68fcb34 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054044 Jul 26 07:31:05.095420 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 357/664] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:05 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:06.108331 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-fb25eb4f-ddb2-4d38-876a-95abe1d271b4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:06.111230 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-fb25eb4f-ddb2-4d38-876a-95abe1d271b4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:06.119747 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fb25eb4f-ddb2-4d38-876a-95abe1d271b4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:06.120324 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fb25eb4f-ddb2-4d38-876a-95abe1d271b4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:06.121330 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fb25eb4f-ddb2-4d38-876a-95abe1d271b4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:06.121822 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fb25eb4f-ddb2-4d38-876a-95abe1d271b4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:06.157898 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-fb25eb4f-ddb2-4d38-876a-95abe1d271b4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053677 Jul 26 07:31:06.158481 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 308/665] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:06 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:07.171239 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-308f60d3-944f-4537-a831-dab0b8fc29fb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:07.173396 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-308f60d3-944f-4537-a831-dab0b8fc29fb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:07.181219 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-308f60d3-944f-4537-a831-dab0b8fc29fb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:07.181663 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-308f60d3-944f-4537-a831-dab0b8fc29fb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:07.182506 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-308f60d3-944f-4537-a831-dab0b8fc29fb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:07.182916 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-308f60d3-944f-4537-a831-dab0b8fc29fb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:07.217494 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-308f60d3-944f-4537-a831-dab0b8fc29fb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050111 Jul 26 07:31:07.218120 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 358/666] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:07 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:08.235884 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ca268543-6954-46cd-8ccb-7027d7989b99 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:08.238229 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ca268543-6954-46cd-8ccb-7027d7989b99 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:08.245834 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ca268543-6954-46cd-8ccb-7027d7989b99 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:08.246308 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ca268543-6954-46cd-8ccb-7027d7989b99 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:08.247104 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ca268543-6954-46cd-8ccb-7027d7989b99 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:08.247552 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ca268543-6954-46cd-8ccb-7027d7989b99 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:08.292082 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ca268543-6954-46cd-8ccb-7027d7989b99 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060054 Jul 26 07:31:08.293100 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 309/667] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:08 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:09.308970 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8ff50423-c6cd-4b4e-955e-d7f3786d86bb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:09.311737 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8ff50423-c6cd-4b4e-955e-d7f3786d86bb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:09.320371 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ff50423-c6cd-4b4e-955e-d7f3786d86bb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:09.320845 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ff50423-c6cd-4b4e-955e-d7f3786d86bb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:09.321646 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ff50423-c6cd-4b4e-955e-d7f3786d86bb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:09.322124 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ff50423-c6cd-4b4e-955e-d7f3786d86bb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:09.325118 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=95 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:31:09.357718 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8ff50423-c6cd-4b4e-955e-d7f3786d86bb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053181 Jul 26 07:31:09.358371 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 359/668] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:09 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:09.806278 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-34aced48-b690-4d4b-b605-b3d47e309c64 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:09.807066 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-34aced48-b690-4d4b-b605-b3d47e309c64 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:09.814546 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-34aced48-b690-4d4b-b605-b3d47e309c64 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:09.815000 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-34aced48-b690-4d4b-b605-b3d47e309c64 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:09.815846 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-34aced48-b690-4d4b-b605-b3d47e309c64 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:09.816314 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-34aced48-b690-4d4b-b605-b3d47e309c64 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:09.846196 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-34aced48-b690-4d4b-b605-b3d47e309c64 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641/ips" status: 200 len: 150 microversion: 2.1 time: 0.043893 Jul 26 07:31:09.846969 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 310/669] 10.222.0.39 () {58 vars in 1248 bytes} [Tue Jul 26 07:31:09 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:10.371279 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9645ee55-ae1a-4aee-bbc6-8b643d98e472 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:10.373949 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-9645ee55-ae1a-4aee-bbc6-8b643d98e472 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:10.381784 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9645ee55-ae1a-4aee-bbc6-8b643d98e472 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:10.382175 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9645ee55-ae1a-4aee-bbc6-8b643d98e472 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:10.382975 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9645ee55-ae1a-4aee-bbc6-8b643d98e472 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:10.383408 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9645ee55-ae1a-4aee-bbc6-8b643d98e472 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:10.419175 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-9645ee55-ae1a-4aee-bbc6-8b643d98e472 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052097 Jul 26 07:31:10.420041 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 360/670] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:10 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:11.433713 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-cb5e02b6-4a69-4532-9806-7008e9081200 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:11.435914 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-cb5e02b6-4a69-4532-9806-7008e9081200 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:11.444220 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cb5e02b6-4a69-4532-9806-7008e9081200 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:11.445032 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cb5e02b6-4a69-4532-9806-7008e9081200 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:11.446539 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cb5e02b6-4a69-4532-9806-7008e9081200 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:11.447313 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cb5e02b6-4a69-4532-9806-7008e9081200 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:11.487804 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-cb5e02b6-4a69-4532-9806-7008e9081200 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058417 Jul 26 07:31:11.488433 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 311/671] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:11 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:12.502577 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3c6a5a8a-5bc8-4541-b00d-472a096c0667 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:12.504984 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3c6a5a8a-5bc8-4541-b00d-472a096c0667 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:12.512942 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3c6a5a8a-5bc8-4541-b00d-472a096c0667 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:12.513287 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3c6a5a8a-5bc8-4541-b00d-472a096c0667 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:12.514168 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3c6a5a8a-5bc8-4541-b00d-472a096c0667 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:12.514604 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3c6a5a8a-5bc8-4541-b00d-472a096c0667 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:12.572309 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3c6a5a8a-5bc8-4541-b00d-472a096c0667 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073767 Jul 26 07:31:12.573359 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 361/672] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:12 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:13.589345 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-5fa3096d-6cc7-4edb-b098-c5f6521fd78a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:13.591748 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-5fa3096d-6cc7-4edb-b098-c5f6521fd78a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:13.599832 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5fa3096d-6cc7-4edb-b098-c5f6521fd78a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:13.600276 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5fa3096d-6cc7-4edb-b098-c5f6521fd78a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:13.601073 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5fa3096d-6cc7-4edb-b098-c5f6521fd78a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:13.601498 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5fa3096d-6cc7-4edb-b098-c5f6521fd78a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:13.636386 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-5fa3096d-6cc7-4edb-b098-c5f6521fd78a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051225 Jul 26 07:31:13.636977 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 312/673] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:13 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:14.329719 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-71b4c237-db06-4849-9218-1df10966c189 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:14.330423 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-71b4c237-db06-4849-9218-1df10966c189 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:14.337610 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-71b4c237-db06-4849-9218-1df10966c189 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:14.338087 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-71b4c237-db06-4849-9218-1df10966c189 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:14.338870 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-71b4c237-db06-4849-9218-1df10966c189 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:14.339302 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-71b4c237-db06-4849-9218-1df10966c189 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:14.427205 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.objects.instance [None req-71b4c237-db06-4849-9218-1df10966c189 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lazy-loading 'services' on Instance uuid 8172b67c-005b-4f1f-91f0-f6ce67a50ab1 {{(pid=117715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 07:31:14.534360 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-71b4c237-db06-4849-9218-1df10966c189 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments/ee55fc9d-589c-41b9-a688-ef26d365900c" status: 202 len: 0 microversion: 2.1 time: 0.208356 Jul 26 07:31:14.535371 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 362/674] 10.222.0.39 () {58 vars in 1416 bytes} [Tue Jul 26 07:31:14 2022] DELETE /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments/ee55fc9d-589c-41b9-a688-ef26d365900c => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 07:31:14.548180 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c98a301d-bc22-495e-9eb9-05977edaf812 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:14.551784 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c98a301d-bc22-495e-9eb9-05977edaf812 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:14.562608 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c98a301d-bc22-495e-9eb9-05977edaf812 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:14.563370 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c98a301d-bc22-495e-9eb9-05977edaf812 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:14.564608 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c98a301d-bc22-495e-9eb9-05977edaf812 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:14.565329 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c98a301d-bc22-495e-9eb9-05977edaf812 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:14.572096 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=94 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:31:14.602950 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c98a301d-bc22-495e-9eb9-05977edaf812 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062234 Jul 26 07:31:14.603600 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 313/675] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:14 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 07:31:14.659947 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c3c9f324-1067-47ec-99ca-366ed25c709f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:14.662517 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c3c9f324-1067-47ec-99ca-366ed25c709f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:14.669483 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c3c9f324-1067-47ec-99ca-366ed25c709f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:14.669967 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c3c9f324-1067-47ec-99ca-366ed25c709f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:14.670745 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c3c9f324-1067-47ec-99ca-366ed25c709f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:14.671181 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c3c9f324-1067-47ec-99ca-366ed25c709f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:14.711113 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c3c9f324-1067-47ec-99ca-366ed25c709f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065072 Jul 26 07:31:14.711708 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 363/676] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:14 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:15.616784 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9fd9e6cd-7b56-4a7c-be9c-ee6a698f3f72 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:15.619243 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-9fd9e6cd-7b56-4a7c-be9c-ee6a698f3f72 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:15.626367 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9fd9e6cd-7b56-4a7c-be9c-ee6a698f3f72 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:15.626815 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9fd9e6cd-7b56-4a7c-be9c-ee6a698f3f72 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:15.627610 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9fd9e6cd-7b56-4a7c-be9c-ee6a698f3f72 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:15.628040 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9fd9e6cd-7b56-4a7c-be9c-ee6a698f3f72 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:15.661096 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-9fd9e6cd-7b56-4a7c-be9c-ee6a698f3f72 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048741 Jul 26 07:31:15.661688 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 314/677] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:15 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 07:31:15.724230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f1a638d2-e9f2-4db6-a478-df237ee1549b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:15.726665 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f1a638d2-e9f2-4db6-a478-df237ee1549b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:15.734308 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f1a638d2-e9f2-4db6-a478-df237ee1549b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:15.734750 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f1a638d2-e9f2-4db6-a478-df237ee1549b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:15.735537 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f1a638d2-e9f2-4db6-a478-df237ee1549b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:15.735971 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f1a638d2-e9f2-4db6-a478-df237ee1549b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:15.770652 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f1a638d2-e9f2-4db6-a478-df237ee1549b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050630 Jul 26 07:31:15.771229 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 364/678] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:15 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:16.674355 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-44b29dcc-3a88-4493-afb3-b616b052660e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:16.676764 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-44b29dcc-3a88-4493-afb3-b616b052660e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:16.684347 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-44b29dcc-3a88-4493-afb3-b616b052660e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:16.684793 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-44b29dcc-3a88-4493-afb3-b616b052660e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:16.685594 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-44b29dcc-3a88-4493-afb3-b616b052660e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:16.686077 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-44b29dcc-3a88-4493-afb3-b616b052660e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:16.720216 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-44b29dcc-3a88-4493-afb3-b616b052660e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050145 Jul 26 07:31:16.720818 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 315/679] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:16 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:16.784078 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-18ca1313-a144-474d-8754-776afb82fd90 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:16.786469 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-18ca1313-a144-474d-8754-776afb82fd90 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:16.794818 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-18ca1313-a144-474d-8754-776afb82fd90 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:16.795167 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-18ca1313-a144-474d-8754-776afb82fd90 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:16.795948 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-18ca1313-a144-474d-8754-776afb82fd90 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:16.796376 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-18ca1313-a144-474d-8754-776afb82fd90 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:16.830004 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-18ca1313-a144-474d-8754-776afb82fd90 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050000 Jul 26 07:31:16.830612 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 365/680] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:16 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:17.733241 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-93940168-6eb9-4778-ac64-515d32855aa9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:17.735514 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-93940168-6eb9-4778-ac64-515d32855aa9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:17.743051 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-93940168-6eb9-4778-ac64-515d32855aa9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:17.743475 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-93940168-6eb9-4778-ac64-515d32855aa9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:17.744259 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-93940168-6eb9-4778-ac64-515d32855aa9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:17.744717 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-93940168-6eb9-4778-ac64-515d32855aa9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:17.784329 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-93940168-6eb9-4778-ac64-515d32855aa9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055112 Jul 26 07:31:17.785078 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 316/681] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:17 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:17.844782 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-edc84dad-3d6f-470d-a158-d4d79ad0f2bd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:17.847195 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-edc84dad-3d6f-470d-a158-d4d79ad0f2bd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:17.855275 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-edc84dad-3d6f-470d-a158-d4d79ad0f2bd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:17.855626 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-edc84dad-3d6f-470d-a158-d4d79ad0f2bd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:17.856414 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-edc84dad-3d6f-470d-a158-d4d79ad0f2bd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:17.856844 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-edc84dad-3d6f-470d-a158-d4d79ad0f2bd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:17.891604 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-edc84dad-3d6f-470d-a158-d4d79ad0f2bd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051357 Jul 26 07:31:17.892175 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 366/682] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:17 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:18.797599 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-fca32b72-040c-4a6b-a7a1-4423d4d060c0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:18.799845 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-fca32b72-040c-4a6b-a7a1-4423d4d060c0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:18.806837 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fca32b72-040c-4a6b-a7a1-4423d4d060c0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:18.807272 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fca32b72-040c-4a6b-a7a1-4423d4d060c0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:18.808043 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fca32b72-040c-4a6b-a7a1-4423d4d060c0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:18.808472 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fca32b72-040c-4a6b-a7a1-4423d4d060c0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:18.841379 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-fca32b72-040c-4a6b-a7a1-4423d4d060c0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047733 Jul 26 07:31:18.842417 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 317/683] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:18 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:18.905048 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-78b3851e-2fb3-475c-b5fa-59dd576f4f85 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:18.907362 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-78b3851e-2fb3-475c-b5fa-59dd576f4f85 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:18.914421 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-78b3851e-2fb3-475c-b5fa-59dd576f4f85 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:18.914775 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-78b3851e-2fb3-475c-b5fa-59dd576f4f85 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:18.915569 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-78b3851e-2fb3-475c-b5fa-59dd576f4f85 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:18.915994 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-78b3851e-2fb3-475c-b5fa-59dd576f4f85 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:18.947725 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-78b3851e-2fb3-475c-b5fa-59dd576f4f85 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046780 Jul 26 07:31:18.948299 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 367/684] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:18 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 07:31:19.854754 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-88c2a7b8-2ec3-4d85-9811-f13059e97773 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:19.856936 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-88c2a7b8-2ec3-4d85-9811-f13059e97773 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:19.863883 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-88c2a7b8-2ec3-4d85-9811-f13059e97773 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:19.864331 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-88c2a7b8-2ec3-4d85-9811-f13059e97773 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:19.865115 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-88c2a7b8-2ec3-4d85-9811-f13059e97773 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:19.865543 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-88c2a7b8-2ec3-4d85-9811-f13059e97773 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:19.906384 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-88c2a7b8-2ec3-4d85-9811-f13059e97773 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055593 Jul 26 07:31:19.907079 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 318/685] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:19 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:19.961030 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-eba9ec71-63f1-4227-8450-7b2d167a7adc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:19.963326 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-eba9ec71-63f1-4227-8450-7b2d167a7adc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:19.973540 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-eba9ec71-63f1-4227-8450-7b2d167a7adc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:19.973976 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-eba9ec71-63f1-4227-8450-7b2d167a7adc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:19.974784 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-eba9ec71-63f1-4227-8450-7b2d167a7adc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:19.975333 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-eba9ec71-63f1-4227-8450-7b2d167a7adc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:20.007973 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-eba9ec71-63f1-4227-8450-7b2d167a7adc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051066 Jul 26 07:31:20.008557 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 368/686] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:19 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:20.919262 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-e846c0cc-1c97-4e77-8a29-44dc005bd94c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:20.921468 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-e846c0cc-1c97-4e77-8a29-44dc005bd94c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:20.928781 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e846c0cc-1c97-4e77-8a29-44dc005bd94c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:20.929212 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e846c0cc-1c97-4e77-8a29-44dc005bd94c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:20.930008 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e846c0cc-1c97-4e77-8a29-44dc005bd94c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:20.930437 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e846c0cc-1c97-4e77-8a29-44dc005bd94c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:20.963333 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-e846c0cc-1c97-4e77-8a29-44dc005bd94c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048285 Jul 26 07:31:20.963883 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 319/687] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:20 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:21.021673 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-84be5e8d-dd01-498e-8174-dfc77c3baddd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:21.023964 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-84be5e8d-dd01-498e-8174-dfc77c3baddd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:21.031793 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-84be5e8d-dd01-498e-8174-dfc77c3baddd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:21.032150 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-84be5e8d-dd01-498e-8174-dfc77c3baddd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:21.033029 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-84be5e8d-dd01-498e-8174-dfc77c3baddd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:21.033494 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-84be5e8d-dd01-498e-8174-dfc77c3baddd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:21.070572 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-84be5e8d-dd01-498e-8174-dfc77c3baddd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053082 Jul 26 07:31:21.071153 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 369/688] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:21 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:21.977373 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-acd44251-d39e-4837-ba49-1cbb39fcc9bf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:21.979591 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-acd44251-d39e-4837-ba49-1cbb39fcc9bf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:21.987048 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-acd44251-d39e-4837-ba49-1cbb39fcc9bf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:21.987521 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-acd44251-d39e-4837-ba49-1cbb39fcc9bf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:21.988306 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-acd44251-d39e-4837-ba49-1cbb39fcc9bf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:21.988776 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-acd44251-d39e-4837-ba49-1cbb39fcc9bf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:22.020646 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-acd44251-d39e-4837-ba49-1cbb39fcc9bf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047545 Jul 26 07:31:22.021229 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 320/689] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:21 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:22.085003 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-06cd1471-9e05-440e-8856-7eeeff8705c6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:22.089252 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-06cd1471-9e05-440e-8856-7eeeff8705c6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:22.101167 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-06cd1471-9e05-440e-8856-7eeeff8705c6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:22.102091 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-06cd1471-9e05-440e-8856-7eeeff8705c6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:22.103620 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-06cd1471-9e05-440e-8856-7eeeff8705c6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:22.104381 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-06cd1471-9e05-440e-8856-7eeeff8705c6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:22.155626 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-06cd1471-9e05-440e-8856-7eeeff8705c6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076688 Jul 26 07:31:22.156237 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 370/690] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:22 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:23.033102 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-95d1efdd-5387-4254-abbf-d9a0582e04f6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:23.035427 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-95d1efdd-5387-4254-abbf-d9a0582e04f6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:23.042346 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-95d1efdd-5387-4254-abbf-d9a0582e04f6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:23.042795 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-95d1efdd-5387-4254-abbf-d9a0582e04f6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:23.043582 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-95d1efdd-5387-4254-abbf-d9a0582e04f6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:23.044046 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-95d1efdd-5387-4254-abbf-d9a0582e04f6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:23.076392 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-95d1efdd-5387-4254-abbf-d9a0582e04f6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047335 Jul 26 07:31:23.076984 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 321/691] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:23 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:23.168005 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f2399166-69f4-4352-9950-708f6f2797be tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:23.170207 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f2399166-69f4-4352-9950-708f6f2797be tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:23.177568 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f2399166-69f4-4352-9950-708f6f2797be tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:23.178036 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f2399166-69f4-4352-9950-708f6f2797be tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:23.178812 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f2399166-69f4-4352-9950-708f6f2797be tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:23.179236 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f2399166-69f4-4352-9950-708f6f2797be tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:23.212012 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f2399166-69f4-4352-9950-708f6f2797be tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048381 Jul 26 07:31:23.212631 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 371/692] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:23 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 07:31:24.088994 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-298202c7-160a-440c-99f5-4ebbee5ce698 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:24.091216 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-298202c7-160a-440c-99f5-4ebbee5ce698 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:24.098597 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-298202c7-160a-440c-99f5-4ebbee5ce698 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:24.099044 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-298202c7-160a-440c-99f5-4ebbee5ce698 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:24.099837 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-298202c7-160a-440c-99f5-4ebbee5ce698 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:24.100272 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-298202c7-160a-440c-99f5-4ebbee5ce698 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:24.135133 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-298202c7-160a-440c-99f5-4ebbee5ce698 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050140 Jul 26 07:31:24.135705 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 322/693] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:24 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:24.227857 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-30571a79-7439-4d7d-a6d6-341ba6874e9b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:24.230716 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-30571a79-7439-4d7d-a6d6-341ba6874e9b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:24.242035 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-30571a79-7439-4d7d-a6d6-341ba6874e9b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:24.242807 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-30571a79-7439-4d7d-a6d6-341ba6874e9b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:24.244202 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-30571a79-7439-4d7d-a6d6-341ba6874e9b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:24.244955 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-30571a79-7439-4d7d-a6d6-341ba6874e9b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:24.285578 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-30571a79-7439-4d7d-a6d6-341ba6874e9b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064110 Jul 26 07:31:24.286212 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 372/694] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:24 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:25.148125 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-35f7406a-6ea2-4730-a7b3-35e2fc49c8c0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:25.150461 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-35f7406a-6ea2-4730-a7b3-35e2fc49c8c0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:25.157559 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-35f7406a-6ea2-4730-a7b3-35e2fc49c8c0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:25.158110 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-35f7406a-6ea2-4730-a7b3-35e2fc49c8c0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:25.159041 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-35f7406a-6ea2-4730-a7b3-35e2fc49c8c0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:25.159470 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-35f7406a-6ea2-4730-a7b3-35e2fc49c8c0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:25.192125 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-35f7406a-6ea2-4730-a7b3-35e2fc49c8c0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048038 Jul 26 07:31:25.192706 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 323/695] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:25 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:25.298964 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-bedeacb8-468f-4534-bc96-beb703e0918f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:25.301609 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-bedeacb8-468f-4534-bc96-beb703e0918f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:25.309552 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bedeacb8-468f-4534-bc96-beb703e0918f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:25.310084 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bedeacb8-468f-4534-bc96-beb703e0918f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:25.311047 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bedeacb8-468f-4534-bc96-beb703e0918f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:25.311524 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bedeacb8-468f-4534-bc96-beb703e0918f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:25.345694 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-bedeacb8-468f-4534-bc96-beb703e0918f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050923 Jul 26 07:31:25.346515 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 373/696] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:25 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:26.204976 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2c97d6e6-bf4c-494b-957e-545ea825b39a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:26.207232 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2c97d6e6-bf4c-494b-957e-545ea825b39a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:26.215271 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2c97d6e6-bf4c-494b-957e-545ea825b39a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:26.215753 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2c97d6e6-bf4c-494b-957e-545ea825b39a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:26.217470 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2c97d6e6-bf4c-494b-957e-545ea825b39a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:26.217470 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2c97d6e6-bf4c-494b-957e-545ea825b39a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:26.249228 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2c97d6e6-bf4c-494b-957e-545ea825b39a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048206 Jul 26 07:31:26.249834 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 324/697] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:26 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:26.359296 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-dc857f38-1920-4a64-9517-163b241643ac tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:26.361387 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-dc857f38-1920-4a64-9517-163b241643ac tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:26.368917 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dc857f38-1920-4a64-9517-163b241643ac tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:26.369361 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dc857f38-1920-4a64-9517-163b241643ac tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:26.370214 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dc857f38-1920-4a64-9517-163b241643ac tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:26.370647 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dc857f38-1920-4a64-9517-163b241643ac tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:26.403186 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-dc857f38-1920-4a64-9517-163b241643ac tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048064 Jul 26 07:31:26.403785 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 374/698] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:26 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:27.262994 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-78aa7611-c5df-43c5-9b9b-c56d27bbc4dc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:27.265208 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-78aa7611-c5df-43c5-9b9b-c56d27bbc4dc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:27.273828 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-78aa7611-c5df-43c5-9b9b-c56d27bbc4dc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:27.274394 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-78aa7611-c5df-43c5-9b9b-c56d27bbc4dc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:27.275385 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-78aa7611-c5df-43c5-9b9b-c56d27bbc4dc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:27.275906 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-78aa7611-c5df-43c5-9b9b-c56d27bbc4dc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:27.308366 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-78aa7611-c5df-43c5-9b9b-c56d27bbc4dc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049282 Jul 26 07:31:27.308952 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 325/699] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:27 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:27.416548 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-4405a951-180f-4b7c-9911-f89e2ccb292e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:27.418690 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-4405a951-180f-4b7c-9911-f89e2ccb292e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:27.425849 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4405a951-180f-4b7c-9911-f89e2ccb292e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:27.426375 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4405a951-180f-4b7c-9911-f89e2ccb292e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:27.427171 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4405a951-180f-4b7c-9911-f89e2ccb292e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:27.427641 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4405a951-180f-4b7c-9911-f89e2ccb292e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:27.430637 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:31:27.463968 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-4405a951-180f-4b7c-9911-f89e2ccb292e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051540 Jul 26 07:31:27.464570 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 375/700] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:27 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:28.321512 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-dc77f77e-63e2-4b83-b35f-71d9f457f99e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:28.323776 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-dc77f77e-63e2-4b83-b35f-71d9f457f99e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:28.330851 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dc77f77e-63e2-4b83-b35f-71d9f457f99e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:28.331299 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dc77f77e-63e2-4b83-b35f-71d9f457f99e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:28.332113 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dc77f77e-63e2-4b83-b35f-71d9f457f99e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:28.332685 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dc77f77e-63e2-4b83-b35f-71d9f457f99e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:28.365474 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-dc77f77e-63e2-4b83-b35f-71d9f457f99e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047920 Jul 26 07:31:28.366108 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 326/701] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:28 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:28.477550 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7b00d1a9-4886-40b2-919a-b1f6d6fa282a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:28.479894 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7b00d1a9-4886-40b2-919a-b1f6d6fa282a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:28.492886 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7b00d1a9-4886-40b2-919a-b1f6d6fa282a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:28.493340 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7b00d1a9-4886-40b2-919a-b1f6d6fa282a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:28.494264 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7b00d1a9-4886-40b2-919a-b1f6d6fa282a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:28.494726 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7b00d1a9-4886-40b2-919a-b1f6d6fa282a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:28.529659 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7b00d1a9-4886-40b2-919a-b1f6d6fa282a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056227 Jul 26 07:31:28.530306 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 376/702] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:28 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:29.380448 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-44c62b88-e678-4af8-b056-f81504d4f264 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:29.382819 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-44c62b88-e678-4af8-b056-f81504d4f264 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:29.390356 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-44c62b88-e678-4af8-b056-f81504d4f264 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:29.390923 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-44c62b88-e678-4af8-b056-f81504d4f264 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:29.391736 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-44c62b88-e678-4af8-b056-f81504d4f264 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:29.392169 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-44c62b88-e678-4af8-b056-f81504d4f264 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:29.427161 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-44c62b88-e678-4af8-b056-f81504d4f264 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052250 Jul 26 07:31:29.428114 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 327/703] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:29 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:29.543065 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-eeea31f4-9509-4d5b-97b0-72976ac4eee8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:29.545235 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-eeea31f4-9509-4d5b-97b0-72976ac4eee8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:29.552915 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-eeea31f4-9509-4d5b-97b0-72976ac4eee8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:29.553402 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-eeea31f4-9509-4d5b-97b0-72976ac4eee8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:29.554237 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-eeea31f4-9509-4d5b-97b0-72976ac4eee8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:29.554703 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-eeea31f4-9509-4d5b-97b0-72976ac4eee8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:29.594854 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-eeea31f4-9509-4d5b-97b0-72976ac4eee8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055990 Jul 26 07:31:29.595464 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 377/704] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:29 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:30.440121 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ab827568-030e-4f45-bbe1-8f1cb6a1c71b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:30.442389 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ab827568-030e-4f45-bbe1-8f1cb6a1c71b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:30.449507 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ab827568-030e-4f45-bbe1-8f1cb6a1c71b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:30.450069 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ab827568-030e-4f45-bbe1-8f1cb6a1c71b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:30.450749 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ab827568-030e-4f45-bbe1-8f1cb6a1c71b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:30.451182 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ab827568-030e-4f45-bbe1-8f1cb6a1c71b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:30.483658 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ab827568-030e-4f45-bbe1-8f1cb6a1c71b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047550 Jul 26 07:31:30.484237 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 328/705] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:30 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:30.612327 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e9dbd26b-4f7d-40f2-b68a-4ce2ae8d5c42 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:30.614591 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e9dbd26b-4f7d-40f2-b68a-4ce2ae8d5c42 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:30.621868 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e9dbd26b-4f7d-40f2-b68a-4ce2ae8d5c42 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:30.622443 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e9dbd26b-4f7d-40f2-b68a-4ce2ae8d5c42 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:30.623239 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e9dbd26b-4f7d-40f2-b68a-4ce2ae8d5c42 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:30.623651 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e9dbd26b-4f7d-40f2-b68a-4ce2ae8d5c42 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:30.657141 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e9dbd26b-4f7d-40f2-b68a-4ce2ae8d5c42 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049043 Jul 26 07:31:30.657764 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 378/706] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:30 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:31.497125 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a786d10d-913c-40c7-9b13-f2936445d76e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:31.500144 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a786d10d-913c-40c7-9b13-f2936445d76e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:31.513328 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a786d10d-913c-40c7-9b13-f2936445d76e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:31.513977 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a786d10d-913c-40c7-9b13-f2936445d76e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:31.515034 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a786d10d-913c-40c7-9b13-f2936445d76e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:31.515561 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a786d10d-913c-40c7-9b13-f2936445d76e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:31.541625 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:31:31.548463 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a786d10d-913c-40c7-9b13-f2936445d76e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055515 Jul 26 07:31:31.549057 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 329/707] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:31 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:31.670446 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8aa9756f-e788-4346-85a9-aa1836977356 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:31.672662 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8aa9756f-e788-4346-85a9-aa1836977356 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:31.679629 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8aa9756f-e788-4346-85a9-aa1836977356 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:31.680073 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8aa9756f-e788-4346-85a9-aa1836977356 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:31.680838 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8aa9756f-e788-4346-85a9-aa1836977356 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:31.681296 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8aa9756f-e788-4346-85a9-aa1836977356 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:31.712157 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8aa9756f-e788-4346-85a9-aa1836977356 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046055 Jul 26 07:31:31.712732 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 379/708] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:31 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:32.561799 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-06c374bc-9f24-4051-917f-94c5c9b684f5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:32.564009 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-06c374bc-9f24-4051-917f-94c5c9b684f5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:32.571526 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-06c374bc-9f24-4051-917f-94c5c9b684f5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:32.571969 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-06c374bc-9f24-4051-917f-94c5c9b684f5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:32.572744 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-06c374bc-9f24-4051-917f-94c5c9b684f5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:32.573174 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-06c374bc-9f24-4051-917f-94c5c9b684f5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:32.604115 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-06c374bc-9f24-4051-917f-94c5c9b684f5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046453 Jul 26 07:31:32.605146 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 330/709] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:32 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 07:31:32.725952 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-bd3efd44-372e-42d0-8484-f4658ef20961 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:32.728360 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-bd3efd44-372e-42d0-8484-f4658ef20961 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:32.735756 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bd3efd44-372e-42d0-8484-f4658ef20961 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:32.736201 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bd3efd44-372e-42d0-8484-f4658ef20961 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:32.736969 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bd3efd44-372e-42d0-8484-f4658ef20961 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:32.737391 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bd3efd44-372e-42d0-8484-f4658ef20961 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:32.769287 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-bd3efd44-372e-42d0-8484-f4658ef20961 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047788 Jul 26 07:31:32.769935 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 380/710] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:32 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:33.617162 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b6f6ed2d-d990-42f4-84b0-07ef38a3c6de tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:33.619410 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-b6f6ed2d-d990-42f4-84b0-07ef38a3c6de tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:33.627233 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b6f6ed2d-d990-42f4-84b0-07ef38a3c6de tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:33.627676 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b6f6ed2d-d990-42f4-84b0-07ef38a3c6de tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:33.628447 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b6f6ed2d-d990-42f4-84b0-07ef38a3c6de tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:33.628919 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b6f6ed2d-d990-42f4-84b0-07ef38a3c6de tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:33.661335 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b6f6ed2d-d990-42f4-84b0-07ef38a3c6de tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048711 Jul 26 07:31:33.661978 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 331/711] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:33 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:33.784545 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c37ed9bd-76ee-4e29-a889-534874002031 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:33.787544 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c37ed9bd-76ee-4e29-a889-534874002031 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:33.797262 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c37ed9bd-76ee-4e29-a889-534874002031 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:33.797708 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c37ed9bd-76ee-4e29-a889-534874002031 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:33.798504 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c37ed9bd-76ee-4e29-a889-534874002031 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:33.798934 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c37ed9bd-76ee-4e29-a889-534874002031 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:33.830802 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c37ed9bd-76ee-4e29-a889-534874002031 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052336 Jul 26 07:31:33.831375 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 381/712] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:33 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:34.674345 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ac43e28a-e1be-4f45-bcb9-22264f9458b1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:34.676549 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ac43e28a-e1be-4f45-bcb9-22264f9458b1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:34.679087 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=50 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:31:34.684447 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ac43e28a-e1be-4f45-bcb9-22264f9458b1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:34.684867 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ac43e28a-e1be-4f45-bcb9-22264f9458b1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:34.685627 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ac43e28a-e1be-4f45-bcb9-22264f9458b1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:34.686088 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ac43e28a-e1be-4f45-bcb9-22264f9458b1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:34.718499 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ac43e28a-e1be-4f45-bcb9-22264f9458b1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048204 Jul 26 07:31:34.719062 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 332/713] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:34 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:34.843993 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-50f69113-e816-42b4-9959-ccc85cc2e800 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:34.846182 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-50f69113-e816-42b4-9959-ccc85cc2e800 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:34.853347 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-50f69113-e816-42b4-9959-ccc85cc2e800 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:34.853823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-50f69113-e816-42b4-9959-ccc85cc2e800 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:34.854608 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-50f69113-e816-42b4-9959-ccc85cc2e800 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:34.855044 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-50f69113-e816-42b4-9959-ccc85cc2e800 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:34.886484 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-50f69113-e816-42b4-9959-ccc85cc2e800 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047019 Jul 26 07:31:34.887031 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 382/714] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:34 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:35.731755 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c58320a0-9f47-49c2-ae68-a29f540cc93c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:35.733943 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c58320a0-9f47-49c2-ae68-a29f540cc93c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:35.740957 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c58320a0-9f47-49c2-ae68-a29f540cc93c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:35.741367 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c58320a0-9f47-49c2-ae68-a29f540cc93c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:35.742176 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c58320a0-9f47-49c2-ae68-a29f540cc93c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:35.742597 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c58320a0-9f47-49c2-ae68-a29f540cc93c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:35.774359 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c58320a0-9f47-49c2-ae68-a29f540cc93c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046642 Jul 26 07:31:35.774939 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 333/715] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:35 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:35.900608 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-47e94c21-8d91-4f29-b2e0-aacb19d9a99e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:35.902863 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-47e94c21-8d91-4f29-b2e0-aacb19d9a99e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:35.905441 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=52 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:31:35.912480 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-47e94c21-8d91-4f29-b2e0-aacb19d9a99e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:35.912924 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-47e94c21-8d91-4f29-b2e0-aacb19d9a99e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:35.913680 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-47e94c21-8d91-4f29-b2e0-aacb19d9a99e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:35.914135 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-47e94c21-8d91-4f29-b2e0-aacb19d9a99e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:35.944250 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-47e94c21-8d91-4f29-b2e0-aacb19d9a99e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048263 Jul 26 07:31:35.944820 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 383/716] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:35 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 07:31:36.787278 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7ae5abf1-4a1a-42c8-8b6d-828166a9ccda tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:36.789517 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7ae5abf1-4a1a-42c8-8b6d-828166a9ccda tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:36.796285 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7ae5abf1-4a1a-42c8-8b6d-828166a9ccda tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:36.796731 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7ae5abf1-4a1a-42c8-8b6d-828166a9ccda tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:36.797554 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7ae5abf1-4a1a-42c8-8b6d-828166a9ccda tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:36.797976 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7ae5abf1-4a1a-42c8-8b6d-828166a9ccda tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:36.829879 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7ae5abf1-4a1a-42c8-8b6d-828166a9ccda tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046710 Jul 26 07:31:36.830546 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 334/717] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:36 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:36.957697 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6e06b554-8cfa-407c-afcd-e963f5fec2e3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:36.960040 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-6e06b554-8cfa-407c-afcd-e963f5fec2e3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:36.966611 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6e06b554-8cfa-407c-afcd-e963f5fec2e3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:36.967367 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6e06b554-8cfa-407c-afcd-e963f5fec2e3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:36.968141 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6e06b554-8cfa-407c-afcd-e963f5fec2e3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:36.968572 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6e06b554-8cfa-407c-afcd-e963f5fec2e3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:37.001523 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6e06b554-8cfa-407c-afcd-e963f5fec2e3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048253 Jul 26 07:31:37.002161 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 384/718] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:36 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:37.844179 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8ab0c023-a5c4-4568-9c01-ba979785ba29 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:37.846583 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8ab0c023-a5c4-4568-9c01-ba979785ba29 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:37.853569 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8ab0c023-a5c4-4568-9c01-ba979785ba29 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:37.854151 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8ab0c023-a5c4-4568-9c01-ba979785ba29 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:37.855020 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8ab0c023-a5c4-4568-9c01-ba979785ba29 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:37.855496 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8ab0c023-a5c4-4568-9c01-ba979785ba29 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:37.889325 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8ab0c023-a5c4-4568-9c01-ba979785ba29 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050610 Jul 26 07:31:37.889932 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 335/719] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:37 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:38.015387 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9b4c324f-eca4-4a51-96d4-5dcfc6bec67a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:38.017598 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-9b4c324f-eca4-4a51-96d4-5dcfc6bec67a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:38.024535 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9b4c324f-eca4-4a51-96d4-5dcfc6bec67a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:38.024974 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9b4c324f-eca4-4a51-96d4-5dcfc6bec67a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:38.025766 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9b4c324f-eca4-4a51-96d4-5dcfc6bec67a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:38.026196 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9b4c324f-eca4-4a51-96d4-5dcfc6bec67a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:38.058309 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-9b4c324f-eca4-4a51-96d4-5dcfc6bec67a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047016 Jul 26 07:31:38.058897 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 385/720] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:38 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:38.902498 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-647a5984-3b60-4617-ae8e-0e096acdec61 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:38.904678 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-647a5984-3b60-4617-ae8e-0e096acdec61 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:38.912276 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-647a5984-3b60-4617-ae8e-0e096acdec61 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:38.912718 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-647a5984-3b60-4617-ae8e-0e096acdec61 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:38.913505 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-647a5984-3b60-4617-ae8e-0e096acdec61 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:38.913992 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-647a5984-3b60-4617-ae8e-0e096acdec61 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:38.946897 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-647a5984-3b60-4617-ae8e-0e096acdec61 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048629 Jul 26 07:31:38.947506 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 336/721] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:38 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:39.071124 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-87a82416-2869-4921-a960-85807bc49704 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:39.073281 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-87a82416-2869-4921-a960-85807bc49704 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:39.084953 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-87a82416-2869-4921-a960-85807bc49704 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:39.085773 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-87a82416-2869-4921-a960-85807bc49704 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:39.086578 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-87a82416-2869-4921-a960-85807bc49704 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:39.087020 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-87a82416-2869-4921-a960-85807bc49704 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:39.118132 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-87a82416-2869-4921-a960-85807bc49704 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051260 Jul 26 07:31:39.118706 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 386/722] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:39 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:39.959647 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-092810eb-6d83-43c5-a12f-53401b01c795 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:39.961831 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-092810eb-6d83-43c5-a12f-53401b01c795 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:39.969075 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-092810eb-6d83-43c5-a12f-53401b01c795 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:39.969525 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-092810eb-6d83-43c5-a12f-53401b01c795 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:39.970296 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-092810eb-6d83-43c5-a12f-53401b01c795 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:39.970708 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-092810eb-6d83-43c5-a12f-53401b01c795 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:40.005415 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-092810eb-6d83-43c5-a12f-53401b01c795 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049762 Jul 26 07:31:40.006022 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 337/723] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:39 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:40.132181 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-610c71d8-a533-407e-9bfb-d8df9706f0fa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:40.134273 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-610c71d8-a533-407e-9bfb-d8df9706f0fa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:40.141006 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-610c71d8-a533-407e-9bfb-d8df9706f0fa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:40.141442 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-610c71d8-a533-407e-9bfb-d8df9706f0fa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:40.142231 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-610c71d8-a533-407e-9bfb-d8df9706f0fa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:40.142654 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-610c71d8-a533-407e-9bfb-d8df9706f0fa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:40.176960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-610c71d8-a533-407e-9bfb-d8df9706f0fa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049247 Jul 26 07:31:40.177590 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 387/724] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:40 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:41.020416 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-fab61c69-fba4-4402-a825-e905a71015b0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:41.022642 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-fab61c69-fba4-4402-a825-e905a71015b0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:41.029552 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fab61c69-fba4-4402-a825-e905a71015b0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:41.030038 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fab61c69-fba4-4402-a825-e905a71015b0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:41.030812 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fab61c69-fba4-4402-a825-e905a71015b0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:41.031239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fab61c69-fba4-4402-a825-e905a71015b0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:41.061987 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-fab61c69-fba4-4402-a825-e905a71015b0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045887 Jul 26 07:31:41.062812 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 338/725] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:41 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:41.189268 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f38d268c-3434-4585-a192-a0a7dac25bdd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:41.191420 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f38d268c-3434-4585-a192-a0a7dac25bdd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:41.199022 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f38d268c-3434-4585-a192-a0a7dac25bdd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:41.199450 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f38d268c-3434-4585-a192-a0a7dac25bdd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:41.200262 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f38d268c-3434-4585-a192-a0a7dac25bdd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:41.200871 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f38d268c-3434-4585-a192-a0a7dac25bdd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:41.232387 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f38d268c-3434-4585-a192-a0a7dac25bdd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047276 Jul 26 07:31:41.232966 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 388/726] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:41 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:42.079043 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-948572c2-e73d-428c-9a3c-205063180fc5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:42.082643 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-948572c2-e73d-428c-9a3c-205063180fc5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:42.094151 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-948572c2-e73d-428c-9a3c-205063180fc5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:42.094883 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-948572c2-e73d-428c-9a3c-205063180fc5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:42.096091 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-948572c2-e73d-428c-9a3c-205063180fc5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:42.096807 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-948572c2-e73d-428c-9a3c-205063180fc5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:42.129370 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-948572c2-e73d-428c-9a3c-205063180fc5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056945 Jul 26 07:31:42.129963 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 339/727] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:42 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:42.245548 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6f6ebe40-efa0-40c7-94ac-fd57c3b4c3f1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:42.247662 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-6f6ebe40-efa0-40c7-94ac-fd57c3b4c3f1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:42.254873 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6f6ebe40-efa0-40c7-94ac-fd57c3b4c3f1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:42.255346 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6f6ebe40-efa0-40c7-94ac-fd57c3b4c3f1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:42.256099 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6f6ebe40-efa0-40c7-94ac-fd57c3b4c3f1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:42.256525 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6f6ebe40-efa0-40c7-94ac-fd57c3b4c3f1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:42.287449 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6f6ebe40-efa0-40c7-94ac-fd57c3b4c3f1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046041 Jul 26 07:31:42.287997 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 389/728] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:42 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:43.144204 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7d20fd0f-d9a1-455f-b02a-4226aebc8cb2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:43.146970 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7d20fd0f-d9a1-455f-b02a-4226aebc8cb2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:43.154731 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7d20fd0f-d9a1-455f-b02a-4226aebc8cb2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:43.155210 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7d20fd0f-d9a1-455f-b02a-4226aebc8cb2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:43.156071 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7d20fd0f-d9a1-455f-b02a-4226aebc8cb2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:43.156570 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7d20fd0f-d9a1-455f-b02a-4226aebc8cb2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:43.192565 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7d20fd0f-d9a1-455f-b02a-4226aebc8cb2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052669 Jul 26 07:31:43.193238 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 340/729] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:43 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:43.303637 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-99fc7bf8-9fbe-45ff-a500-b7dd87b59de9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:43.305733 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-99fc7bf8-9fbe-45ff-a500-b7dd87b59de9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:43.312684 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-99fc7bf8-9fbe-45ff-a500-b7dd87b59de9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:43.313111 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-99fc7bf8-9fbe-45ff-a500-b7dd87b59de9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:43.313953 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-99fc7bf8-9fbe-45ff-a500-b7dd87b59de9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:43.314389 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-99fc7bf8-9fbe-45ff-a500-b7dd87b59de9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:43.344514 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-99fc7bf8-9fbe-45ff-a500-b7dd87b59de9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047425 Jul 26 07:31:43.345071 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 390/730] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:43 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:44.205804 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2179cc6b-9de9-4a4f-84ad-e4f6a12bcf81 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:44.207983 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2179cc6b-9de9-4a4f-84ad-e4f6a12bcf81 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:44.215293 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2179cc6b-9de9-4a4f-84ad-e4f6a12bcf81 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:44.215737 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2179cc6b-9de9-4a4f-84ad-e4f6a12bcf81 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:44.216492 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2179cc6b-9de9-4a4f-84ad-e4f6a12bcf81 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:44.217282 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2179cc6b-9de9-4a4f-84ad-e4f6a12bcf81 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:44.251409 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2179cc6b-9de9-4a4f-84ad-e4f6a12bcf81 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049569 Jul 26 07:31:44.251977 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 341/731] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:44 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:44.363080 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e325c555-9200-4a37-9f91-0d63cfb362c8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:44.366331 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e325c555-9200-4a37-9f91-0d63cfb362c8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:44.376478 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e325c555-9200-4a37-9f91-0d63cfb362c8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:44.377100 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e325c555-9200-4a37-9f91-0d63cfb362c8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:44.378220 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e325c555-9200-4a37-9f91-0d63cfb362c8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:44.378913 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e325c555-9200-4a37-9f91-0d63cfb362c8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:44.403915 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:31:44.410472 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e325c555-9200-4a37-9f91-0d63cfb362c8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054083 Jul 26 07:31:44.411035 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 391/732] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:44 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:45.264467 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-92863784-3ae2-4f2a-8cb1-09cf9c7998be tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:45.266657 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-92863784-3ae2-4f2a-8cb1-09cf9c7998be tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:45.273594 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-92863784-3ae2-4f2a-8cb1-09cf9c7998be tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:45.274118 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-92863784-3ae2-4f2a-8cb1-09cf9c7998be tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:45.274874 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-92863784-3ae2-4f2a-8cb1-09cf9c7998be tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:45.275300 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-92863784-3ae2-4f2a-8cb1-09cf9c7998be tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:45.306452 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-92863784-3ae2-4f2a-8cb1-09cf9c7998be tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046103 Jul 26 07:31:45.307020 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 342/733] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:45 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:45.425175 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8ec8aa8d-94c5-48d7-9ab0-a70edbf1ea2e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:45.427311 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8ec8aa8d-94c5-48d7-9ab0-a70edbf1ea2e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:45.434280 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ec8aa8d-94c5-48d7-9ab0-a70edbf1ea2e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:45.434726 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ec8aa8d-94c5-48d7-9ab0-a70edbf1ea2e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:45.435502 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ec8aa8d-94c5-48d7-9ab0-a70edbf1ea2e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:45.435935 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ec8aa8d-94c5-48d7-9ab0-a70edbf1ea2e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:45.465954 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8ec8aa8d-94c5-48d7-9ab0-a70edbf1ea2e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046128 Jul 26 07:31:45.466503 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 392/734] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:45 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:46.318501 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8945403d-1285-4011-947d-55f15d7d577a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:46.320706 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8945403d-1285-4011-947d-55f15d7d577a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:46.328072 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8945403d-1285-4011-947d-55f15d7d577a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:46.328840 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8945403d-1285-4011-947d-55f15d7d577a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:46.330150 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8945403d-1285-4011-947d-55f15d7d577a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:46.330868 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8945403d-1285-4011-947d-55f15d7d577a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:46.371935 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8945403d-1285-4011-947d-55f15d7d577a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057402 Jul 26 07:31:46.372491 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 343/735] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:46 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:46.478621 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-fe60263e-185b-4928-b2fb-2cd99bb1645a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:46.480767 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-fe60263e-185b-4928-b2fb-2cd99bb1645a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:46.487735 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fe60263e-185b-4928-b2fb-2cd99bb1645a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:46.488178 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fe60263e-185b-4928-b2fb-2cd99bb1645a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:46.488942 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fe60263e-185b-4928-b2fb-2cd99bb1645a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:46.489375 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fe60263e-185b-4928-b2fb-2cd99bb1645a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:46.520127 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-fe60263e-185b-4928-b2fb-2cd99bb1645a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045709 Jul 26 07:31:46.520695 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 393/736] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:46 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:47.385372 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-3f1c6e3b-5454-45e5-afaa-5cae661f5886 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:47.387581 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-3f1c6e3b-5454-45e5-afaa-5cae661f5886 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:47.394560 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3f1c6e3b-5454-45e5-afaa-5cae661f5886 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:47.395009 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3f1c6e3b-5454-45e5-afaa-5cae661f5886 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:47.395767 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3f1c6e3b-5454-45e5-afaa-5cae661f5886 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:47.396198 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3f1c6e3b-5454-45e5-afaa-5cae661f5886 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:47.425455 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-3f1c6e3b-5454-45e5-afaa-5cae661f5886 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044512 Jul 26 07:31:47.426050 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 344/737] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:47 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:47.533822 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f3d34e46-9de1-4253-9cd0-98febff53eba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:47.536022 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f3d34e46-9de1-4253-9cd0-98febff53eba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:47.543209 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f3d34e46-9de1-4253-9cd0-98febff53eba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:47.543587 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f3d34e46-9de1-4253-9cd0-98febff53eba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:47.544349 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f3d34e46-9de1-4253-9cd0-98febff53eba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:47.544777 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f3d34e46-9de1-4253-9cd0-98febff53eba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:47.574175 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f3d34e46-9de1-4253-9cd0-98febff53eba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044448 Jul 26 07:31:47.574735 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 394/738] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:47 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:48.438432 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2e1d9b22-c1b3-4343-9d3d-34daeb512331 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:48.440580 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2e1d9b22-c1b3-4343-9d3d-34daeb512331 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:48.447213 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2e1d9b22-c1b3-4343-9d3d-34daeb512331 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:48.447652 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2e1d9b22-c1b3-4343-9d3d-34daeb512331 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:48.448403 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2e1d9b22-c1b3-4343-9d3d-34daeb512331 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:48.448829 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2e1d9b22-c1b3-4343-9d3d-34daeb512331 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:48.480790 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2e1d9b22-c1b3-4343-9d3d-34daeb512331 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046387 Jul 26 07:31:48.481371 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 345/739] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:48 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:48.587023 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-81d861ec-6851-4a31-8da2-9e3e7bb3a088 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:48.589234 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-81d861ec-6851-4a31-8da2-9e3e7bb3a088 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:48.597097 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-81d861ec-6851-4a31-8da2-9e3e7bb3a088 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:48.597472 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-81d861ec-6851-4a31-8da2-9e3e7bb3a088 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:48.598266 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-81d861ec-6851-4a31-8da2-9e3e7bb3a088 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:48.598695 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-81d861ec-6851-4a31-8da2-9e3e7bb3a088 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:48.628493 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-81d861ec-6851-4a31-8da2-9e3e7bb3a088 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045594 Jul 26 07:31:48.629047 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 395/740] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:48 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:49.492862 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-bbdf32fc-99ef-401d-959c-0ef21ad41381 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:49.495048 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-bbdf32fc-99ef-401d-959c-0ef21ad41381 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:49.501915 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bbdf32fc-99ef-401d-959c-0ef21ad41381 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:49.502381 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bbdf32fc-99ef-401d-959c-0ef21ad41381 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:49.503111 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bbdf32fc-99ef-401d-959c-0ef21ad41381 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:49.503667 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bbdf32fc-99ef-401d-959c-0ef21ad41381 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:49.518031 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:31:49.534670 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-bbdf32fc-99ef-401d-959c-0ef21ad41381 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045804 Jul 26 07:31:49.535299 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 346/741] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:49 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:49.643323 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-07f5bcc0-6f1f-4a90-bc77-5e2dad56c722 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:49.646145 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-07f5bcc0-6f1f-4a90-bc77-5e2dad56c722 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:49.655357 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-07f5bcc0-6f1f-4a90-bc77-5e2dad56c722 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:49.655846 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-07f5bcc0-6f1f-4a90-bc77-5e2dad56c722 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:49.656858 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-07f5bcc0-6f1f-4a90-bc77-5e2dad56c722 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:49.657427 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-07f5bcc0-6f1f-4a90-bc77-5e2dad56c722 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:49.688878 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-07f5bcc0-6f1f-4a90-bc77-5e2dad56c722 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050992 Jul 26 07:31:49.689417 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 396/742] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:49 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:50.550244 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b31f6374-d7d7-4c8b-9945-5990180010f5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:50.553231 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-b31f6374-d7d7-4c8b-9945-5990180010f5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:50.562760 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b31f6374-d7d7-4c8b-9945-5990180010f5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:50.563391 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b31f6374-d7d7-4c8b-9945-5990180010f5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:50.564461 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b31f6374-d7d7-4c8b-9945-5990180010f5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:50.565071 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b31f6374-d7d7-4c8b-9945-5990180010f5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:50.596592 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b31f6374-d7d7-4c8b-9945-5990180010f5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051974 Jul 26 07:31:50.597135 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 347/743] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:50 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:50.703772 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-de1759e5-a0dd-420c-badd-a02f31dbcd57 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:50.705896 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-de1759e5-a0dd-420c-badd-a02f31dbcd57 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:50.713102 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-de1759e5-a0dd-420c-badd-a02f31dbcd57 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:50.713549 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-de1759e5-a0dd-420c-badd-a02f31dbcd57 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:50.714344 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-de1759e5-a0dd-420c-badd-a02f31dbcd57 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:50.714775 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-de1759e5-a0dd-420c-badd-a02f31dbcd57 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:50.747109 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-de1759e5-a0dd-420c-badd-a02f31dbcd57 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047480 Jul 26 07:31:50.747675 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 397/744] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:50 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:51.609052 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-06ca1fa2-c425-4616-af14-934d522aad03 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:51.611262 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-06ca1fa2-c425-4616-af14-934d522aad03 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:51.618806 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-06ca1fa2-c425-4616-af14-934d522aad03 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:51.619220 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-06ca1fa2-c425-4616-af14-934d522aad03 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:51.619984 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-06ca1fa2-c425-4616-af14-934d522aad03 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:51.620443 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-06ca1fa2-c425-4616-af14-934d522aad03 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:51.652309 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-06ca1fa2-c425-4616-af14-934d522aad03 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047184 Jul 26 07:31:51.652996 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 348/745] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:51 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:51.759862 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-91159fed-0e5a-4c39-a72b-f2ff7ab52de9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:51.762137 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-91159fed-0e5a-4c39-a72b-f2ff7ab52de9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:51.769367 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-91159fed-0e5a-4c39-a72b-f2ff7ab52de9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:51.769844 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-91159fed-0e5a-4c39-a72b-f2ff7ab52de9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:51.770626 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-91159fed-0e5a-4c39-a72b-f2ff7ab52de9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:51.771054 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-91159fed-0e5a-4c39-a72b-f2ff7ab52de9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:51.810468 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-91159fed-0e5a-4c39-a72b-f2ff7ab52de9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054446 Jul 26 07:31:51.811332 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 398/746] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:51 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:52.665267 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-952d2b75-4df2-415a-b3a4-ad5cdd2bf179 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:52.667560 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-952d2b75-4df2-415a-b3a4-ad5cdd2bf179 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:52.674848 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-952d2b75-4df2-415a-b3a4-ad5cdd2bf179 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:52.675297 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-952d2b75-4df2-415a-b3a4-ad5cdd2bf179 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:52.676078 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-952d2b75-4df2-415a-b3a4-ad5cdd2bf179 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:52.676496 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-952d2b75-4df2-415a-b3a4-ad5cdd2bf179 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:52.707311 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-952d2b75-4df2-415a-b3a4-ad5cdd2bf179 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046150 Jul 26 07:31:52.707889 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 349/747] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:52 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:52.827073 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-cf52e06f-3a6f-43a1-b1e4-cd53e4f4b9be tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:52.829226 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-cf52e06f-3a6f-43a1-b1e4-cd53e4f4b9be tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:52.836465 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cf52e06f-3a6f-43a1-b1e4-cd53e4f4b9be tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:52.836919 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cf52e06f-3a6f-43a1-b1e4-cd53e4f4b9be tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:52.837698 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cf52e06f-3a6f-43a1-b1e4-cd53e4f4b9be tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:52.838169 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cf52e06f-3a6f-43a1-b1e4-cd53e4f4b9be tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:52.870467 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-cf52e06f-3a6f-43a1-b1e4-cd53e4f4b9be tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048028 Jul 26 07:31:52.871044 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 399/748] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:52 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:53.720579 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c5b0e7c1-40c2-43c9-a826-328f35500b23 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:53.722771 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c5b0e7c1-40c2-43c9-a826-328f35500b23 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:53.729886 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c5b0e7c1-40c2-43c9-a826-328f35500b23 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:53.730369 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c5b0e7c1-40c2-43c9-a826-328f35500b23 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:53.731127 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c5b0e7c1-40c2-43c9-a826-328f35500b23 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:53.731557 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c5b0e7c1-40c2-43c9-a826-328f35500b23 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:53.761846 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c5b0e7c1-40c2-43c9-a826-328f35500b23 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045539 Jul 26 07:31:53.762412 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 350/749] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:53 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:53.884747 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-427df535-c0ba-42fc-a2d3-c80dcc29d7c7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:53.887725 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-427df535-c0ba-42fc-a2d3-c80dcc29d7c7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:53.896925 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-427df535-c0ba-42fc-a2d3-c80dcc29d7c7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:53.897454 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-427df535-c0ba-42fc-a2d3-c80dcc29d7c7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:53.898550 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-427df535-c0ba-42fc-a2d3-c80dcc29d7c7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:53.899148 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-427df535-c0ba-42fc-a2d3-c80dcc29d7c7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:53.928984 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-427df535-c0ba-42fc-a2d3-c80dcc29d7c7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049816 Jul 26 07:31:53.929538 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 400/750] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:53 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:54.774568 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-e09cac62-da2e-4ef5-867c-f1c87c400b7e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:54.776883 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-e09cac62-da2e-4ef5-867c-f1c87c400b7e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:54.783689 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e09cac62-da2e-4ef5-867c-f1c87c400b7e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:54.784132 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e09cac62-da2e-4ef5-867c-f1c87c400b7e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:54.784891 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e09cac62-da2e-4ef5-867c-f1c87c400b7e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:54.785326 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e09cac62-da2e-4ef5-867c-f1c87c400b7e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:54.816200 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-e09cac62-da2e-4ef5-867c-f1c87c400b7e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045618 Jul 26 07:31:54.816762 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 351/751] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:54 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:54.946530 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ef1c5ab9-e27b-48a6-b61b-417226a9f9a0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:54.948922 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ef1c5ab9-e27b-48a6-b61b-417226a9f9a0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:54.955902 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef1c5ab9-e27b-48a6-b61b-417226a9f9a0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:54.956280 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef1c5ab9-e27b-48a6-b61b-417226a9f9a0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:54.957069 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef1c5ab9-e27b-48a6-b61b-417226a9f9a0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:54.957507 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef1c5ab9-e27b-48a6-b61b-417226a9f9a0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:54.987663 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ef1c5ab9-e27b-48a6-b61b-417226a9f9a0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047395 Jul 26 07:31:54.988630 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 401/752] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:54 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:55.832731 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8e9e6db5-b716-4408-8434-95b7d2311fae tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:55.836318 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8e9e6db5-b716-4408-8434-95b7d2311fae tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:55.844757 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8e9e6db5-b716-4408-8434-95b7d2311fae tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:55.845203 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8e9e6db5-b716-4408-8434-95b7d2311fae tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:55.846019 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8e9e6db5-b716-4408-8434-95b7d2311fae tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:55.846448 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8e9e6db5-b716-4408-8434-95b7d2311fae tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:55.876595 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8e9e6db5-b716-4408-8434-95b7d2311fae tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051362 Jul 26 07:31:55.877193 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 352/753] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:55 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:56.000708 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-000417d3-aeeb-4def-b769-494e6117a4ac tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:56.002884 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-000417d3-aeeb-4def-b769-494e6117a4ac tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:56.009847 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-000417d3-aeeb-4def-b769-494e6117a4ac tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:56.010283 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-000417d3-aeeb-4def-b769-494e6117a4ac tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:56.011053 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-000417d3-aeeb-4def-b769-494e6117a4ac tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:56.011458 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-000417d3-aeeb-4def-b769-494e6117a4ac tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:56.042288 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-000417d3-aeeb-4def-b769-494e6117a4ac tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045488 Jul 26 07:31:56.042741 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 402/754] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:55 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:56.893126 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-1bdada45-9742-42d2-b70f-c3cf126920fd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:56.895405 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-1bdada45-9742-42d2-b70f-c3cf126920fd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:56.902235 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1bdada45-9742-42d2-b70f-c3cf126920fd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:56.902678 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1bdada45-9742-42d2-b70f-c3cf126920fd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:56.903448 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1bdada45-9742-42d2-b70f-c3cf126920fd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:56.903875 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1bdada45-9742-42d2-b70f-c3cf126920fd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:56.934803 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-1bdada45-9742-42d2-b70f-c3cf126920fd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045930 Jul 26 07:31:56.935325 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 353/755] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:56 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:57.055662 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8b7aef6c-280b-4419-98a9-349086c4d660 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:57.057911 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8b7aef6c-280b-4419-98a9-349086c4d660 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:57.065034 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8b7aef6c-280b-4419-98a9-349086c4d660 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:57.065517 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8b7aef6c-280b-4419-98a9-349086c4d660 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:57.066318 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8b7aef6c-280b-4419-98a9-349086c4d660 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:57.066759 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8b7aef6c-280b-4419-98a9-349086c4d660 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:57.098055 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8b7aef6c-280b-4419-98a9-349086c4d660 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046501 Jul 26 07:31:57.098515 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 403/756] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:57 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:57.949757 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ccaedb77-a621-4e72-912a-492632222a25 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:57.951963 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ccaedb77-a621-4e72-912a-492632222a25 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:57.958938 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ccaedb77-a621-4e72-912a-492632222a25 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:57.959392 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ccaedb77-a621-4e72-912a-492632222a25 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:57.960173 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ccaedb77-a621-4e72-912a-492632222a25 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:57.960609 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ccaedb77-a621-4e72-912a-492632222a25 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:57.998784 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ccaedb77-a621-4e72-912a-492632222a25 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052877 Jul 26 07:31:57.999371 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 354/757] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:57 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:58.111133 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-11cd4123-baf3-4871-a35f-2c40a3907374 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:58.113295 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-11cd4123-baf3-4871-a35f-2c40a3907374 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:58.120380 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-11cd4123-baf3-4871-a35f-2c40a3907374 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:58.120822 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-11cd4123-baf3-4871-a35f-2c40a3907374 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:58.121668 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-11cd4123-baf3-4871-a35f-2c40a3907374 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:58.122126 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-11cd4123-baf3-4871-a35f-2c40a3907374 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:58.153503 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-11cd4123-baf3-4871-a35f-2c40a3907374 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046247 Jul 26 07:31:58.154029 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 404/758] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:58 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:31:59.012025 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-e2262e68-3f0b-4e41-9c76-16105bf3f722 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:59.014204 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-e2262e68-3f0b-4e41-9c76-16105bf3f722 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:59.021064 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e2262e68-3f0b-4e41-9c76-16105bf3f722 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:59.021545 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e2262e68-3f0b-4e41-9c76-16105bf3f722 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:59.022433 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e2262e68-3f0b-4e41-9c76-16105bf3f722 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:59.022919 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e2262e68-3f0b-4e41-9c76-16105bf3f722 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:59.055778 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-e2262e68-3f0b-4e41-9c76-16105bf3f722 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047900 Jul 26 07:31:59.056389 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 355/759] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:31:59 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:31:59.166527 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e0264282-91ab-4581-9c41-31ce37065cbf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:31:59.168954 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e0264282-91ab-4581-9c41-31ce37065cbf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:31:59.175989 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e0264282-91ab-4581-9c41-31ce37065cbf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:59.176631 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e0264282-91ab-4581-9c41-31ce37065cbf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:59.177402 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e0264282-91ab-4581-9c41-31ce37065cbf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:31:59.177856 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e0264282-91ab-4581-9c41-31ce37065cbf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:31:59.208730 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e0264282-91ab-4581-9c41-31ce37065cbf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046136 Jul 26 07:31:59.209310 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 405/760] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:31:59 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:00.069139 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-5b075aee-2c5f-4ea8-b66a-4534b4479e98 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:00.071656 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-5b075aee-2c5f-4ea8-b66a-4534b4479e98 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:00.079291 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5b075aee-2c5f-4ea8-b66a-4534b4479e98 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:00.079745 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5b075aee-2c5f-4ea8-b66a-4534b4479e98 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:00.080519 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5b075aee-2c5f-4ea8-b66a-4534b4479e98 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:00.080957 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5b075aee-2c5f-4ea8-b66a-4534b4479e98 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:00.112920 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-5b075aee-2c5f-4ea8-b66a-4534b4479e98 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047864 Jul 26 07:32:00.113481 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 356/761] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:00 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:00.223134 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-84275129-ec69-4165-8e73-c2f992dfee2a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:00.225251 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-84275129-ec69-4165-8e73-c2f992dfee2a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:00.232791 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-84275129-ec69-4165-8e73-c2f992dfee2a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:00.233207 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-84275129-ec69-4165-8e73-c2f992dfee2a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:00.234011 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-84275129-ec69-4165-8e73-c2f992dfee2a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:00.234468 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-84275129-ec69-4165-8e73-c2f992dfee2a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:00.265264 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-84275129-ec69-4165-8e73-c2f992dfee2a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046822 Jul 26 07:32:00.265886 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 406/762] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:00 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:01.126450 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2c0083b9-a2c4-41d1-b930-1297a82ad619 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:01.128598 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2c0083b9-a2c4-41d1-b930-1297a82ad619 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:01.135470 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2c0083b9-a2c4-41d1-b930-1297a82ad619 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:01.135915 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2c0083b9-a2c4-41d1-b930-1297a82ad619 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:01.136675 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2c0083b9-a2c4-41d1-b930-1297a82ad619 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:01.137090 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2c0083b9-a2c4-41d1-b930-1297a82ad619 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:01.167645 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2c0083b9-a2c4-41d1-b930-1297a82ad619 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045259 Jul 26 07:32:01.168196 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 357/763] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:01 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:01.281308 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d7642098-e7b0-4437-a5de-07815d99ab70 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:01.283569 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d7642098-e7b0-4437-a5de-07815d99ab70 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:01.290330 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d7642098-e7b0-4437-a5de-07815d99ab70 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:01.290787 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d7642098-e7b0-4437-a5de-07815d99ab70 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:01.291531 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d7642098-e7b0-4437-a5de-07815d99ab70 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:01.291984 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d7642098-e7b0-4437-a5de-07815d99ab70 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:01.321956 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d7642098-e7b0-4437-a5de-07815d99ab70 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046840 Jul 26 07:32:01.322419 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 407/764] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:01 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:02.180436 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-784dfec3-bcbd-484d-aced-9e94fa5f4113 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:02.182643 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-784dfec3-bcbd-484d-aced-9e94fa5f4113 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:02.189695 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-784dfec3-bcbd-484d-aced-9e94fa5f4113 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:02.190170 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-784dfec3-bcbd-484d-aced-9e94fa5f4113 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:02.190942 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-784dfec3-bcbd-484d-aced-9e94fa5f4113 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:02.191346 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-784dfec3-bcbd-484d-aced-9e94fa5f4113 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:02.223531 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-784dfec3-bcbd-484d-aced-9e94fa5f4113 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047024 Jul 26 07:32:02.224086 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 358/765] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:02 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:02.334268 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8ded1918-11c1-46c9-aa34-85e84dd652b7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:02.337326 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8ded1918-11c1-46c9-aa34-85e84dd652b7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:02.346855 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ded1918-11c1-46c9-aa34-85e84dd652b7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:02.347443 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ded1918-11c1-46c9-aa34-85e84dd652b7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:02.348494 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ded1918-11c1-46c9-aa34-85e84dd652b7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:02.349050 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ded1918-11c1-46c9-aa34-85e84dd652b7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:02.365977 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:32:02.383678 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8ded1918-11c1-46c9-aa34-85e84dd652b7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053182 Jul 26 07:32:02.384418 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 408/766] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:02 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:03.236862 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-24f1183d-edb6-4068-a3bf-c6259fd491f4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:03.239078 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-24f1183d-edb6-4068-a3bf-c6259fd491f4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:03.246264 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-24f1183d-edb6-4068-a3bf-c6259fd491f4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:03.246880 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-24f1183d-edb6-4068-a3bf-c6259fd491f4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:03.247580 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-24f1183d-edb6-4068-a3bf-c6259fd491f4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:03.248005 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-24f1183d-edb6-4068-a3bf-c6259fd491f4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:03.281354 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-24f1183d-edb6-4068-a3bf-c6259fd491f4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048661 Jul 26 07:32:03.281948 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 359/767] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:03 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:03.396931 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6855115f-6da1-4e5f-8723-74a30f126d28 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:03.399270 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-6855115f-6da1-4e5f-8723-74a30f126d28 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:03.407395 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6855115f-6da1-4e5f-8723-74a30f126d28 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:03.407742 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6855115f-6da1-4e5f-8723-74a30f126d28 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:03.408524 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6855115f-6da1-4e5f-8723-74a30f126d28 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:03.408953 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6855115f-6da1-4e5f-8723-74a30f126d28 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:03.443889 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6855115f-6da1-4e5f-8723-74a30f126d28 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051002 Jul 26 07:32:03.444484 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 409/768] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:03 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:04.294267 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a90bbfb1-81a7-478d-a105-58a2ca946ed5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:04.296501 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a90bbfb1-81a7-478d-a105-58a2ca946ed5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:04.303758 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a90bbfb1-81a7-478d-a105-58a2ca946ed5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:04.304257 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a90bbfb1-81a7-478d-a105-58a2ca946ed5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:04.305189 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a90bbfb1-81a7-478d-a105-58a2ca946ed5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:04.305667 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a90bbfb1-81a7-478d-a105-58a2ca946ed5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:04.339459 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a90bbfb1-81a7-478d-a105-58a2ca946ed5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049305 Jul 26 07:32:04.340029 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 360/769] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:04 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:04.457148 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d5029ad8-a630-4a05-ba77-ece0c7316a6f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:04.459449 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d5029ad8-a630-4a05-ba77-ece0c7316a6f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:04.467212 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d5029ad8-a630-4a05-ba77-ece0c7316a6f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:04.467575 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d5029ad8-a630-4a05-ba77-ece0c7316a6f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:04.468422 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d5029ad8-a630-4a05-ba77-ece0c7316a6f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:04.468909 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d5029ad8-a630-4a05-ba77-ece0c7316a6f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:04.504633 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d5029ad8-a630-4a05-ba77-ece0c7316a6f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051574 Jul 26 07:32:04.505239 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 410/770] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:04 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:05.355812 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8a49e35e-3081-41a6-866a-a7b108282b41 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:05.358183 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8a49e35e-3081-41a6-866a-a7b108282b41 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:05.360688 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=58 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:32:05.366838 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8a49e35e-3081-41a6-866a-a7b108282b41 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:05.367286 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8a49e35e-3081-41a6-866a-a7b108282b41 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:05.368056 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8a49e35e-3081-41a6-866a-a7b108282b41 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:05.368485 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8a49e35e-3081-41a6-866a-a7b108282b41 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:05.401374 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8a49e35e-3081-41a6-866a-a7b108282b41 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049646 Jul 26 07:32:05.402009 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 361/771] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:05 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:05.522149 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-4ad72a2f-8cfa-40f2-9d84-8de3f2041cd7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:05.525885 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-4ad72a2f-8cfa-40f2-9d84-8de3f2041cd7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:05.537290 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4ad72a2f-8cfa-40f2-9d84-8de3f2041cd7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:05.538088 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4ad72a2f-8cfa-40f2-9d84-8de3f2041cd7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:05.539393 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4ad72a2f-8cfa-40f2-9d84-8de3f2041cd7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:05.540120 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4ad72a2f-8cfa-40f2-9d84-8de3f2041cd7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:05.576159 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-4ad72a2f-8cfa-40f2-9d84-8de3f2041cd7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061657 Jul 26 07:32:05.576758 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 411/772] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:05 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:06.414585 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-331626c6-d79a-4533-8209-b8e39b9e0055 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:06.416800 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-331626c6-d79a-4533-8209-b8e39b9e0055 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:06.424099 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-331626c6-d79a-4533-8209-b8e39b9e0055 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:06.424555 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-331626c6-d79a-4533-8209-b8e39b9e0055 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:06.425366 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-331626c6-d79a-4533-8209-b8e39b9e0055 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:06.425827 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-331626c6-d79a-4533-8209-b8e39b9e0055 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:06.460153 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-331626c6-d79a-4533-8209-b8e39b9e0055 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049683 Jul 26 07:32:06.460718 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 362/773] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:06 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:06.589672 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6e8256fe-1bab-4aa4-93a0-ca22b1cf0696 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:06.592252 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-6e8256fe-1bab-4aa4-93a0-ca22b1cf0696 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:06.594695 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=58 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:32:06.600511 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6e8256fe-1bab-4aa4-93a0-ca22b1cf0696 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:06.600954 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6e8256fe-1bab-4aa4-93a0-ca22b1cf0696 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:06.601754 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6e8256fe-1bab-4aa4-93a0-ca22b1cf0696 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:06.602197 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6e8256fe-1bab-4aa4-93a0-ca22b1cf0696 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:06.633724 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6e8256fe-1bab-4aa4-93a0-ca22b1cf0696 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048109 Jul 26 07:32:06.634320 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 412/774] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:06 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 07:32:07.474342 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9d2df6c8-ed11-4bd1-bef6-2309c096629b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:07.476580 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-9d2df6c8-ed11-4bd1-bef6-2309c096629b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:07.484090 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9d2df6c8-ed11-4bd1-bef6-2309c096629b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:07.484522 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9d2df6c8-ed11-4bd1-bef6-2309c096629b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:07.485295 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9d2df6c8-ed11-4bd1-bef6-2309c096629b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:07.485725 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9d2df6c8-ed11-4bd1-bef6-2309c096629b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:07.488701 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:32:07.522275 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-9d2df6c8-ed11-4bd1-bef6-2309c096629b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052071 Jul 26 07:32:07.522852 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 363/775] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:07 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:07.647129 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-45a0e067-6376-4116-be79-7d4a98edfbb0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:07.649270 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-45a0e067-6376-4116-be79-7d4a98edfbb0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:07.656663 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-45a0e067-6376-4116-be79-7d4a98edfbb0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:07.657116 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-45a0e067-6376-4116-be79-7d4a98edfbb0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:07.657954 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-45a0e067-6376-4116-be79-7d4a98edfbb0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:07.658391 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-45a0e067-6376-4116-be79-7d4a98edfbb0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:07.692660 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-45a0e067-6376-4116-be79-7d4a98edfbb0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049699 Jul 26 07:32:07.693253 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 413/776] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:07 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:08.537598 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-5ca090a7-b176-41d6-9c7e-77fefae8d1ed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:08.539817 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-5ca090a7-b176-41d6-9c7e-77fefae8d1ed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:08.546898 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5ca090a7-b176-41d6-9c7e-77fefae8d1ed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:08.547320 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5ca090a7-b176-41d6-9c7e-77fefae8d1ed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:08.548091 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5ca090a7-b176-41d6-9c7e-77fefae8d1ed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:08.548519 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5ca090a7-b176-41d6-9c7e-77fefae8d1ed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:08.582093 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-5ca090a7-b176-41d6-9c7e-77fefae8d1ed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048457 Jul 26 07:32:08.582671 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 364/777] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:08 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:08.705694 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b36dedf8-fc37-4657-a1fb-d2aeeac0e2a1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:08.707886 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b36dedf8-fc37-4657-a1fb-d2aeeac0e2a1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:08.715941 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b36dedf8-fc37-4657-a1fb-d2aeeac0e2a1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:08.716383 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b36dedf8-fc37-4657-a1fb-d2aeeac0e2a1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:08.717521 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b36dedf8-fc37-4657-a1fb-d2aeeac0e2a1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:08.717987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b36dedf8-fc37-4657-a1fb-d2aeeac0e2a1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:08.750297 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b36dedf8-fc37-4657-a1fb-d2aeeac0e2a1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048626 Jul 26 07:32:08.750859 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 414/778] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:08 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:09.595380 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ed2214f4-27ac-4a74-9865-05ec33a8ae54 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:09.597533 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ed2214f4-27ac-4a74-9865-05ec33a8ae54 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:09.604664 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ed2214f4-27ac-4a74-9865-05ec33a8ae54 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:09.605182 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ed2214f4-27ac-4a74-9865-05ec33a8ae54 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:09.606168 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ed2214f4-27ac-4a74-9865-05ec33a8ae54 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:09.606594 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ed2214f4-27ac-4a74-9865-05ec33a8ae54 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:09.637317 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ed2214f4-27ac-4a74-9865-05ec33a8ae54 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046494 Jul 26 07:32:09.637904 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 365/779] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:09 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:09.763953 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d2496914-78df-4154-91b7-87b2863b4d39 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:09.766175 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d2496914-78df-4154-91b7-87b2863b4d39 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:09.773136 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d2496914-78df-4154-91b7-87b2863b4d39 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:09.773606 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d2496914-78df-4154-91b7-87b2863b4d39 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:09.774425 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d2496914-78df-4154-91b7-87b2863b4d39 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:09.774857 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d2496914-78df-4154-91b7-87b2863b4d39 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:09.806116 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d2496914-78df-4154-91b7-87b2863b4d39 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046232 Jul 26 07:32:09.806702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 415/780] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:09 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:10.264463 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 07:32:10.264696 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Tue Jul 26 07:32:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 07:32:10.651506 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7f38645d-5984-4cad-bf7d-3ecf9b707ba2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:10.653775 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7f38645d-5984-4cad-bf7d-3ecf9b707ba2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:10.660871 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7f38645d-5984-4cad-bf7d-3ecf9b707ba2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:10.661311 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7f38645d-5984-4cad-bf7d-3ecf9b707ba2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:10.662129 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7f38645d-5984-4cad-bf7d-3ecf9b707ba2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:10.662556 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7f38645d-5984-4cad-bf7d-3ecf9b707ba2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:10.693664 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7f38645d-5984-4cad-bf7d-3ecf9b707ba2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046311 Jul 26 07:32:10.694256 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 366/781] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:10 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:10.819445 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-2099ab5d-ebc5-42e3-bbd6-2ff90bbf1b66 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:10.821540 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2099ab5d-ebc5-42e3-bbd6-2ff90bbf1b66 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:10.828772 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2099ab5d-ebc5-42e3-bbd6-2ff90bbf1b66 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:10.829204 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2099ab5d-ebc5-42e3-bbd6-2ff90bbf1b66 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:10.830017 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2099ab5d-ebc5-42e3-bbd6-2ff90bbf1b66 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:10.830449 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2099ab5d-ebc5-42e3-bbd6-2ff90bbf1b66 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:10.863137 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-2099ab5d-ebc5-42e3-bbd6-2ff90bbf1b66 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047800 Jul 26 07:32:10.863707 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 416/782] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:10 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:11.705854 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-12645a0b-f9f4-45d6-9766-b295ad50308f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:11.708050 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-12645a0b-f9f4-45d6-9766-b295ad50308f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:11.715351 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-12645a0b-f9f4-45d6-9766-b295ad50308f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:11.715804 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-12645a0b-f9f4-45d6-9766-b295ad50308f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:11.717006 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-12645a0b-f9f4-45d6-9766-b295ad50308f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:11.717447 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-12645a0b-f9f4-45d6-9766-b295ad50308f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:11.749727 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-12645a0b-f9f4-45d6-9766-b295ad50308f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047827 Jul 26 07:32:11.750331 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 367/783] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:11 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:11.876218 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a0cd38cc-f213-4b7a-a51e-b3ed6b255209 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:11.878447 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a0cd38cc-f213-4b7a-a51e-b3ed6b255209 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:11.885716 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a0cd38cc-f213-4b7a-a51e-b3ed6b255209 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:11.886122 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a0cd38cc-f213-4b7a-a51e-b3ed6b255209 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:11.886902 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a0cd38cc-f213-4b7a-a51e-b3ed6b255209 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:11.887338 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a0cd38cc-f213-4b7a-a51e-b3ed6b255209 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:11.920864 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a0cd38cc-f213-4b7a-a51e-b3ed6b255209 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048640 Jul 26 07:32:11.921439 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 417/784] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:11 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:12.762688 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f5e21cb2-403a-4323-8e3a-db233541c88c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:12.765063 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-f5e21cb2-403a-4323-8e3a-db233541c88c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:12.772323 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f5e21cb2-403a-4323-8e3a-db233541c88c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:12.772784 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f5e21cb2-403a-4323-8e3a-db233541c88c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:12.773884 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f5e21cb2-403a-4323-8e3a-db233541c88c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:12.774163 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f5e21cb2-403a-4323-8e3a-db233541c88c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:12.806312 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f5e21cb2-403a-4323-8e3a-db233541c88c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047615 Jul 26 07:32:12.806890 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 368/785] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:12 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:12.934791 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-4b6f8b21-4c8e-4644-9b5b-5379a311b6b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:12.937244 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-4b6f8b21-4c8e-4644-9b5b-5379a311b6b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:12.945304 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4b6f8b21-4c8e-4644-9b5b-5379a311b6b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:12.945792 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4b6f8b21-4c8e-4644-9b5b-5379a311b6b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:12.946789 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4b6f8b21-4c8e-4644-9b5b-5379a311b6b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:12.947251 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4b6f8b21-4c8e-4644-9b5b-5379a311b6b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:12.977966 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-4b6f8b21-4c8e-4644-9b5b-5379a311b6b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047873 Jul 26 07:32:12.978512 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 418/786] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:12 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:13.820022 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-28feb535-5605-4ce7-8903-fd12415944f8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:13.822244 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-28feb535-5605-4ce7-8903-fd12415944f8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:13.829594 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-28feb535-5605-4ce7-8903-fd12415944f8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:13.830063 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-28feb535-5605-4ce7-8903-fd12415944f8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:13.830836 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-28feb535-5605-4ce7-8903-fd12415944f8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:13.831264 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-28feb535-5605-4ce7-8903-fd12415944f8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:13.863892 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-28feb535-5605-4ce7-8903-fd12415944f8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047818 Jul 26 07:32:13.864471 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 369/787] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:13 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:13.990535 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-54bf60e4-79aa-4ba4-b522-b68ea3e205b1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:13.992784 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-54bf60e4-79aa-4ba4-b522-b68ea3e205b1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:14.000076 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-54bf60e4-79aa-4ba4-b522-b68ea3e205b1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:14.000531 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-54bf60e4-79aa-4ba4-b522-b68ea3e205b1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:14.001316 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-54bf60e4-79aa-4ba4-b522-b68ea3e205b1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:14.001840 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-54bf60e4-79aa-4ba4-b522-b68ea3e205b1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:14.033708 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-54bf60e4-79aa-4ba4-b522-b68ea3e205b1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047103 Jul 26 07:32:14.034292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 419/788] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:13 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:14.877122 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8d9feda3-f874-4196-b89a-eb1bde26c663 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:14.879329 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8d9feda3-f874-4196-b89a-eb1bde26c663 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:14.886659 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8d9feda3-f874-4196-b89a-eb1bde26c663 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:14.887144 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8d9feda3-f874-4196-b89a-eb1bde26c663 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:14.887957 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8d9feda3-f874-4196-b89a-eb1bde26c663 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:14.888383 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8d9feda3-f874-4196-b89a-eb1bde26c663 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:14.921596 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8d9feda3-f874-4196-b89a-eb1bde26c663 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048849 Jul 26 07:32:14.922284 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 370/789] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:14 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:15.048237 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-fcf5bb17-0656-4936-b9ed-dc7fc0c9dbbd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:15.050476 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-fcf5bb17-0656-4936-b9ed-dc7fc0c9dbbd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:15.057213 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fcf5bb17-0656-4936-b9ed-dc7fc0c9dbbd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:15.057664 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fcf5bb17-0656-4936-b9ed-dc7fc0c9dbbd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:15.058555 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fcf5bb17-0656-4936-b9ed-dc7fc0c9dbbd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:15.058987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fcf5bb17-0656-4936-b9ed-dc7fc0c9dbbd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:15.090337 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-fcf5bb17-0656-4936-b9ed-dc7fc0c9dbbd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047397 Jul 26 07:32:15.090848 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 420/790] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:15 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:15.937285 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-69fe148f-2238-407e-8098-9812f95e2eb7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:15.939493 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-69fe148f-2238-407e-8098-9812f95e2eb7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:15.946434 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-69fe148f-2238-407e-8098-9812f95e2eb7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:15.946905 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-69fe148f-2238-407e-8098-9812f95e2eb7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:15.947938 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-69fe148f-2238-407e-8098-9812f95e2eb7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:15.948370 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-69fe148f-2238-407e-8098-9812f95e2eb7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:15.980399 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-69fe148f-2238-407e-8098-9812f95e2eb7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049194 Jul 26 07:32:15.980966 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 371/791] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:15 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:16.103876 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-efcccaaa-53be-4abc-9b65-5df7fe8ccc07 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:16.106087 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-efcccaaa-53be-4abc-9b65-5df7fe8ccc07 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:16.113037 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-efcccaaa-53be-4abc-9b65-5df7fe8ccc07 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:16.113460 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-efcccaaa-53be-4abc-9b65-5df7fe8ccc07 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:16.114278 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-efcccaaa-53be-4abc-9b65-5df7fe8ccc07 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:16.114704 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-efcccaaa-53be-4abc-9b65-5df7fe8ccc07 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:16.145977 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-efcccaaa-53be-4abc-9b65-5df7fe8ccc07 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046006 Jul 26 07:32:16.146455 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 421/792] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:16 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 07:32:16.992854 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b68f0772-8150-4c79-b282-0743d7017f01 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:16.995069 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-b68f0772-8150-4c79-b282-0743d7017f01 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:17.002193 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b68f0772-8150-4c79-b282-0743d7017f01 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:17.002642 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b68f0772-8150-4c79-b282-0743d7017f01 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:17.003422 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b68f0772-8150-4c79-b282-0743d7017f01 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:17.003849 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b68f0772-8150-4c79-b282-0743d7017f01 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:17.035085 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b68f0772-8150-4c79-b282-0743d7017f01 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046220 Jul 26 07:32:17.035661 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 372/793] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:16 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:17.158991 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-16c41d6b-3928-4c9b-947d-07ed6ce1ff30 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:17.161136 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-16c41d6b-3928-4c9b-947d-07ed6ce1ff30 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:17.168563 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-16c41d6b-3928-4c9b-947d-07ed6ce1ff30 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:17.169011 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-16c41d6b-3928-4c9b-947d-07ed6ce1ff30 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:17.169817 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-16c41d6b-3928-4c9b-947d-07ed6ce1ff30 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:17.170235 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-16c41d6b-3928-4c9b-947d-07ed6ce1ff30 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:17.203163 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-16c41d6b-3928-4c9b-947d-07ed6ce1ff30 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048282 Jul 26 07:32:17.203714 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 422/794] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:17 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:17.639366 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 07:32:17.639619 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Tue Jul 26 07:32:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 07:32:18.048980 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ad84085f-e7c4-4094-8ceb-960ae0395744 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:18.051634 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ad84085f-e7c4-4094-8ceb-960ae0395744 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:18.062559 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ad84085f-e7c4-4094-8ceb-960ae0395744 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:18.063159 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ad84085f-e7c4-4094-8ceb-960ae0395744 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:18.064292 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ad84085f-e7c4-4094-8ceb-960ae0395744 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:18.064910 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ad84085f-e7c4-4094-8ceb-960ae0395744 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:18.102187 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ad84085f-e7c4-4094-8ceb-960ae0395744 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056765 Jul 26 07:32:18.102898 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 373/795] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:18 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:18.217337 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c6b58318-1433-47fb-8819-6c3c34f7739a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:18.219624 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c6b58318-1433-47fb-8819-6c3c34f7739a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:18.226842 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c6b58318-1433-47fb-8819-6c3c34f7739a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:18.227283 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c6b58318-1433-47fb-8819-6c3c34f7739a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:18.228084 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c6b58318-1433-47fb-8819-6c3c34f7739a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:18.228512 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c6b58318-1433-47fb-8819-6c3c34f7739a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:18.259742 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c6b58318-1433-47fb-8819-6c3c34f7739a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046854 Jul 26 07:32:18.260295 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 423/796] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:18 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:19.115349 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c276717d-d1a8-4f05-a15c-a3ed860c6673 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:19.117600 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c276717d-d1a8-4f05-a15c-a3ed860c6673 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:19.124599 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c276717d-d1a8-4f05-a15c-a3ed860c6673 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:19.125092 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c276717d-d1a8-4f05-a15c-a3ed860c6673 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:19.125972 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c276717d-d1a8-4f05-a15c-a3ed860c6673 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:19.126401 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c276717d-d1a8-4f05-a15c-a3ed860c6673 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:19.156643 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c276717d-d1a8-4f05-a15c-a3ed860c6673 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045187 Jul 26 07:32:19.157193 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 374/797] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:19 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:19.275503 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e07f8a12-3389-4d5b-9a68-faf34f56d35e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:19.278395 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e07f8a12-3389-4d5b-9a68-faf34f56d35e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:19.285729 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e07f8a12-3389-4d5b-9a68-faf34f56d35e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:19.286201 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e07f8a12-3389-4d5b-9a68-faf34f56d35e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:19.286954 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e07f8a12-3389-4d5b-9a68-faf34f56d35e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:19.287381 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e07f8a12-3389-4d5b-9a68-faf34f56d35e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:19.317605 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e07f8a12-3389-4d5b-9a68-faf34f56d35e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047818 Jul 26 07:32:19.318204 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 424/798] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:19 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:20.169158 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-4dc1bb0b-9d52-41b3-9108-32bcb6dccf84 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:20.171532 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-4dc1bb0b-9d52-41b3-9108-32bcb6dccf84 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:20.178739 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4dc1bb0b-9d52-41b3-9108-32bcb6dccf84 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:20.179188 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4dc1bb0b-9d52-41b3-9108-32bcb6dccf84 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:20.179976 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4dc1bb0b-9d52-41b3-9108-32bcb6dccf84 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:20.180412 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4dc1bb0b-9d52-41b3-9108-32bcb6dccf84 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:20.213073 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-4dc1bb0b-9d52-41b3-9108-32bcb6dccf84 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047952 Jul 26 07:32:20.213668 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 375/799] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:20 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:20.333031 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6dcd9234-dbd4-45d2-a781-5f66fe82863f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:20.335875 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-6dcd9234-dbd4-45d2-a781-5f66fe82863f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:20.343355 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6dcd9234-dbd4-45d2-a781-5f66fe82863f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:20.344063 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6dcd9234-dbd4-45d2-a781-5f66fe82863f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:20.345048 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6dcd9234-dbd4-45d2-a781-5f66fe82863f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:20.345564 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6dcd9234-dbd4-45d2-a781-5f66fe82863f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:20.348633 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:32:20.379667 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6dcd9234-dbd4-45d2-a781-5f66fe82863f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050691 Jul 26 07:32:20.380144 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 425/800] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:20 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:21.226562 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-309d472d-e75e-4f44-b15b-cebc2c5d468c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:21.228720 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-309d472d-e75e-4f44-b15b-cebc2c5d468c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:21.235685 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-309d472d-e75e-4f44-b15b-cebc2c5d468c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:21.236133 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-309d472d-e75e-4f44-b15b-cebc2c5d468c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:21.236888 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-309d472d-e75e-4f44-b15b-cebc2c5d468c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:21.237308 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-309d472d-e75e-4f44-b15b-cebc2c5d468c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:21.266232 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-309d472d-e75e-4f44-b15b-cebc2c5d468c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043577 Jul 26 07:32:21.266779 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 376/801] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:21 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:21.395504 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-03a88c0c-8ade-481e-a9c0-b680566a1f19 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:21.398917 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-03a88c0c-8ade-481e-a9c0-b680566a1f19 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:21.408811 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-03a88c0c-8ade-481e-a9c0-b680566a1f19 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:21.409252 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-03a88c0c-8ade-481e-a9c0-b680566a1f19 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:21.410049 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-03a88c0c-8ade-481e-a9c0-b680566a1f19 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:21.410471 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-03a88c0c-8ade-481e-a9c0-b680566a1f19 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:21.440769 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-03a88c0c-8ade-481e-a9c0-b680566a1f19 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051295 Jul 26 07:32:21.441247 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 426/802] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:21 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:22.282554 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-defaf937-aac7-4a84-bb92-85458ca591c7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:22.285544 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-defaf937-aac7-4a84-bb92-85458ca591c7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:22.294196 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-defaf937-aac7-4a84-bb92-85458ca591c7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:22.294667 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-defaf937-aac7-4a84-bb92-85458ca591c7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:22.295413 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-defaf937-aac7-4a84-bb92-85458ca591c7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:22.295867 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-defaf937-aac7-4a84-bb92-85458ca591c7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:22.325155 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-defaf937-aac7-4a84-bb92-85458ca591c7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048940 Jul 26 07:32:22.325702 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 377/803] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:22 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:22.453891 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-bcae2fd4-2e6e-4e8e-b6ad-1819b8cf25d9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:22.456164 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-bcae2fd4-2e6e-4e8e-b6ad-1819b8cf25d9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:22.463210 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bcae2fd4-2e6e-4e8e-b6ad-1819b8cf25d9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:22.463652 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bcae2fd4-2e6e-4e8e-b6ad-1819b8cf25d9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:22.464421 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bcae2fd4-2e6e-4e8e-b6ad-1819b8cf25d9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:22.464851 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bcae2fd4-2e6e-4e8e-b6ad-1819b8cf25d9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:22.495416 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-bcae2fd4-2e6e-4e8e-b6ad-1819b8cf25d9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045512 Jul 26 07:32:22.495888 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 427/804] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:22 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:23.337181 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f42db393-e710-4d53-b2b0-7161d6e0d2d1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:23.339382 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-f42db393-e710-4d53-b2b0-7161d6e0d2d1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:23.346578 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f42db393-e710-4d53-b2b0-7161d6e0d2d1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:23.347025 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f42db393-e710-4d53-b2b0-7161d6e0d2d1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:23.347828 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f42db393-e710-4d53-b2b0-7161d6e0d2d1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:23.348261 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f42db393-e710-4d53-b2b0-7161d6e0d2d1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:23.380456 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f42db393-e710-4d53-b2b0-7161d6e0d2d1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047274 Jul 26 07:32:23.381025 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 378/805] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:23 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 07:32:23.508696 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-edb42a34-d211-4f64-b2a8-e32b764210ee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:23.511005 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-edb42a34-d211-4f64-b2a8-e32b764210ee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:23.519513 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-edb42a34-d211-4f64-b2a8-e32b764210ee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:23.520111 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-edb42a34-d211-4f64-b2a8-e32b764210ee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:23.521285 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-edb42a34-d211-4f64-b2a8-e32b764210ee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:23.521924 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-edb42a34-d211-4f64-b2a8-e32b764210ee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:23.554658 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-edb42a34-d211-4f64-b2a8-e32b764210ee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050071 Jul 26 07:32:23.555121 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 428/806] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:23 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:24.392908 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9d644422-155f-48ac-8124-474e2ce298b8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:24.395139 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-9d644422-155f-48ac-8124-474e2ce298b8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:24.402429 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9d644422-155f-48ac-8124-474e2ce298b8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:24.402878 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9d644422-155f-48ac-8124-474e2ce298b8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:24.403661 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9d644422-155f-48ac-8124-474e2ce298b8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:24.404093 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9d644422-155f-48ac-8124-474e2ce298b8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:24.430027 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:32:24.437327 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-9d644422-155f-48ac-8124-474e2ce298b8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048381 Jul 26 07:32:24.437948 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 379/807] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:24 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:24.568043 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3c596bb7-25ec-409c-8e28-3913e6213155 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:24.570458 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3c596bb7-25ec-409c-8e28-3913e6213155 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:24.579797 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3c596bb7-25ec-409c-8e28-3913e6213155 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:24.580624 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3c596bb7-25ec-409c-8e28-3913e6213155 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:24.581541 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3c596bb7-25ec-409c-8e28-3913e6213155 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:24.581913 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3c596bb7-25ec-409c-8e28-3913e6213155 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:24.615754 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3c596bb7-25ec-409c-8e28-3913e6213155 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052024 Jul 26 07:32:24.616338 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 429/808] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:24 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:25.450562 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b5756f63-67ed-4bc1-b2c2-d7484b3d98c3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:25.452729 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-b5756f63-67ed-4bc1-b2c2-d7484b3d98c3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:25.459939 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b5756f63-67ed-4bc1-b2c2-d7484b3d98c3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:25.460384 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b5756f63-67ed-4bc1-b2c2-d7484b3d98c3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:25.461263 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b5756f63-67ed-4bc1-b2c2-d7484b3d98c3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:25.461705 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b5756f63-67ed-4bc1-b2c2-d7484b3d98c3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:25.495280 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b5756f63-67ed-4bc1-b2c2-d7484b3d98c3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048798 Jul 26 07:32:25.495852 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 380/809] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:25 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:25.632742 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7dc128b9-7a1b-4776-b3d4-7d1ab38af500 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:25.639657 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7dc128b9-7a1b-4776-b3d4-7d1ab38af500 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:25.647218 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7dc128b9-7a1b-4776-b3d4-7d1ab38af500 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:25.647685 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7dc128b9-7a1b-4776-b3d4-7d1ab38af500 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:25.648607 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7dc128b9-7a1b-4776-b3d4-7d1ab38af500 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:25.649134 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7dc128b9-7a1b-4776-b3d4-7d1ab38af500 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:25.680646 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7dc128b9-7a1b-4776-b3d4-7d1ab38af500 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055926 Jul 26 07:32:25.681198 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 430/810] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:25 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 07:32:26.507973 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-20db9366-5a22-434d-854c-7ab916f0e225 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:26.510145 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-20db9366-5a22-434d-854c-7ab916f0e225 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:26.517215 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-20db9366-5a22-434d-854c-7ab916f0e225 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:26.517675 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-20db9366-5a22-434d-854c-7ab916f0e225 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:26.518438 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-20db9366-5a22-434d-854c-7ab916f0e225 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:26.518860 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-20db9366-5a22-434d-854c-7ab916f0e225 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:26.550613 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-20db9366-5a22-434d-854c-7ab916f0e225 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046540 Jul 26 07:32:26.551198 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 381/811] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:26 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:26.694871 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-5e2da5d1-40e8-46df-9808-25cedfb2bc81 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:26.696957 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-5e2da5d1-40e8-46df-9808-25cedfb2bc81 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:26.704357 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5e2da5d1-40e8-46df-9808-25cedfb2bc81 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:26.704774 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5e2da5d1-40e8-46df-9808-25cedfb2bc81 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:26.705568 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5e2da5d1-40e8-46df-9808-25cedfb2bc81 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:26.706032 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5e2da5d1-40e8-46df-9808-25cedfb2bc81 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:26.737271 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-5e2da5d1-40e8-46df-9808-25cedfb2bc81 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046522 Jul 26 07:32:26.737879 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 431/812] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:26 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:27.188721 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 07:32:27.188876 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Tue Jul 26 07:32:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 07:32:27.568205 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a914bc45-cf46-46c8-abf9-de161fe68382 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:27.571941 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a914bc45-cf46-46c8-abf9-de161fe68382 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:27.585078 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a914bc45-cf46-46c8-abf9-de161fe68382 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:27.585683 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a914bc45-cf46-46c8-abf9-de161fe68382 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:27.587035 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a914bc45-cf46-46c8-abf9-de161fe68382 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:27.587748 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a914bc45-cf46-46c8-abf9-de161fe68382 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:27.620229 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a914bc45-cf46-46c8-abf9-de161fe68382 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059523 Jul 26 07:32:27.620798 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 382/813] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:27 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:27.749428 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-aaa6a1a3-f19b-42d5-9e50-e2308b07032a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:27.751610 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-aaa6a1a3-f19b-42d5-9e50-e2308b07032a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:27.758891 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-aaa6a1a3-f19b-42d5-9e50-e2308b07032a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:27.759339 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-aaa6a1a3-f19b-42d5-9e50-e2308b07032a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:27.760119 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-aaa6a1a3-f19b-42d5-9e50-e2308b07032a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:27.760599 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-aaa6a1a3-f19b-42d5-9e50-e2308b07032a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:27.793086 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-aaa6a1a3-f19b-42d5-9e50-e2308b07032a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047646 Jul 26 07:32:27.793579 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 432/814] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:27 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:28.632900 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-53bde3bf-55b0-420c-9e7d-15184da7e7b7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:28.635258 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-53bde3bf-55b0-420c-9e7d-15184da7e7b7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:28.643050 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-53bde3bf-55b0-420c-9e7d-15184da7e7b7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:28.643732 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-53bde3bf-55b0-420c-9e7d-15184da7e7b7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:28.644528 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-53bde3bf-55b0-420c-9e7d-15184da7e7b7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:28.644968 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-53bde3bf-55b0-420c-9e7d-15184da7e7b7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:28.677258 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-53bde3bf-55b0-420c-9e7d-15184da7e7b7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048356 Jul 26 07:32:28.677864 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 383/815] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:28 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:28.806336 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a977f7c4-0587-40ed-ba00-6904ec8e3234 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:28.808533 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a977f7c4-0587-40ed-ba00-6904ec8e3234 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:28.816014 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a977f7c4-0587-40ed-ba00-6904ec8e3234 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:28.816417 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a977f7c4-0587-40ed-ba00-6904ec8e3234 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:28.817192 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a977f7c4-0587-40ed-ba00-6904ec8e3234 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:28.817638 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a977f7c4-0587-40ed-ba00-6904ec8e3234 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:28.850022 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a977f7c4-0587-40ed-ba00-6904ec8e3234 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047712 Jul 26 07:32:28.850593 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 433/816] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:28 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:29.690043 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-87dc550f-dbb6-45cf-b0b4-2d7e40fa17c0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:29.692334 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-87dc550f-dbb6-45cf-b0b4-2d7e40fa17c0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:29.699795 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-87dc550f-dbb6-45cf-b0b4-2d7e40fa17c0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:29.700236 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-87dc550f-dbb6-45cf-b0b4-2d7e40fa17c0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:29.701022 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-87dc550f-dbb6-45cf-b0b4-2d7e40fa17c0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:29.701456 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-87dc550f-dbb6-45cf-b0b4-2d7e40fa17c0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:29.733716 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-87dc550f-dbb6-45cf-b0b4-2d7e40fa17c0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047629 Jul 26 07:32:29.734307 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 384/817] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:29 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:29.863846 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3d76f3d6-a6f1-4148-b593-59e79c3f6733 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:29.866148 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3d76f3d6-a6f1-4148-b593-59e79c3f6733 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:29.873709 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3d76f3d6-a6f1-4148-b593-59e79c3f6733 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:29.874094 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3d76f3d6-a6f1-4148-b593-59e79c3f6733 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:29.874881 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3d76f3d6-a6f1-4148-b593-59e79c3f6733 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:29.875311 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3d76f3d6-a6f1-4148-b593-59e79c3f6733 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:29.909120 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3d76f3d6-a6f1-4148-b593-59e79c3f6733 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049310 Jul 26 07:32:29.909717 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 434/818] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:29 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:30.749264 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b396968c-1e0c-4aa4-8ca5-d8a1f1754840 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:30.752095 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-b396968c-1e0c-4aa4-8ca5-d8a1f1754840 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:30.762059 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b396968c-1e0c-4aa4-8ca5-d8a1f1754840 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:30.762662 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b396968c-1e0c-4aa4-8ca5-d8a1f1754840 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:30.763462 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b396968c-1e0c-4aa4-8ca5-d8a1f1754840 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:30.764268 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b396968c-1e0c-4aa4-8ca5-d8a1f1754840 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:30.796860 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b396968c-1e0c-4aa4-8ca5-d8a1f1754840 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053464 Jul 26 07:32:30.797426 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 385/819] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:30 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:30.922688 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c67f40ae-7206-4836-b05c-5e9f6444a008 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:30.925552 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c67f40ae-7206-4836-b05c-5e9f6444a008 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:30.932861 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c67f40ae-7206-4836-b05c-5e9f6444a008 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:30.933311 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c67f40ae-7206-4836-b05c-5e9f6444a008 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:30.934135 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c67f40ae-7206-4836-b05c-5e9f6444a008 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:30.934565 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c67f40ae-7206-4836-b05c-5e9f6444a008 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:30.965094 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c67f40ae-7206-4836-b05c-5e9f6444a008 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046556 Jul 26 07:32:30.965654 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 435/820] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:30 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:31.809674 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-3dc9cfe8-efa4-41bd-afbf-dc06cbb16c8e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:31.811853 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-3dc9cfe8-efa4-41bd-afbf-dc06cbb16c8e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:31.818684 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3dc9cfe8-efa4-41bd-afbf-dc06cbb16c8e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:31.819173 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3dc9cfe8-efa4-41bd-afbf-dc06cbb16c8e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:31.819849 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3dc9cfe8-efa4-41bd-afbf-dc06cbb16c8e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:31.820295 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3dc9cfe8-efa4-41bd-afbf-dc06cbb16c8e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:31.850570 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-3dc9cfe8-efa4-41bd-afbf-dc06cbb16c8e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044884 Jul 26 07:32:31.851131 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 386/821] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:31 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:31.982650 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c71918ee-8795-440e-90d1-b8ee36b984c1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:31.984971 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c71918ee-8795-440e-90d1-b8ee36b984c1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:31.993234 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c71918ee-8795-440e-90d1-b8ee36b984c1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:31.993681 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c71918ee-8795-440e-90d1-b8ee36b984c1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:31.995130 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c71918ee-8795-440e-90d1-b8ee36b984c1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:31.995570 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c71918ee-8795-440e-90d1-b8ee36b984c1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:32.028254 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c71918ee-8795-440e-90d1-b8ee36b984c1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050975 Jul 26 07:32:32.029202 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 436/822] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:31 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:32.863253 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-809b8a69-88c6-42f0-8f50-9c8e9edef50b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:32.865434 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-809b8a69-88c6-42f0-8f50-9c8e9edef50b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:32.872629 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-809b8a69-88c6-42f0-8f50-9c8e9edef50b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:32.873076 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-809b8a69-88c6-42f0-8f50-9c8e9edef50b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:32.873874 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-809b8a69-88c6-42f0-8f50-9c8e9edef50b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:32.874302 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-809b8a69-88c6-42f0-8f50-9c8e9edef50b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:32.904635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-809b8a69-88c6-42f0-8f50-9c8e9edef50b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045480 Jul 26 07:32:32.905187 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 387/823] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:32 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:33.042256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-26b2558a-f75a-4b30-b7ea-07cb450852c1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:33.044341 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-26b2558a-f75a-4b30-b7ea-07cb450852c1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:33.051336 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-26b2558a-f75a-4b30-b7ea-07cb450852c1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:33.051785 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-26b2558a-f75a-4b30-b7ea-07cb450852c1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:33.052548 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-26b2558a-f75a-4b30-b7ea-07cb450852c1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:33.052970 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-26b2558a-f75a-4b30-b7ea-07cb450852c1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:33.083153 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-26b2558a-f75a-4b30-b7ea-07cb450852c1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044947 Jul 26 07:32:33.083975 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 437/824] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:33 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:33.917519 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-30ec2362-0b1e-4e9a-a830-3326946e6be3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:33.919699 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-30ec2362-0b1e-4e9a-a830-3326946e6be3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:33.926682 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-30ec2362-0b1e-4e9a-a830-3326946e6be3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:33.927159 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-30ec2362-0b1e-4e9a-a830-3326946e6be3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:33.927929 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-30ec2362-0b1e-4e9a-a830-3326946e6be3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:33.928359 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-30ec2362-0b1e-4e9a-a830-3326946e6be3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:33.959351 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-30ec2362-0b1e-4e9a-a830-3326946e6be3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045849 Jul 26 07:32:33.959920 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 388/825] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:33 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:34.098553 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3a3dd5be-a2f5-4476-9b5b-afca2a15e614 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:34.100618 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3a3dd5be-a2f5-4476-9b5b-afca2a15e614 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:34.107574 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3a3dd5be-a2f5-4476-9b5b-afca2a15e614 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:34.108016 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3a3dd5be-a2f5-4476-9b5b-afca2a15e614 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:34.108779 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3a3dd5be-a2f5-4476-9b5b-afca2a15e614 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:34.109205 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3a3dd5be-a2f5-4476-9b5b-afca2a15e614 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:34.142299 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3a3dd5be-a2f5-4476-9b5b-afca2a15e614 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049263 Jul 26 07:32:34.142909 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 438/826] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:34 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:34.972362 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-3c4153ed-2618-4cb9-83ae-813d5919f2ff tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:34.974631 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-3c4153ed-2618-4cb9-83ae-813d5919f2ff tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:34.981575 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3c4153ed-2618-4cb9-83ae-813d5919f2ff tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:34.982563 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3c4153ed-2618-4cb9-83ae-813d5919f2ff tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:34.983370 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3c4153ed-2618-4cb9-83ae-813d5919f2ff tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:34.983807 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3c4153ed-2618-4cb9-83ae-813d5919f2ff tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:35.017028 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-3c4153ed-2618-4cb9-83ae-813d5919f2ff tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048771 Jul 26 07:32:35.017630 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 389/827] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:34 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:35.155316 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-39248933-b8af-4fd0-abd1-ee8333b3188d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:35.157622 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-39248933-b8af-4fd0-abd1-ee8333b3188d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:35.165107 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-39248933-b8af-4fd0-abd1-ee8333b3188d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:35.165550 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-39248933-b8af-4fd0-abd1-ee8333b3188d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:35.166408 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-39248933-b8af-4fd0-abd1-ee8333b3188d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:35.166843 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-39248933-b8af-4fd0-abd1-ee8333b3188d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:35.201340 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-39248933-b8af-4fd0-abd1-ee8333b3188d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050039 Jul 26 07:32:35.202204 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 439/828] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:35 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:36.033086 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9d4823fa-9078-47c2-957b-c211c759eda2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:36.036777 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-9d4823fa-9078-47c2-957b-c211c759eda2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:36.040963 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=58 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:32:36.051272 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9d4823fa-9078-47c2-957b-c211c759eda2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:36.052046 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9d4823fa-9078-47c2-957b-c211c759eda2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:36.053438 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9d4823fa-9078-47c2-957b-c211c759eda2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:36.054239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9d4823fa-9078-47c2-957b-c211c759eda2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:36.092220 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-9d4823fa-9078-47c2-957b-c211c759eda2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066420 Jul 26 07:32:36.092851 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 390/829] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:36 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:36.218165 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7e0b7a9a-5e1f-4b95-92da-e12135e6fc34 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:36.220340 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7e0b7a9a-5e1f-4b95-92da-e12135e6fc34 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:36.227701 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7e0b7a9a-5e1f-4b95-92da-e12135e6fc34 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:36.228153 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7e0b7a9a-5e1f-4b95-92da-e12135e6fc34 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:36.228899 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7e0b7a9a-5e1f-4b95-92da-e12135e6fc34 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:36.229357 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7e0b7a9a-5e1f-4b95-92da-e12135e6fc34 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:36.258747 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7e0b7a9a-5e1f-4b95-92da-e12135e6fc34 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045898 Jul 26 07:32:36.259316 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 440/830] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:36 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:37.105076 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a631b101-df10-46b4-9a2e-a8603ab9a3fd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:37.107297 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a631b101-df10-46b4-9a2e-a8603ab9a3fd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:37.114134 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a631b101-df10-46b4-9a2e-a8603ab9a3fd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:37.114582 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a631b101-df10-46b4-9a2e-a8603ab9a3fd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:37.115354 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a631b101-df10-46b4-9a2e-a8603ab9a3fd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:37.115794 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a631b101-df10-46b4-9a2e-a8603ab9a3fd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:37.150891 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a631b101-df10-46b4-9a2e-a8603ab9a3fd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049757 Jul 26 07:32:37.151485 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 391/831] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:37 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:37.271340 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-bf5412e6-7091-4254-b0bb-1e65e60737ce tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:37.273374 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-bf5412e6-7091-4254-b0bb-1e65e60737ce tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:37.275822 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=58 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:32:37.281585 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bf5412e6-7091-4254-b0bb-1e65e60737ce tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:37.282059 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bf5412e6-7091-4254-b0bb-1e65e60737ce tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:37.282834 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bf5412e6-7091-4254-b0bb-1e65e60737ce tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:37.283261 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bf5412e6-7091-4254-b0bb-1e65e60737ce tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:37.310146 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:32:37.316749 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-bf5412e6-7091-4254-b0bb-1e65e60737ce tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049656 Jul 26 07:32:37.317321 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 441/832] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:37 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:38.163635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-97b1d27d-597d-4035-a9e4-4bd119d8b640 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:38.165819 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-97b1d27d-597d-4035-a9e4-4bd119d8b640 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:38.172560 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-97b1d27d-597d-4035-a9e4-4bd119d8b640 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:38.173000 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-97b1d27d-597d-4035-a9e4-4bd119d8b640 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:38.173803 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-97b1d27d-597d-4035-a9e4-4bd119d8b640 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:38.174241 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-97b1d27d-597d-4035-a9e4-4bd119d8b640 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:38.206362 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-97b1d27d-597d-4035-a9e4-4bd119d8b640 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046470 Jul 26 07:32:38.206923 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 392/833] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:38 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:38.329198 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b870a464-5c82-4e27-8691-ba76bd457843 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:38.331381 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b870a464-5c82-4e27-8691-ba76bd457843 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:38.338987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b870a464-5c82-4e27-8691-ba76bd457843 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:38.339432 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b870a464-5c82-4e27-8691-ba76bd457843 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:38.340221 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b870a464-5c82-4e27-8691-ba76bd457843 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:38.340642 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b870a464-5c82-4e27-8691-ba76bd457843 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:38.374514 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b870a464-5c82-4e27-8691-ba76bd457843 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049377 Jul 26 07:32:38.375091 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 442/834] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:38 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:39.224031 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-52fe6c37-137e-4d0e-bb14-5ba296d6aa5d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:39.227885 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-52fe6c37-137e-4d0e-bb14-5ba296d6aa5d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:39.239045 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-52fe6c37-137e-4d0e-bb14-5ba296d6aa5d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:39.239872 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-52fe6c37-137e-4d0e-bb14-5ba296d6aa5d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:39.241257 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-52fe6c37-137e-4d0e-bb14-5ba296d6aa5d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:39.242104 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-52fe6c37-137e-4d0e-bb14-5ba296d6aa5d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:39.276338 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-52fe6c37-137e-4d0e-bb14-5ba296d6aa5d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060335 Jul 26 07:32:39.276952 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 393/835] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:39 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:39.389916 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-23d01158-3804-448a-99ac-cbbefc87d33e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:39.392191 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-23d01158-3804-448a-99ac-cbbefc87d33e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:39.399050 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-23d01158-3804-448a-99ac-cbbefc87d33e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:39.399500 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-23d01158-3804-448a-99ac-cbbefc87d33e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:39.400306 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-23d01158-3804-448a-99ac-cbbefc87d33e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:39.400713 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-23d01158-3804-448a-99ac-cbbefc87d33e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:39.432066 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-23d01158-3804-448a-99ac-cbbefc87d33e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047385 Jul 26 07:32:39.432560 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 443/836] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:39 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:40.291063 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6f946177-5112-4c9d-9ad5-5732a17435d9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:40.293397 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6f946177-5112-4c9d-9ad5-5732a17435d9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:40.300544 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6f946177-5112-4c9d-9ad5-5732a17435d9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:40.301066 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6f946177-5112-4c9d-9ad5-5732a17435d9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:40.301875 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6f946177-5112-4c9d-9ad5-5732a17435d9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:40.302305 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6f946177-5112-4c9d-9ad5-5732a17435d9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:40.332839 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6f946177-5112-4c9d-9ad5-5732a17435d9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046628 Jul 26 07:32:40.333388 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 394/837] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:40 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:40.444970 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3cdbdf62-3165-41fa-8588-ae0a72361939 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:40.447208 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3cdbdf62-3165-41fa-8588-ae0a72361939 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:40.454471 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3cdbdf62-3165-41fa-8588-ae0a72361939 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:40.454920 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3cdbdf62-3165-41fa-8588-ae0a72361939 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:40.455755 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3cdbdf62-3165-41fa-8588-ae0a72361939 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:40.456128 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3cdbdf62-3165-41fa-8588-ae0a72361939 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:40.489805 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3cdbdf62-3165-41fa-8588-ae0a72361939 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048876 Jul 26 07:32:40.490413 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 444/838] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:40 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:41.345477 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-3ee15ce6-139f-45a3-8a38-178b5a8ebd99 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:41.347685 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-3ee15ce6-139f-45a3-8a38-178b5a8ebd99 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:41.354914 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3ee15ce6-139f-45a3-8a38-178b5a8ebd99 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:41.355383 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3ee15ce6-139f-45a3-8a38-178b5a8ebd99 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:41.356160 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3ee15ce6-139f-45a3-8a38-178b5a8ebd99 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:41.356576 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3ee15ce6-139f-45a3-8a38-178b5a8ebd99 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:41.389060 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-3ee15ce6-139f-45a3-8a38-178b5a8ebd99 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047965 Jul 26 07:32:41.389669 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 395/839] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:41 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:41.503261 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-deb6f04a-a756-4f72-8135-aa2ebf8c0cc4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:41.505512 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-deb6f04a-a756-4f72-8135-aa2ebf8c0cc4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:41.513292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-deb6f04a-a756-4f72-8135-aa2ebf8c0cc4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:41.513590 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-deb6f04a-a756-4f72-8135-aa2ebf8c0cc4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:41.514422 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-deb6f04a-a756-4f72-8135-aa2ebf8c0cc4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:41.514867 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-deb6f04a-a756-4f72-8135-aa2ebf8c0cc4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:41.550013 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-deb6f04a-a756-4f72-8135-aa2ebf8c0cc4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050474 Jul 26 07:32:41.550801 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 445/840] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:41 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:42.402780 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8542040c-dc99-409a-812c-7b501a07975f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:42.404907 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8542040c-dc99-409a-812c-7b501a07975f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:42.412961 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8542040c-dc99-409a-812c-7b501a07975f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:42.413405 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8542040c-dc99-409a-812c-7b501a07975f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:42.414204 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8542040c-dc99-409a-812c-7b501a07975f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:42.414627 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8542040c-dc99-409a-812c-7b501a07975f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:42.429201 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:32:42.446830 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8542040c-dc99-409a-812c-7b501a07975f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048534 Jul 26 07:32:42.447437 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 396/841] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:42 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:42.562733 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c8962264-5f15-4800-98fa-183f5d00ed6d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:42.564952 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c8962264-5f15-4800-98fa-183f5d00ed6d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:42.572029 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c8962264-5f15-4800-98fa-183f5d00ed6d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:42.572685 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c8962264-5f15-4800-98fa-183f5d00ed6d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:42.573492 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c8962264-5f15-4800-98fa-183f5d00ed6d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:42.573967 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c8962264-5f15-4800-98fa-183f5d00ed6d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:42.609374 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c8962264-5f15-4800-98fa-183f5d00ed6d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050612 Jul 26 07:32:42.610078 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 446/842] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:42 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:43.461814 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d3bf9532-c777-4a7e-9eb0-e8a5b05b3a39 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:43.464108 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d3bf9532-c777-4a7e-9eb0-e8a5b05b3a39 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:43.471540 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d3bf9532-c777-4a7e-9eb0-e8a5b05b3a39 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:43.471983 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d3bf9532-c777-4a7e-9eb0-e8a5b05b3a39 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:43.472775 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d3bf9532-c777-4a7e-9eb0-e8a5b05b3a39 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:43.473221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d3bf9532-c777-4a7e-9eb0-e8a5b05b3a39 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:43.506366 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d3bf9532-c777-4a7e-9eb0-e8a5b05b3a39 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049809 Jul 26 07:32:43.506971 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 397/843] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:43 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:43.625661 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-44d5f477-1806-411f-afe9-daca99f4cc38 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:43.628896 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-44d5f477-1806-411f-afe9-daca99f4cc38 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:43.640286 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-44d5f477-1806-411f-afe9-daca99f4cc38 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:43.640952 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-44d5f477-1806-411f-afe9-daca99f4cc38 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:43.642362 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-44d5f477-1806-411f-afe9-daca99f4cc38 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:43.643054 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-44d5f477-1806-411f-afe9-daca99f4cc38 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:43.698216 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-44d5f477-1806-411f-afe9-daca99f4cc38 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077584 Jul 26 07:32:43.699251 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 447/844] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:43 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:44.518640 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8b090d41-9e14-4ebb-a5e7-76e5eb502bed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:44.520913 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8b090d41-9e14-4ebb-a5e7-76e5eb502bed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:44.528007 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8b090d41-9e14-4ebb-a5e7-76e5eb502bed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:44.528457 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8b090d41-9e14-4ebb-a5e7-76e5eb502bed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:44.529248 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8b090d41-9e14-4ebb-a5e7-76e5eb502bed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:44.529688 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8b090d41-9e14-4ebb-a5e7-76e5eb502bed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:44.562698 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8b090d41-9e14-4ebb-a5e7-76e5eb502bed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048118 Jul 26 07:32:44.563272 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 398/845] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:44 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:44.715045 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-49872efe-dee1-48bb-a2ee-af89050a8b09 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:44.717593 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-49872efe-dee1-48bb-a2ee-af89050a8b09 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:44.724768 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-49872efe-dee1-48bb-a2ee-af89050a8b09 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:44.725214 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-49872efe-dee1-48bb-a2ee-af89050a8b09 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:44.726035 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-49872efe-dee1-48bb-a2ee-af89050a8b09 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:44.726465 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-49872efe-dee1-48bb-a2ee-af89050a8b09 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:44.758999 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-49872efe-dee1-48bb-a2ee-af89050a8b09 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047935 Jul 26 07:32:44.759323 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 448/846] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:44 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:45.576186 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-5f9ded9a-2081-4fc9-bd64-17b8cc109f38 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:45.578398 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-5f9ded9a-2081-4fc9-bd64-17b8cc109f38 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:45.585023 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5f9ded9a-2081-4fc9-bd64-17b8cc109f38 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:45.585466 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5f9ded9a-2081-4fc9-bd64-17b8cc109f38 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:45.586283 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5f9ded9a-2081-4fc9-bd64-17b8cc109f38 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:45.586732 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5f9ded9a-2081-4fc9-bd64-17b8cc109f38 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:45.621083 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-5f9ded9a-2081-4fc9-bd64-17b8cc109f38 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049065 Jul 26 07:32:45.621655 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 399/847] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:45 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:45.771944 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e9fb07ff-0748-48d9-9e54-fb8674739fa8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:45.774158 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e9fb07ff-0748-48d9-9e54-fb8674739fa8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:45.781032 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e9fb07ff-0748-48d9-9e54-fb8674739fa8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:45.781474 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e9fb07ff-0748-48d9-9e54-fb8674739fa8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:45.782282 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e9fb07ff-0748-48d9-9e54-fb8674739fa8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:45.782699 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e9fb07ff-0748-48d9-9e54-fb8674739fa8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:45.816986 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e9fb07ff-0748-48d9-9e54-fb8674739fa8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049031 Jul 26 07:32:45.817584 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 449/848] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:45 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:46.633717 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-dfd128c7-369e-4e30-9c02-585a398f2e8e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:46.636094 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-dfd128c7-369e-4e30-9c02-585a398f2e8e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:46.642781 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dfd128c7-369e-4e30-9c02-585a398f2e8e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:46.643209 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dfd128c7-369e-4e30-9c02-585a398f2e8e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:46.643974 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dfd128c7-369e-4e30-9c02-585a398f2e8e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:46.644395 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dfd128c7-369e-4e30-9c02-585a398f2e8e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:46.676703 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-dfd128c7-369e-4e30-9c02-585a398f2e8e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046981 Jul 26 07:32:46.677256 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 400/849] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:46 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:46.830394 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-0fccdba6-6af4-49f9-98d4-333f9d00126a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:46.832455 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-0fccdba6-6af4-49f9-98d4-333f9d00126a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:46.844273 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0fccdba6-6af4-49f9-98d4-333f9d00126a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:46.844804 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0fccdba6-6af4-49f9-98d4-333f9d00126a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:46.845971 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0fccdba6-6af4-49f9-98d4-333f9d00126a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:46.846505 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0fccdba6-6af4-49f9-98d4-333f9d00126a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:46.880597 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-0fccdba6-6af4-49f9-98d4-333f9d00126a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054348 Jul 26 07:32:46.881506 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 450/850] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:46 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:47.689454 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c5ce4e23-c25a-4e41-b9b3-369309ded00a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:47.691722 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c5ce4e23-c25a-4e41-b9b3-369309ded00a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:47.698683 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c5ce4e23-c25a-4e41-b9b3-369309ded00a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:47.699137 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c5ce4e23-c25a-4e41-b9b3-369309ded00a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:47.699910 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c5ce4e23-c25a-4e41-b9b3-369309ded00a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:47.700347 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c5ce4e23-c25a-4e41-b9b3-369309ded00a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:47.733665 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c5ce4e23-c25a-4e41-b9b3-369309ded00a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048256 Jul 26 07:32:47.734261 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 401/851] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:47 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:47.896099 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-417e1548-054b-4dc7-a0f9-2a05ba925123 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:47.900678 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-417e1548-054b-4dc7-a0f9-2a05ba925123 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:47.905537 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-417e1548-054b-4dc7-a0f9-2a05ba925123 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:47.906017 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-417e1548-054b-4dc7-a0f9-2a05ba925123 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:47.906833 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-417e1548-054b-4dc7-a0f9-2a05ba925123 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:47.907269 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-417e1548-054b-4dc7-a0f9-2a05ba925123 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:47.939585 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-417e1548-054b-4dc7-a0f9-2a05ba925123 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048872 Jul 26 07:32:47.940167 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 451/852] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:47 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:48.746470 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-55348783-7f38-4c0e-a32f-07a21187a557 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:48.748675 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-55348783-7f38-4c0e-a32f-07a21187a557 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:48.756019 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-55348783-7f38-4c0e-a32f-07a21187a557 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:48.756463 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-55348783-7f38-4c0e-a32f-07a21187a557 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:48.757238 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-55348783-7f38-4c0e-a32f-07a21187a557 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:48.757670 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-55348783-7f38-4c0e-a32f-07a21187a557 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:48.789459 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-55348783-7f38-4c0e-a32f-07a21187a557 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046961 Jul 26 07:32:48.790046 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 402/853] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:48 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:48.952696 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d0e96e09-8d92-4dfe-a339-952afb3ac3b1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:48.954829 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d0e96e09-8d92-4dfe-a339-952afb3ac3b1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:48.962065 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d0e96e09-8d92-4dfe-a339-952afb3ac3b1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:48.962508 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d0e96e09-8d92-4dfe-a339-952afb3ac3b1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:48.963268 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d0e96e09-8d92-4dfe-a339-952afb3ac3b1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:48.963695 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d0e96e09-8d92-4dfe-a339-952afb3ac3b1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:48.995006 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d0e96e09-8d92-4dfe-a339-952afb3ac3b1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046479 Jul 26 07:32:48.995570 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 452/854] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:48 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:49.807568 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-03285a22-7456-4836-a633-f0f3afb0b940 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:49.810901 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-03285a22-7456-4836-a633-f0f3afb0b940 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:49.819397 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-03285a22-7456-4836-a633-f0f3afb0b940 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:49.819855 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-03285a22-7456-4836-a633-f0f3afb0b940 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:49.820611 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-03285a22-7456-4836-a633-f0f3afb0b940 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:49.821046 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-03285a22-7456-4836-a633-f0f3afb0b940 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:49.851260 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-03285a22-7456-4836-a633-f0f3afb0b940 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050232 Jul 26 07:32:49.851814 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 403/855] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:49 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:50.008724 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-084e7fd6-f4fd-4242-bb99-8d915b593cde tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:50.010977 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-084e7fd6-f4fd-4242-bb99-8d915b593cde tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:50.018168 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-084e7fd6-f4fd-4242-bb99-8d915b593cde tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:50.018614 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-084e7fd6-f4fd-4242-bb99-8d915b593cde tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:50.019392 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-084e7fd6-f4fd-4242-bb99-8d915b593cde tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:50.019940 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-084e7fd6-f4fd-4242-bb99-8d915b593cde tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:50.051231 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-084e7fd6-f4fd-4242-bb99-8d915b593cde tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046567 Jul 26 07:32:50.051780 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 453/856] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:50 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:50.863176 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f9bcaa56-5c29-4e12-8641-67ca697ad0b0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:50.865423 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-f9bcaa56-5c29-4e12-8641-67ca697ad0b0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:50.873674 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f9bcaa56-5c29-4e12-8641-67ca697ad0b0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:50.874161 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f9bcaa56-5c29-4e12-8641-67ca697ad0b0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:50.874946 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f9bcaa56-5c29-4e12-8641-67ca697ad0b0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:50.875377 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f9bcaa56-5c29-4e12-8641-67ca697ad0b0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:50.906904 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f9bcaa56-5c29-4e12-8641-67ca697ad0b0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047677 Jul 26 07:32:50.907486 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 404/857] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:50 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:51.064871 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-da9d7ac0-9e73-4eca-988e-ef802bfa953e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:51.067296 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-da9d7ac0-9e73-4eca-988e-ef802bfa953e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:51.074475 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-da9d7ac0-9e73-4eca-988e-ef802bfa953e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:51.074936 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-da9d7ac0-9e73-4eca-988e-ef802bfa953e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:51.075709 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-da9d7ac0-9e73-4eca-988e-ef802bfa953e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:51.076138 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-da9d7ac0-9e73-4eca-988e-ef802bfa953e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:51.107450 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-da9d7ac0-9e73-4eca-988e-ef802bfa953e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046743 Jul 26 07:32:51.108028 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 454/858] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:51 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:51.920582 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8ceb978b-acda-48b7-a7de-905629817eec tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:51.922804 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8ceb978b-acda-48b7-a7de-905629817eec tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:51.930036 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8ceb978b-acda-48b7-a7de-905629817eec tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:51.930519 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8ceb978b-acda-48b7-a7de-905629817eec tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:51.931301 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8ceb978b-acda-48b7-a7de-905629817eec tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:51.931738 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8ceb978b-acda-48b7-a7de-905629817eec tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:51.963675 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8ceb978b-acda-48b7-a7de-905629817eec tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047307 Jul 26 07:32:51.964251 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 405/859] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:51 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:52.121829 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9cf41333-5e40-4eb5-917d-a54f40ca8125 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:52.124721 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-9cf41333-5e40-4eb5-917d-a54f40ca8125 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:52.134633 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9cf41333-5e40-4eb5-917d-a54f40ca8125 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:52.135198 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9cf41333-5e40-4eb5-917d-a54f40ca8125 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:52.136159 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9cf41333-5e40-4eb5-917d-a54f40ca8125 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:52.136607 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9cf41333-5e40-4eb5-917d-a54f40ca8125 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:52.167900 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-9cf41333-5e40-4eb5-917d-a54f40ca8125 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051098 Jul 26 07:32:52.168570 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 455/860] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:52 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:52.976205 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-e8796379-07e6-4242-9458-a297858e7573 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:52.978424 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-e8796379-07e6-4242-9458-a297858e7573 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:52.986618 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e8796379-07e6-4242-9458-a297858e7573 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:52.987063 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e8796379-07e6-4242-9458-a297858e7573 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:52.987834 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e8796379-07e6-4242-9458-a297858e7573 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:52.988272 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e8796379-07e6-4242-9458-a297858e7573 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:53.019298 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-e8796379-07e6-4242-9458-a297858e7573 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047222 Jul 26 07:32:53.019879 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 406/861] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:52 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:53.181296 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-593ed395-fd7a-466b-8fb8-b10d11ba3bcf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:53.183412 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-593ed395-fd7a-466b-8fb8-b10d11ba3bcf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:53.191286 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-593ed395-fd7a-466b-8fb8-b10d11ba3bcf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:53.191988 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-593ed395-fd7a-466b-8fb8-b10d11ba3bcf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:53.192791 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-593ed395-fd7a-466b-8fb8-b10d11ba3bcf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:53.193407 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-593ed395-fd7a-466b-8fb8-b10d11ba3bcf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:53.226670 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-593ed395-fd7a-466b-8fb8-b10d11ba3bcf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049511 Jul 26 07:32:53.227255 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 456/862] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:53 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:54.031916 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-14932962-ee6e-4570-aead-e037c20f4244 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:54.034159 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-14932962-ee6e-4570-aead-e037c20f4244 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:54.044679 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-14932962-ee6e-4570-aead-e037c20f4244 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:54.045118 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-14932962-ee6e-4570-aead-e037c20f4244 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:54.045951 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-14932962-ee6e-4570-aead-e037c20f4244 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:54.046395 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-14932962-ee6e-4570-aead-e037c20f4244 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:54.081250 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-14932962-ee6e-4570-aead-e037c20f4244 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053349 Jul 26 07:32:54.081868 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 407/863] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:54 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:54.241877 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b4d606dc-b21c-41df-81bf-8a2c44e048ad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:54.245461 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b4d606dc-b21c-41df-81bf-8a2c44e048ad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:54.257061 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b4d606dc-b21c-41df-81bf-8a2c44e048ad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:54.257859 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b4d606dc-b21c-41df-81bf-8a2c44e048ad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:54.258662 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b4d606dc-b21c-41df-81bf-8a2c44e048ad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:54.259092 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b4d606dc-b21c-41df-81bf-8a2c44e048ad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:54.292065 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b4d606dc-b21c-41df-81bf-8a2c44e048ad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056395 Jul 26 07:32:54.292645 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 457/864] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:54 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 07:32:55.094725 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6ebf7471-e31c-42c2-9b64-8a3b095d9aac tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:55.096922 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6ebf7471-e31c-42c2-9b64-8a3b095d9aac tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:55.104258 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6ebf7471-e31c-42c2-9b64-8a3b095d9aac tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:55.104701 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6ebf7471-e31c-42c2-9b64-8a3b095d9aac tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:55.105487 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6ebf7471-e31c-42c2-9b64-8a3b095d9aac tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:55.105961 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6ebf7471-e31c-42c2-9b64-8a3b095d9aac tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:55.138059 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6ebf7471-e31c-42c2-9b64-8a3b095d9aac tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047721 Jul 26 07:32:55.138641 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 408/865] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:55 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:55.307782 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-25614625-c929-49bb-8a67-d575f73385ad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:55.309889 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-25614625-c929-49bb-8a67-d575f73385ad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:55.316957 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-25614625-c929-49bb-8a67-d575f73385ad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:55.317402 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-25614625-c929-49bb-8a67-d575f73385ad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:55.318303 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-25614625-c929-49bb-8a67-d575f73385ad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:55.318813 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-25614625-c929-49bb-8a67-d575f73385ad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:55.334540 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:32:55.352645 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-25614625-c929-49bb-8a67-d575f73385ad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049185 Jul 26 07:32:55.353209 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 458/866] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:55 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:56.153645 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-33e1a5ca-b92d-4c37-a0f7-198219fe8db4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:56.155899 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-33e1a5ca-b92d-4c37-a0f7-198219fe8db4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:56.165171 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-33e1a5ca-b92d-4c37-a0f7-198219fe8db4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:56.165601 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-33e1a5ca-b92d-4c37-a0f7-198219fe8db4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:56.166412 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-33e1a5ca-b92d-4c37-a0f7-198219fe8db4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:56.166833 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-33e1a5ca-b92d-4c37-a0f7-198219fe8db4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:56.196724 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-33e1a5ca-b92d-4c37-a0f7-198219fe8db4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048554 Jul 26 07:32:56.197281 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 409/867] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:56 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:56.367816 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8a252327-1557-465d-b95a-d153d5f45fef tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:56.369929 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8a252327-1557-465d-b95a-d153d5f45fef tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:56.376844 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8a252327-1557-465d-b95a-d153d5f45fef tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:56.377300 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8a252327-1557-465d-b95a-d153d5f45fef tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:56.378086 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8a252327-1557-465d-b95a-d153d5f45fef tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:56.378509 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8a252327-1557-465d-b95a-d153d5f45fef tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:56.413657 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8a252327-1557-465d-b95a-d153d5f45fef tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050220 Jul 26 07:32:56.414285 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 459/868] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:56 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:57.208958 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ff081ccf-b69f-4f58-aa3a-7479c9d39eca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:57.211228 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ff081ccf-b69f-4f58-aa3a-7479c9d39eca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:57.218813 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ff081ccf-b69f-4f58-aa3a-7479c9d39eca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:57.219268 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ff081ccf-b69f-4f58-aa3a-7479c9d39eca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:57.220050 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ff081ccf-b69f-4f58-aa3a-7479c9d39eca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:57.220472 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ff081ccf-b69f-4f58-aa3a-7479c9d39eca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:57.252321 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ff081ccf-b69f-4f58-aa3a-7479c9d39eca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047341 Jul 26 07:32:57.253130 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 410/869] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:57 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:57.429063 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-2af5b03b-f236-42f8-b55c-126e1f65e603 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:57.431741 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2af5b03b-f236-42f8-b55c-126e1f65e603 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:57.440363 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2af5b03b-f236-42f8-b55c-126e1f65e603 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:57.441014 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2af5b03b-f236-42f8-b55c-126e1f65e603 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:57.442050 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2af5b03b-f236-42f8-b55c-126e1f65e603 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:57.442791 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2af5b03b-f236-42f8-b55c-126e1f65e603 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:57.473322 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-2af5b03b-f236-42f8-b55c-126e1f65e603 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049988 Jul 26 07:32:57.474153 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 460/870] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:57 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:58.266646 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-e142a7fd-c183-4925-b56a-4d014ab99a11 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:58.269093 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-e142a7fd-c183-4925-b56a-4d014ab99a11 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:58.277203 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e142a7fd-c183-4925-b56a-4d014ab99a11 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:58.277648 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e142a7fd-c183-4925-b56a-4d014ab99a11 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:58.279082 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e142a7fd-c183-4925-b56a-4d014ab99a11 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:58.279681 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e142a7fd-c183-4925-b56a-4d014ab99a11 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:58.313096 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-e142a7fd-c183-4925-b56a-4d014ab99a11 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050957 Jul 26 07:32:58.313663 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 411/871] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:58 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:58.490305 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-71a2d0cc-3bc4-4b23-adf6-24946aee9b26 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:58.493128 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-71a2d0cc-3bc4-4b23-adf6-24946aee9b26 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:58.502085 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-71a2d0cc-3bc4-4b23-adf6-24946aee9b26 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:58.502736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-71a2d0cc-3bc4-4b23-adf6-24946aee9b26 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:58.503990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-71a2d0cc-3bc4-4b23-adf6-24946aee9b26 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:58.504452 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-71a2d0cc-3bc4-4b23-adf6-24946aee9b26 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:58.535881 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-71a2d0cc-3bc4-4b23-adf6-24946aee9b26 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053156 Jul 26 07:32:58.536802 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 461/872] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:58 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:32:59.325767 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-5ceea27f-f589-45a4-86f0-61e7cbf5a3eb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:59.327957 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-5ceea27f-f589-45a4-86f0-61e7cbf5a3eb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:59.334988 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5ceea27f-f589-45a4-86f0-61e7cbf5a3eb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:59.335432 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5ceea27f-f589-45a4-86f0-61e7cbf5a3eb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:59.336188 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5ceea27f-f589-45a4-86f0-61e7cbf5a3eb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:59.336716 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5ceea27f-f589-45a4-86f0-61e7cbf5a3eb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:59.367622 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-5ceea27f-f589-45a4-86f0-61e7cbf5a3eb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045894 Jul 26 07:32:59.368252 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 412/873] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:32:59 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:32:59.551183 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-93c97f67-0f53-47e2-b0f7-46a4a674bcb4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:32:59.554116 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-93c97f67-0f53-47e2-b0f7-46a4a674bcb4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:32:59.561391 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-93c97f67-0f53-47e2-b0f7-46a4a674bcb4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:59.561852 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-93c97f67-0f53-47e2-b0f7-46a4a674bcb4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:59.562604 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-93c97f67-0f53-47e2-b0f7-46a4a674bcb4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:32:59.563029 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-93c97f67-0f53-47e2-b0f7-46a4a674bcb4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:32:59.598929 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-93c97f67-0f53-47e2-b0f7-46a4a674bcb4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053178 Jul 26 07:32:59.599541 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 462/874] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:32:59 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:00.380439 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f9816026-c821-42e1-8f21-8fc47bd75793 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:00.382629 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-f9816026-c821-42e1-8f21-8fc47bd75793 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:00.389421 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f9816026-c821-42e1-8f21-8fc47bd75793 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:00.389912 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f9816026-c821-42e1-8f21-8fc47bd75793 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:00.390658 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f9816026-c821-42e1-8f21-8fc47bd75793 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:00.391086 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f9816026-c821-42e1-8f21-8fc47bd75793 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:00.393442 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:00.423732 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f9816026-c821-42e1-8f21-8fc47bd75793 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047287 Jul 26 07:33:00.424322 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 413/875] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:00 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:00.612548 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d4424c06-dffd-48b7-933c-15c828aaed3c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:00.614817 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d4424c06-dffd-48b7-933c-15c828aaed3c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:00.622750 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d4424c06-dffd-48b7-933c-15c828aaed3c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:00.623202 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d4424c06-dffd-48b7-933c-15c828aaed3c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:00.623964 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d4424c06-dffd-48b7-933c-15c828aaed3c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:00.624375 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d4424c06-dffd-48b7-933c-15c828aaed3c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:00.654620 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d4424c06-dffd-48b7-933c-15c828aaed3c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046140 Jul 26 07:33:00.655209 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 463/876] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:00 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:01.436529 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-191cc2da-94f8-4232-8686-f01687f2420c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:01.438807 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-191cc2da-94f8-4232-8686-f01687f2420c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:01.446149 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-191cc2da-94f8-4232-8686-f01687f2420c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:01.446590 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-191cc2da-94f8-4232-8686-f01687f2420c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:01.447364 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-191cc2da-94f8-4232-8686-f01687f2420c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:01.447790 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-191cc2da-94f8-4232-8686-f01687f2420c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:01.481788 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-191cc2da-94f8-4232-8686-f01687f2420c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049523 Jul 26 07:33:01.482352 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 414/877] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:01 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:01.669892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d2039094-1f4b-4289-a532-edc9ab37c080 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:01.672645 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d2039094-1f4b-4289-a532-edc9ab37c080 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:01.682425 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d2039094-1f4b-4289-a532-edc9ab37c080 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:01.683029 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d2039094-1f4b-4289-a532-edc9ab37c080 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:01.683792 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d2039094-1f4b-4289-a532-edc9ab37c080 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:01.684223 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d2039094-1f4b-4289-a532-edc9ab37c080 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:01.715449 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d2039094-1f4b-4289-a532-edc9ab37c080 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051742 Jul 26 07:33:01.716019 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 464/878] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:01 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:02.495201 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-3d2d6b02-9e5a-4538-a1ad-0fba85577f27 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:02.497343 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-3d2d6b02-9e5a-4538-a1ad-0fba85577f27 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:02.504310 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3d2d6b02-9e5a-4538-a1ad-0fba85577f27 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:02.504728 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3d2d6b02-9e5a-4538-a1ad-0fba85577f27 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:02.505546 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3d2d6b02-9e5a-4538-a1ad-0fba85577f27 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:02.506008 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3d2d6b02-9e5a-4538-a1ad-0fba85577f27 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:02.536438 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-3d2d6b02-9e5a-4538-a1ad-0fba85577f27 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045289 Jul 26 07:33:02.536988 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 415/879] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:02 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:02.729497 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a4aa4c40-280b-4859-9c9d-cb5ef3a8bf02 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:02.731618 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a4aa4c40-280b-4859-9c9d-cb5ef3a8bf02 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:02.738875 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a4aa4c40-280b-4859-9c9d-cb5ef3a8bf02 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:02.739309 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a4aa4c40-280b-4859-9c9d-cb5ef3a8bf02 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:02.740069 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a4aa4c40-280b-4859-9c9d-cb5ef3a8bf02 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:02.740506 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a4aa4c40-280b-4859-9c9d-cb5ef3a8bf02 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:02.773508 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a4aa4c40-280b-4859-9c9d-cb5ef3a8bf02 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048313 Jul 26 07:33:02.774189 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 465/880] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:02 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:03.549693 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9c57807e-9980-4b08-9a7e-3459bff58367 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:03.552114 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-9c57807e-9980-4b08-9a7e-3459bff58367 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:03.559790 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9c57807e-9980-4b08-9a7e-3459bff58367 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:03.560237 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9c57807e-9980-4b08-9a7e-3459bff58367 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:03.561014 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9c57807e-9980-4b08-9a7e-3459bff58367 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:03.561447 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9c57807e-9980-4b08-9a7e-3459bff58367 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:03.592809 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-9c57807e-9980-4b08-9a7e-3459bff58367 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047203 Jul 26 07:33:03.593392 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 416/881] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:03 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:03.787652 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-4c0f2da2-67c2-406b-8484-210785a529cd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:03.789850 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-4c0f2da2-67c2-406b-8484-210785a529cd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:03.797903 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4c0f2da2-67c2-406b-8484-210785a529cd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:03.798347 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4c0f2da2-67c2-406b-8484-210785a529cd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:03.799141 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4c0f2da2-67c2-406b-8484-210785a529cd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:03.799570 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4c0f2da2-67c2-406b-8484-210785a529cd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:03.832389 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-4c0f2da2-67c2-406b-8484-210785a529cd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048708 Jul 26 07:33:03.832962 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 466/882] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:03 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:04.610595 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b0923c39-f7de-4e60-b738-626327008548 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:04.615179 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-b0923c39-f7de-4e60-b738-626327008548 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:04.629858 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b0923c39-f7de-4e60-b738-626327008548 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:04.630580 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b0923c39-f7de-4e60-b738-626327008548 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:04.631886 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b0923c39-f7de-4e60-b738-626327008548 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:04.632642 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b0923c39-f7de-4e60-b738-626327008548 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:04.676562 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b0923c39-f7de-4e60-b738-626327008548 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074078 Jul 26 07:33:04.677155 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 417/883] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:04 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:04.846241 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-0a9d757e-28d0-41d7-86fc-84085bb73b58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:04.848510 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-0a9d757e-28d0-41d7-86fc-84085bb73b58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:04.856505 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0a9d757e-28d0-41d7-86fc-84085bb73b58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:04.856951 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0a9d757e-28d0-41d7-86fc-84085bb73b58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:04.857770 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0a9d757e-28d0-41d7-86fc-84085bb73b58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:04.858208 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0a9d757e-28d0-41d7-86fc-84085bb73b58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:04.892810 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-0a9d757e-28d0-41d7-86fc-84085bb73b58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051145 Jul 26 07:33:04.893408 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 467/884] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:04 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:05.689959 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-070a6e8a-57ec-4b78-a832-d86654b6e903 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:05.692182 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-070a6e8a-57ec-4b78-a832-d86654b6e903 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:05.699252 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-070a6e8a-57ec-4b78-a832-d86654b6e903 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:05.699701 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-070a6e8a-57ec-4b78-a832-d86654b6e903 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:05.700481 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-070a6e8a-57ec-4b78-a832-d86654b6e903 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:05.700915 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-070a6e8a-57ec-4b78-a832-d86654b6e903 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:05.736555 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-070a6e8a-57ec-4b78-a832-d86654b6e903 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050608 Jul 26 07:33:05.737139 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 418/885] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:05 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:05.906161 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a7734908-3605-4069-8c51-10de7b4403d6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:05.908320 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a7734908-3605-4069-8c51-10de7b4403d6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:05.916276 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a7734908-3605-4069-8c51-10de7b4403d6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:05.916766 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a7734908-3605-4069-8c51-10de7b4403d6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:05.917834 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a7734908-3605-4069-8c51-10de7b4403d6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:05.918323 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a7734908-3605-4069-8c51-10de7b4403d6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:05.952591 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a7734908-3605-4069-8c51-10de7b4403d6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050718 Jul 26 07:33:05.953272 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 468/886] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:05 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:06.749545 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-4b1e9593-9f3a-41ac-8662-a85e9f619bf3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:06.751736 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-4b1e9593-9f3a-41ac-8662-a85e9f619bf3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:06.754205 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=58 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:06.760058 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4b1e9593-9f3a-41ac-8662-a85e9f619bf3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:06.760530 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4b1e9593-9f3a-41ac-8662-a85e9f619bf3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:06.761396 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4b1e9593-9f3a-41ac-8662-a85e9f619bf3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:06.761854 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4b1e9593-9f3a-41ac-8662-a85e9f619bf3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:06.794938 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-4b1e9593-9f3a-41ac-8662-a85e9f619bf3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049498 Jul 26 07:33:06.795499 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 419/887] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:06 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:06.967535 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-5874bd80-3e35-4980-a21b-983be4b23b18 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:06.969611 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-5874bd80-3e35-4980-a21b-983be4b23b18 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:06.977604 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5874bd80-3e35-4980-a21b-983be4b23b18 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:06.978089 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5874bd80-3e35-4980-a21b-983be4b23b18 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:06.978857 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5874bd80-3e35-4980-a21b-983be4b23b18 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:06.979297 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5874bd80-3e35-4980-a21b-983be4b23b18 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:07.012007 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-5874bd80-3e35-4980-a21b-983be4b23b18 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048900 Jul 26 07:33:07.012606 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 469/888] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:06 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:07.808952 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-94f0a4f3-a04a-4aab-abb1-99ac59537b51 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:07.811231 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-94f0a4f3-a04a-4aab-abb1-99ac59537b51 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:07.820722 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-94f0a4f3-a04a-4aab-abb1-99ac59537b51 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:07.821241 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-94f0a4f3-a04a-4aab-abb1-99ac59537b51 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:07.822399 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-94f0a4f3-a04a-4aab-abb1-99ac59537b51 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:07.822976 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-94f0a4f3-a04a-4aab-abb1-99ac59537b51 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:07.855222 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-94f0a4f3-a04a-4aab-abb1-99ac59537b51 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051271 Jul 26 07:33:07.855776 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 420/889] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:07 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:08.025299 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8d27a876-ce9f-4ae8-a228-f8fc790aeb78 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:08.027665 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8d27a876-ce9f-4ae8-a228-f8fc790aeb78 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:08.030232 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=58 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:08.036210 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8d27a876-ce9f-4ae8-a228-f8fc790aeb78 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:08.036650 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8d27a876-ce9f-4ae8-a228-f8fc790aeb78 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:08.037418 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8d27a876-ce9f-4ae8-a228-f8fc790aeb78 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:08.037875 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8d27a876-ce9f-4ae8-a228-f8fc790aeb78 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:08.075330 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8d27a876-ce9f-4ae8-a228-f8fc790aeb78 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054154 Jul 26 07:33:08.075911 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 470/890] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:08 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:08.869361 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2dc0df95-6950-442f-95ab-e4a7a1d90e00 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:08.871670 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2dc0df95-6950-442f-95ab-e4a7a1d90e00 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:08.878461 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2dc0df95-6950-442f-95ab-e4a7a1d90e00 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:08.878897 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2dc0df95-6950-442f-95ab-e4a7a1d90e00 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:08.879675 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2dc0df95-6950-442f-95ab-e4a7a1d90e00 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:08.880107 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2dc0df95-6950-442f-95ab-e4a7a1d90e00 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:08.910838 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2dc0df95-6950-442f-95ab-e4a7a1d90e00 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046768 Jul 26 07:33:08.911480 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 421/891] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:08 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:09.090725 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b004cf0c-7478-45d3-9295-715bbcc88bd7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:09.093198 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b004cf0c-7478-45d3-9295-715bbcc88bd7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:09.100198 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b004cf0c-7478-45d3-9295-715bbcc88bd7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:09.100648 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b004cf0c-7478-45d3-9295-715bbcc88bd7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:09.101420 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b004cf0c-7478-45d3-9295-715bbcc88bd7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:09.101881 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b004cf0c-7478-45d3-9295-715bbcc88bd7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:09.132518 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b004cf0c-7478-45d3-9295-715bbcc88bd7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045937 Jul 26 07:33:09.133088 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 471/892] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:09 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:09.923486 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-57c17880-ff00-40f0-b0ba-0362a92dfbb6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:09.925660 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-57c17880-ff00-40f0-b0ba-0362a92dfbb6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:09.932588 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-57c17880-ff00-40f0-b0ba-0362a92dfbb6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:09.933038 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-57c17880-ff00-40f0-b0ba-0362a92dfbb6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:09.933859 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-57c17880-ff00-40f0-b0ba-0362a92dfbb6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:09.934584 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-57c17880-ff00-40f0-b0ba-0362a92dfbb6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:09.965418 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-57c17880-ff00-40f0-b0ba-0362a92dfbb6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045926 Jul 26 07:33:09.966030 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 422/893] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:09 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:10.146098 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-1ef9703a-b12c-4f6c-9c6b-77f145ff7181 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:10.148169 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-1ef9703a-b12c-4f6c-9c6b-77f145ff7181 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:10.155313 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1ef9703a-b12c-4f6c-9c6b-77f145ff7181 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:10.155765 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1ef9703a-b12c-4f6c-9c6b-77f145ff7181 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:10.156536 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1ef9703a-b12c-4f6c-9c6b-77f145ff7181 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:10.156971 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1ef9703a-b12c-4f6c-9c6b-77f145ff7181 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:10.187012 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-1ef9703a-b12c-4f6c-9c6b-77f145ff7181 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045111 Jul 26 07:33:10.187585 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 472/894] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:10 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:10.978905 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a40c7132-be92-46aa-8957-c253482fd8e4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:10.981160 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a40c7132-be92-46aa-8957-c253482fd8e4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:10.988184 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a40c7132-be92-46aa-8957-c253482fd8e4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:10.988625 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a40c7132-be92-46aa-8957-c253482fd8e4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:10.989414 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a40c7132-be92-46aa-8957-c253482fd8e4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:10.989886 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a40c7132-be92-46aa-8957-c253482fd8e4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:11.022410 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a40c7132-be92-46aa-8957-c253482fd8e4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047614 Jul 26 07:33:11.022999 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 423/895] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:10 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:11.200113 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-74518879-a338-411a-8a3b-8e639f0b4006 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:11.202332 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-74518879-a338-411a-8a3b-8e639f0b4006 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:11.209675 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-74518879-a338-411a-8a3b-8e639f0b4006 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:11.210156 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-74518879-a338-411a-8a3b-8e639f0b4006 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:11.210932 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-74518879-a338-411a-8a3b-8e639f0b4006 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:11.211344 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-74518879-a338-411a-8a3b-8e639f0b4006 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:11.243578 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-74518879-a338-411a-8a3b-8e639f0b4006 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047666 Jul 26 07:33:11.244153 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 473/896] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:11 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:12.035743 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-614b2377-f35d-466c-9b42-bcfb50402ccb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:12.038033 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-614b2377-f35d-466c-9b42-bcfb50402ccb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:12.045000 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-614b2377-f35d-466c-9b42-bcfb50402ccb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:12.045451 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-614b2377-f35d-466c-9b42-bcfb50402ccb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:12.046281 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-614b2377-f35d-466c-9b42-bcfb50402ccb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:12.046721 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-614b2377-f35d-466c-9b42-bcfb50402ccb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:12.079282 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-614b2377-f35d-466c-9b42-bcfb50402ccb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047598 Jul 26 07:33:12.079869 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 424/897] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:12 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:12.256616 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-073dcbd5-7af0-4c88-b664-4614cb54b41e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:12.258869 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-073dcbd5-7af0-4c88-b664-4614cb54b41e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:12.266515 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-073dcbd5-7af0-4c88-b664-4614cb54b41e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:12.267307 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-073dcbd5-7af0-4c88-b664-4614cb54b41e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:12.268604 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-073dcbd5-7af0-4c88-b664-4614cb54b41e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:12.269372 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-073dcbd5-7af0-4c88-b664-4614cb54b41e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:12.302400 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-073dcbd5-7af0-4c88-b664-4614cb54b41e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049934 Jul 26 07:33:12.302983 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 474/898] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:12 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:13.093090 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-42897ffb-5db1-4a09-8ce6-fb034648921f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:13.095382 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-42897ffb-5db1-4a09-8ce6-fb034648921f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:13.102773 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-42897ffb-5db1-4a09-8ce6-fb034648921f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:13.103220 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-42897ffb-5db1-4a09-8ce6-fb034648921f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:13.104014 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-42897ffb-5db1-4a09-8ce6-fb034648921f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:13.104451 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-42897ffb-5db1-4a09-8ce6-fb034648921f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:13.138159 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-42897ffb-5db1-4a09-8ce6-fb034648921f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049454 Jul 26 07:33:13.138747 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 425/899] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:13 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:13.315954 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6499866f-1aa2-48ce-9460-e930a9b215d2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:13.318374 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-6499866f-1aa2-48ce-9460-e930a9b215d2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:13.325654 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6499866f-1aa2-48ce-9460-e930a9b215d2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:13.326122 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6499866f-1aa2-48ce-9460-e930a9b215d2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:13.326903 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6499866f-1aa2-48ce-9460-e930a9b215d2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:13.327336 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6499866f-1aa2-48ce-9460-e930a9b215d2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:13.330214 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:13.361971 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6499866f-1aa2-48ce-9460-e930a9b215d2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050170 Jul 26 07:33:13.362562 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 475/900] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:13 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:14.157669 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a699d7cc-b032-4b06-865e-49ba2290a6b3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:14.161425 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a699d7cc-b032-4b06-865e-49ba2290a6b3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:14.172858 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a699d7cc-b032-4b06-865e-49ba2290a6b3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:14.173661 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a699d7cc-b032-4b06-865e-49ba2290a6b3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:14.175054 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a699d7cc-b032-4b06-865e-49ba2290a6b3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:14.175855 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a699d7cc-b032-4b06-865e-49ba2290a6b3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:14.218316 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a699d7cc-b032-4b06-865e-49ba2290a6b3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068156 Jul 26 07:33:14.218912 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 426/901] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:14 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:14.379485 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b42b5d9b-2754-4c09-bf34-42322302cee3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:14.381731 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b42b5d9b-2754-4c09-bf34-42322302cee3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:14.389359 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b42b5d9b-2754-4c09-bf34-42322302cee3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:14.389808 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b42b5d9b-2754-4c09-bf34-42322302cee3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:14.390601 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b42b5d9b-2754-4c09-bf34-42322302cee3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:14.391055 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b42b5d9b-2754-4c09-bf34-42322302cee3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:14.427213 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b42b5d9b-2754-4c09-bf34-42322302cee3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051820 Jul 26 07:33:14.428151 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 476/902] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:14 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:15.231858 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7f8cc6a8-3c7e-4f2c-b417-cedee162fdc3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:15.234076 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7f8cc6a8-3c7e-4f2c-b417-cedee162fdc3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:15.240943 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7f8cc6a8-3c7e-4f2c-b417-cedee162fdc3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:15.241384 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7f8cc6a8-3c7e-4f2c-b417-cedee162fdc3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:15.242205 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7f8cc6a8-3c7e-4f2c-b417-cedee162fdc3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:15.242667 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7f8cc6a8-3c7e-4f2c-b417-cedee162fdc3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:15.273716 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7f8cc6a8-3c7e-4f2c-b417-cedee162fdc3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045983 Jul 26 07:33:15.274306 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 427/903] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:15 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:15.442081 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9acbc58b-3924-4a91-8d6b-64ba2065e4a7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:15.445104 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-9acbc58b-3924-4a91-8d6b-64ba2065e4a7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:15.453883 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9acbc58b-3924-4a91-8d6b-64ba2065e4a7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:15.454490 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9acbc58b-3924-4a91-8d6b-64ba2065e4a7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:15.455671 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9acbc58b-3924-4a91-8d6b-64ba2065e4a7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:15.456271 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9acbc58b-3924-4a91-8d6b-64ba2065e4a7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:15.514236 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-9acbc58b-3924-4a91-8d6b-64ba2065e4a7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077884 Jul 26 07:33:15.515323 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 477/904] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:15 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:16.290287 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ab712f03-9b00-492d-bfd5-b70aea862742 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:16.293988 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ab712f03-9b00-492d-bfd5-b70aea862742 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:16.304675 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ab712f03-9b00-492d-bfd5-b70aea862742 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:16.305365 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ab712f03-9b00-492d-bfd5-b70aea862742 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:16.306713 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ab712f03-9b00-492d-bfd5-b70aea862742 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:16.307354 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ab712f03-9b00-492d-bfd5-b70aea862742 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:16.345117 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ab712f03-9b00-492d-bfd5-b70aea862742 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061839 Jul 26 07:33:16.345722 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 428/905] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:16 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:16.531102 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3c55abc9-e0f2-48d6-814b-130a849d0b01 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:16.533369 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3c55abc9-e0f2-48d6-814b-130a849d0b01 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:16.540556 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3c55abc9-e0f2-48d6-814b-130a849d0b01 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:16.541022 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3c55abc9-e0f2-48d6-814b-130a849d0b01 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:16.541882 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3c55abc9-e0f2-48d6-814b-130a849d0b01 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:16.542352 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3c55abc9-e0f2-48d6-814b-130a849d0b01 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:16.577647 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3c55abc9-e0f2-48d6-814b-130a849d0b01 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050637 Jul 26 07:33:16.578708 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 478/906] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:16 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:17.359375 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-fc2163a4-bbce-4259-a9f4-37b6f4f0be09 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:17.361544 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-fc2163a4-bbce-4259-a9f4-37b6f4f0be09 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:17.368638 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fc2163a4-bbce-4259-a9f4-37b6f4f0be09 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:17.369086 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fc2163a4-bbce-4259-a9f4-37b6f4f0be09 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:17.369900 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fc2163a4-bbce-4259-a9f4-37b6f4f0be09 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:17.370359 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fc2163a4-bbce-4259-a9f4-37b6f4f0be09 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:17.398593 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:17.406168 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-fc2163a4-bbce-4259-a9f4-37b6f4f0be09 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051599 Jul 26 07:33:17.406759 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 429/907] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:17 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:17.598868 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-4dbd2b42-da78-42d2-ba97-faed42d37835 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:17.601101 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-4dbd2b42-da78-42d2-ba97-faed42d37835 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:17.608229 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4dbd2b42-da78-42d2-ba97-faed42d37835 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:17.608677 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4dbd2b42-da78-42d2-ba97-faed42d37835 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:17.609452 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4dbd2b42-da78-42d2-ba97-faed42d37835 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:17.609917 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4dbd2b42-da78-42d2-ba97-faed42d37835 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:17.642840 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-4dbd2b42-da78-42d2-ba97-faed42d37835 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053333 Jul 26 07:33:17.643425 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 479/908] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:17 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:18.419399 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-08dd33a6-89f9-4175-89a8-ccabb3228b48 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:18.421595 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-08dd33a6-89f9-4175-89a8-ccabb3228b48 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:18.431166 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-08dd33a6-89f9-4175-89a8-ccabb3228b48 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:18.432024 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-08dd33a6-89f9-4175-89a8-ccabb3228b48 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:18.433730 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-08dd33a6-89f9-4175-89a8-ccabb3228b48 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:18.434700 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-08dd33a6-89f9-4175-89a8-ccabb3228b48 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:18.475002 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-08dd33a6-89f9-4175-89a8-ccabb3228b48 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059643 Jul 26 07:33:18.475751 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 430/909] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:18 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:18.656290 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7ceba3ea-fba4-47fe-8f6e-337776cbf1ae tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:18.658515 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7ceba3ea-fba4-47fe-8f6e-337776cbf1ae tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:18.665891 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7ceba3ea-fba4-47fe-8f6e-337776cbf1ae tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:18.666337 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7ceba3ea-fba4-47fe-8f6e-337776cbf1ae tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:18.667126 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7ceba3ea-fba4-47fe-8f6e-337776cbf1ae tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:18.667558 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7ceba3ea-fba4-47fe-8f6e-337776cbf1ae tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:18.700283 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7ceba3ea-fba4-47fe-8f6e-337776cbf1ae tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048245 Jul 26 07:33:18.700876 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 480/910] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:18 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:19.491182 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ec59a762-853b-436b-97bc-53b009063832 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:19.493406 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ec59a762-853b-436b-97bc-53b009063832 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:19.500651 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ec59a762-853b-436b-97bc-53b009063832 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:19.501119 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ec59a762-853b-436b-97bc-53b009063832 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:19.501940 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ec59a762-853b-436b-97bc-53b009063832 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:19.502370 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ec59a762-853b-436b-97bc-53b009063832 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:19.535676 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ec59a762-853b-436b-97bc-53b009063832 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048508 Jul 26 07:33:19.536271 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 431/911] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:19 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:19.713533 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b795dd18-c671-4775-911b-1e102e90a385 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:19.715763 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b795dd18-c671-4775-911b-1e102e90a385 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:19.724033 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b795dd18-c671-4775-911b-1e102e90a385 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:19.724611 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b795dd18-c671-4775-911b-1e102e90a385 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:19.725508 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b795dd18-c671-4775-911b-1e102e90a385 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:19.726121 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b795dd18-c671-4775-911b-1e102e90a385 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:19.760055 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b795dd18-c671-4775-911b-1e102e90a385 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050727 Jul 26 07:33:19.760653 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 481/912] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:19 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:20.548763 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ff818d9d-b93b-4f38-a701-68611d7954f1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:20.551174 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ff818d9d-b93b-4f38-a701-68611d7954f1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:20.561752 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ff818d9d-b93b-4f38-a701-68611d7954f1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:20.562482 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ff818d9d-b93b-4f38-a701-68611d7954f1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:20.563981 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ff818d9d-b93b-4f38-a701-68611d7954f1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:20.564697 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ff818d9d-b93b-4f38-a701-68611d7954f1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:20.615852 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ff818d9d-b93b-4f38-a701-68611d7954f1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071127 Jul 26 07:33:20.616534 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 432/913] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:20 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:20.774821 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9352c85e-d826-46a7-971b-d118926cb36c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:20.777300 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-9352c85e-d826-46a7-971b-d118926cb36c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:20.784571 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9352c85e-d826-46a7-971b-d118926cb36c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:20.785024 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9352c85e-d826-46a7-971b-d118926cb36c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:20.786271 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9352c85e-d826-46a7-971b-d118926cb36c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:20.786648 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9352c85e-d826-46a7-971b-d118926cb36c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:20.825039 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-9352c85e-d826-46a7-971b-d118926cb36c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055774 Jul 26 07:33:20.825638 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 482/914] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:20 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:21.629317 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-05ae88af-e146-49e7-96ef-f4e1026f0961 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:21.631593 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-05ae88af-e146-49e7-96ef-f4e1026f0961 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:21.639484 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-05ae88af-e146-49e7-96ef-f4e1026f0961 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:21.639995 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-05ae88af-e146-49e7-96ef-f4e1026f0961 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:21.640865 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-05ae88af-e146-49e7-96ef-f4e1026f0961 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:21.641348 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-05ae88af-e146-49e7-96ef-f4e1026f0961 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:21.676591 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-05ae88af-e146-49e7-96ef-f4e1026f0961 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051371 Jul 26 07:33:21.677179 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 433/915] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:21 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:21.840469 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ff27f9d1-47a5-4531-98ab-a87dee747033 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:21.843208 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ff27f9d1-47a5-4531-98ab-a87dee747033 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:21.851083 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ff27f9d1-47a5-4531-98ab-a87dee747033 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:21.851526 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ff27f9d1-47a5-4531-98ab-a87dee747033 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:21.852331 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ff27f9d1-47a5-4531-98ab-a87dee747033 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:21.852936 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ff27f9d1-47a5-4531-98ab-a87dee747033 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:21.887101 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ff27f9d1-47a5-4531-98ab-a87dee747033 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051105 Jul 26 07:33:21.887663 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 483/916] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:21 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:22.689700 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-81a2d002-c39a-4706-bc6a-536af0ce740b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:22.692212 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-81a2d002-c39a-4706-bc6a-536af0ce740b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:22.699780 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-81a2d002-c39a-4706-bc6a-536af0ce740b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:22.700239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-81a2d002-c39a-4706-bc6a-536af0ce740b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:22.701106 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-81a2d002-c39a-4706-bc6a-536af0ce740b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:22.701543 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-81a2d002-c39a-4706-bc6a-536af0ce740b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:22.737827 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-81a2d002-c39a-4706-bc6a-536af0ce740b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052240 Jul 26 07:33:22.738432 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 434/917] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:22 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:22.903328 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-eabab430-891f-476e-8396-c47dafafe569 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:22.905485 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-eabab430-891f-476e-8396-c47dafafe569 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:22.912875 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-eabab430-891f-476e-8396-c47dafafe569 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:22.913312 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-eabab430-891f-476e-8396-c47dafafe569 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:22.914136 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-eabab430-891f-476e-8396-c47dafafe569 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:22.914559 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-eabab430-891f-476e-8396-c47dafafe569 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:22.948677 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-eabab430-891f-476e-8396-c47dafafe569 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049689 Jul 26 07:33:22.949306 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 484/918] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:22 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:23.757657 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-36f8f852-6393-4a86-a614-6cec14900bdb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:23.761446 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-36f8f852-6393-4a86-a614-6cec14900bdb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:23.773376 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-36f8f852-6393-4a86-a614-6cec14900bdb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:23.774165 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-36f8f852-6393-4a86-a614-6cec14900bdb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:23.775576 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-36f8f852-6393-4a86-a614-6cec14900bdb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:23.776353 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-36f8f852-6393-4a86-a614-6cec14900bdb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:23.812745 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-36f8f852-6393-4a86-a614-6cec14900bdb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062587 Jul 26 07:33:23.813321 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 435/919] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:23 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:23.962090 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6300abbc-de6c-4600-8a4a-eb5981adc8a1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:23.964301 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-6300abbc-de6c-4600-8a4a-eb5981adc8a1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:23.971879 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6300abbc-de6c-4600-8a4a-eb5981adc8a1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:23.972323 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6300abbc-de6c-4600-8a4a-eb5981adc8a1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:23.973091 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6300abbc-de6c-4600-8a4a-eb5981adc8a1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:23.973517 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6300abbc-de6c-4600-8a4a-eb5981adc8a1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:24.005912 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6300abbc-de6c-4600-8a4a-eb5981adc8a1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048044 Jul 26 07:33:24.006511 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 485/920] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:23 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:24.825046 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d89fe1be-f45f-418d-b662-2d005fd5e365 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:24.827251 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d89fe1be-f45f-418d-b662-2d005fd5e365 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:24.834496 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d89fe1be-f45f-418d-b662-2d005fd5e365 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:24.834945 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d89fe1be-f45f-418d-b662-2d005fd5e365 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:24.835866 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d89fe1be-f45f-418d-b662-2d005fd5e365 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:24.836297 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d89fe1be-f45f-418d-b662-2d005fd5e365 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:24.871327 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d89fe1be-f45f-418d-b662-2d005fd5e365 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050278 Jul 26 07:33:24.871919 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 436/921] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:24 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:25.019450 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-2c699853-eb03-4c40-b665-ad792a47db24 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:25.021769 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2c699853-eb03-4c40-b665-ad792a47db24 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:25.028837 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2c699853-eb03-4c40-b665-ad792a47db24 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:25.029317 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2c699853-eb03-4c40-b665-ad792a47db24 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:25.030133 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2c699853-eb03-4c40-b665-ad792a47db24 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:25.030561 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2c699853-eb03-4c40-b665-ad792a47db24 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:25.063397 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-2c699853-eb03-4c40-b665-ad792a47db24 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048508 Jul 26 07:33:25.063984 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 486/922] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:25 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:25.888051 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f93e40a4-cc32-48b3-84c9-e94d79d427f0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:25.891918 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-f93e40a4-cc32-48b3-84c9-e94d79d427f0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:25.903799 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f93e40a4-cc32-48b3-84c9-e94d79d427f0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:25.904547 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f93e40a4-cc32-48b3-84c9-e94d79d427f0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:25.905939 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f93e40a4-cc32-48b3-84c9-e94d79d427f0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:25.906704 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f93e40a4-cc32-48b3-84c9-e94d79d427f0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:25.962750 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f93e40a4-cc32-48b3-84c9-e94d79d427f0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081643 Jul 26 07:33:25.963629 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 437/923] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:25 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:26.075849 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f7efd164-930b-4f53-8e03-d6bfbb10797c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:26.078029 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f7efd164-930b-4f53-8e03-d6bfbb10797c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:26.084901 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f7efd164-930b-4f53-8e03-d6bfbb10797c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:26.085344 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f7efd164-930b-4f53-8e03-d6bfbb10797c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:26.086163 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f7efd164-930b-4f53-8e03-d6bfbb10797c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:26.086600 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f7efd164-930b-4f53-8e03-d6bfbb10797c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:26.118879 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f7efd164-930b-4f53-8e03-d6bfbb10797c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047062 Jul 26 07:33:26.119477 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 487/924] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:26 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:26.976612 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2c60d362-67a5-444a-9eaa-a3617974657d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:26.979009 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2c60d362-67a5-444a-9eaa-a3617974657d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:26.986812 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2c60d362-67a5-444a-9eaa-a3617974657d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:26.987388 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2c60d362-67a5-444a-9eaa-a3617974657d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:26.988185 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2c60d362-67a5-444a-9eaa-a3617974657d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:26.988616 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2c60d362-67a5-444a-9eaa-a3617974657d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:27.023440 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2c60d362-67a5-444a-9eaa-a3617974657d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050925 Jul 26 07:33:27.024024 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 438/925] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:26 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:27.132010 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f212806e-1fa9-4960-8757-c94fd4bcf233 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:27.134331 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f212806e-1fa9-4960-8757-c94fd4bcf233 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:27.142266 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f212806e-1fa9-4960-8757-c94fd4bcf233 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:27.142723 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f212806e-1fa9-4960-8757-c94fd4bcf233 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:27.143525 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f212806e-1fa9-4960-8757-c94fd4bcf233 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:27.143959 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f212806e-1fa9-4960-8757-c94fd4bcf233 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:27.177287 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f212806e-1fa9-4960-8757-c94fd4bcf233 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049462 Jul 26 07:33:27.177899 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 488/926] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:27 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:28.041301 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-adc6f505-656c-4cfd-b18f-ac3b65d66e80 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:28.045324 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-adc6f505-656c-4cfd-b18f-ac3b65d66e80 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:28.058426 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-adc6f505-656c-4cfd-b18f-ac3b65d66e80 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:28.059212 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-adc6f505-656c-4cfd-b18f-ac3b65d66e80 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:28.060683 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-adc6f505-656c-4cfd-b18f-ac3b65d66e80 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:28.061465 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-adc6f505-656c-4cfd-b18f-ac3b65d66e80 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:28.116671 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-adc6f505-656c-4cfd-b18f-ac3b65d66e80 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082749 Jul 26 07:33:28.117636 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 439/927] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:28 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:28.196683 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-002e824d-d3af-4ee2-b768-2e408441af38 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:28.200519 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-002e824d-d3af-4ee2-b768-2e408441af38 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:28.213000 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-002e824d-d3af-4ee2-b768-2e408441af38 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:28.213570 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-002e824d-d3af-4ee2-b768-2e408441af38 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:28.214819 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-002e824d-d3af-4ee2-b768-2e408441af38 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:28.215608 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-002e824d-d3af-4ee2-b768-2e408441af38 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:28.250862 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-002e824d-d3af-4ee2-b768-2e408441af38 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062140 Jul 26 07:33:28.251440 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 489/928] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:28 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:29.132684 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-3a15c4c1-050c-4778-aeb4-52b932fd174e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:29.135022 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-3a15c4c1-050c-4778-aeb4-52b932fd174e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:29.142745 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3a15c4c1-050c-4778-aeb4-52b932fd174e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:29.143245 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3a15c4c1-050c-4778-aeb4-52b932fd174e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:29.144061 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3a15c4c1-050c-4778-aeb4-52b932fd174e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:29.144594 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3a15c4c1-050c-4778-aeb4-52b932fd174e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:29.187783 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-3a15c4c1-050c-4778-aeb4-52b932fd174e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059409 Jul 26 07:33:29.188398 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 440/929] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:29 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:29.264270 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-907af807-8ce7-4329-a5fb-2b5121d57c7b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:29.266677 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-907af807-8ce7-4329-a5fb-2b5121d57c7b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:29.274248 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-907af807-8ce7-4329-a5fb-2b5121d57c7b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:29.274690 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-907af807-8ce7-4329-a5fb-2b5121d57c7b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:29.275472 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-907af807-8ce7-4329-a5fb-2b5121d57c7b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:29.275896 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-907af807-8ce7-4329-a5fb-2b5121d57c7b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:29.309302 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-907af807-8ce7-4329-a5fb-2b5121d57c7b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049136 Jul 26 07:33:29.309893 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 490/930] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:29 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:30.204110 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d70ea4d3-779d-4563-b414-5e0c340f2630 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:30.207078 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d70ea4d3-779d-4563-b414-5e0c340f2630 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:30.214393 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d70ea4d3-779d-4563-b414-5e0c340f2630 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:30.214838 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d70ea4d3-779d-4563-b414-5e0c340f2630 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:30.215633 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d70ea4d3-779d-4563-b414-5e0c340f2630 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:30.216070 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d70ea4d3-779d-4563-b414-5e0c340f2630 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:30.259608 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d70ea4d3-779d-4563-b414-5e0c340f2630 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060928 Jul 26 07:33:30.260196 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 441/931] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:30 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:30.322592 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-29853db9-5127-4f60-804f-38af3e36f555 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:30.324990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-29853db9-5127-4f60-804f-38af3e36f555 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:30.331851 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-29853db9-5127-4f60-804f-38af3e36f555 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:30.332287 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-29853db9-5127-4f60-804f-38af3e36f555 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:30.333052 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-29853db9-5127-4f60-804f-38af3e36f555 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:30.333477 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-29853db9-5127-4f60-804f-38af3e36f555 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:30.360542 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:30.367350 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-29853db9-5127-4f60-804f-38af3e36f555 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049082 Jul 26 07:33:30.367939 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 491/932] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:30 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:31.272143 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ab864731-9cca-497b-b250-057ac62a08cc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:31.274396 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ab864731-9cca-497b-b250-057ac62a08cc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:31.282227 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ab864731-9cca-497b-b250-057ac62a08cc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:31.282699 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ab864731-9cca-497b-b250-057ac62a08cc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:31.283663 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ab864731-9cca-497b-b250-057ac62a08cc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:31.284063 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ab864731-9cca-497b-b250-057ac62a08cc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:31.316597 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ab864731-9cca-497b-b250-057ac62a08cc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048558 Jul 26 07:33:31.317190 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 442/933] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:31 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:31.380705 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e19e47cf-cfb9-424d-b6b4-0d980e3a3f00 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:31.382943 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e19e47cf-cfb9-424d-b6b4-0d980e3a3f00 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:31.390341 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e19e47cf-cfb9-424d-b6b4-0d980e3a3f00 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:31.390766 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e19e47cf-cfb9-424d-b6b4-0d980e3a3f00 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:31.391579 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e19e47cf-cfb9-424d-b6b4-0d980e3a3f00 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:31.392011 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e19e47cf-cfb9-424d-b6b4-0d980e3a3f00 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:31.430169 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e19e47cf-cfb9-424d-b6b4-0d980e3a3f00 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053323 Jul 26 07:33:31.431210 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 492/934] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:31 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:32.329258 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6a1cecdb-102b-434a-9290-0d2fee9d95bb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:32.331520 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6a1cecdb-102b-434a-9290-0d2fee9d95bb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:32.339068 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6a1cecdb-102b-434a-9290-0d2fee9d95bb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:32.339492 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6a1cecdb-102b-434a-9290-0d2fee9d95bb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:32.340350 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6a1cecdb-102b-434a-9290-0d2fee9d95bb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:32.340783 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6a1cecdb-102b-434a-9290-0d2fee9d95bb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:32.373037 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6a1cecdb-102b-434a-9290-0d2fee9d95bb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047845 Jul 26 07:33:32.373610 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 443/935] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:32 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:32.446687 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-1f0f8a30-4683-460c-8e46-cc016499057f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:32.448839 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-1f0f8a30-4683-460c-8e46-cc016499057f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:32.456221 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1f0f8a30-4683-460c-8e46-cc016499057f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:32.456657 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1f0f8a30-4683-460c-8e46-cc016499057f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:32.457426 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1f0f8a30-4683-460c-8e46-cc016499057f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:32.457910 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1f0f8a30-4683-460c-8e46-cc016499057f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:32.491181 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-1f0f8a30-4683-460c-8e46-cc016499057f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048598 Jul 26 07:33:32.491768 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 493/936] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:32 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:33.386052 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2e9eadbb-9edb-4a0c-a9e1-64379cc27555 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:33.388283 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2e9eadbb-9edb-4a0c-a9e1-64379cc27555 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:33.395556 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2e9eadbb-9edb-4a0c-a9e1-64379cc27555 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:33.395968 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2e9eadbb-9edb-4a0c-a9e1-64379cc27555 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:33.396746 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2e9eadbb-9edb-4a0c-a9e1-64379cc27555 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:33.397163 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2e9eadbb-9edb-4a0c-a9e1-64379cc27555 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:33.430515 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2e9eadbb-9edb-4a0c-a9e1-64379cc27555 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048649 Jul 26 07:33:33.431108 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 444/937] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:33 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:33.504095 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-fc76e1ec-67d8-45f7-8096-ffc0680cb7e4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:33.506325 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-fc76e1ec-67d8-45f7-8096-ffc0680cb7e4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:33.513218 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fc76e1ec-67d8-45f7-8096-ffc0680cb7e4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:33.513672 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fc76e1ec-67d8-45f7-8096-ffc0680cb7e4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:33.514441 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fc76e1ec-67d8-45f7-8096-ffc0680cb7e4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:33.514866 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fc76e1ec-67d8-45f7-8096-ffc0680cb7e4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:33.548032 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-fc76e1ec-67d8-45f7-8096-ffc0680cb7e4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047790 Jul 26 07:33:33.548600 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 494/938] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:33 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:34.445252 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-cdd7f0aa-4c3a-4549-9a11-13e56502d392 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:34.447516 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-cdd7f0aa-4c3a-4549-9a11-13e56502d392 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:34.454763 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cdd7f0aa-4c3a-4549-9a11-13e56502d392 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:34.455240 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cdd7f0aa-4c3a-4549-9a11-13e56502d392 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:34.456034 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cdd7f0aa-4c3a-4549-9a11-13e56502d392 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:34.456473 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cdd7f0aa-4c3a-4549-9a11-13e56502d392 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:34.490440 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-cdd7f0aa-4c3a-4549-9a11-13e56502d392 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049965 Jul 26 07:33:34.491041 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 445/939] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:34 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:34.561596 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ee9f10df-cbd9-44d7-b229-46c891399206 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:34.564374 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ee9f10df-cbd9-44d7-b229-46c891399206 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:34.571776 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ee9f10df-cbd9-44d7-b229-46c891399206 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:34.572439 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ee9f10df-cbd9-44d7-b229-46c891399206 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:34.573328 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ee9f10df-cbd9-44d7-b229-46c891399206 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:34.573892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ee9f10df-cbd9-44d7-b229-46c891399206 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:34.608026 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ee9f10df-cbd9-44d7-b229-46c891399206 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050482 Jul 26 07:33:34.608550 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 495/940] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:34 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:35.503358 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a316c858-7d47-46f6-9a9a-db38ef842512 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:35.505570 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a316c858-7d47-46f6-9a9a-db38ef842512 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:35.513090 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a316c858-7d47-46f6-9a9a-db38ef842512 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:35.513528 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a316c858-7d47-46f6-9a9a-db38ef842512 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:35.514349 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a316c858-7d47-46f6-9a9a-db38ef842512 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:35.514780 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a316c858-7d47-46f6-9a9a-db38ef842512 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:35.529815 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:35.549474 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a316c858-7d47-46f6-9a9a-db38ef842512 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050093 Jul 26 07:33:35.550087 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 446/941] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:35 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:35.620611 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-88f694a2-7b8e-4dfe-90ea-6f41af6ffe2a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:35.622939 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-88f694a2-7b8e-4dfe-90ea-6f41af6ffe2a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:35.630375 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-88f694a2-7b8e-4dfe-90ea-6f41af6ffe2a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:35.630846 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-88f694a2-7b8e-4dfe-90ea-6f41af6ffe2a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:35.631622 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-88f694a2-7b8e-4dfe-90ea-6f41af6ffe2a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:35.632049 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-88f694a2-7b8e-4dfe-90ea-6f41af6ffe2a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:35.665367 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-88f694a2-7b8e-4dfe-90ea-6f41af6ffe2a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048891 Jul 26 07:33:35.666115 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 496/942] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:35 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:36.562046 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c3da9f9d-d4a0-452c-b533-697969311061 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:36.564332 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c3da9f9d-d4a0-452c-b533-697969311061 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:36.571967 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c3da9f9d-d4a0-452c-b533-697969311061 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:36.572414 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c3da9f9d-d4a0-452c-b533-697969311061 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:36.573209 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c3da9f9d-d4a0-452c-b533-697969311061 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:36.573650 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c3da9f9d-d4a0-452c-b533-697969311061 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:36.608988 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c3da9f9d-d4a0-452c-b533-697969311061 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051039 Jul 26 07:33:36.609874 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 447/943] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:36 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:36.681671 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f00b9e06-56e0-476f-b3df-51c6b88d27e4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:36.683966 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f00b9e06-56e0-476f-b3df-51c6b88d27e4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:36.691708 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f00b9e06-56e0-476f-b3df-51c6b88d27e4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:36.692156 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f00b9e06-56e0-476f-b3df-51c6b88d27e4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:36.692955 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f00b9e06-56e0-476f-b3df-51c6b88d27e4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:36.693400 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f00b9e06-56e0-476f-b3df-51c6b88d27e4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:36.727960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f00b9e06-56e0-476f-b3df-51c6b88d27e4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051042 Jul 26 07:33:36.728546 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 497/944] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:36 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 07:33:37.621983 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-16a9fc78-4e66-4c74-b7dd-165450c0495e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:37.624143 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-16a9fc78-4e66-4c74-b7dd-165450c0495e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:37.626599 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=58 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:37.632451 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-16a9fc78-4e66-4c74-b7dd-165450c0495e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:37.632897 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-16a9fc78-4e66-4c74-b7dd-165450c0495e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:37.633676 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-16a9fc78-4e66-4c74-b7dd-165450c0495e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:37.634137 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-16a9fc78-4e66-4c74-b7dd-165450c0495e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:37.667272 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-16a9fc78-4e66-4c74-b7dd-165450c0495e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049369 Jul 26 07:33:37.668049 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 448/945] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:37 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:37.741169 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-162f73e0-2f9b-486c-bc55-b0a83fadd853 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:37.743295 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-162f73e0-2f9b-486c-bc55-b0a83fadd853 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:37.750834 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-162f73e0-2f9b-486c-bc55-b0a83fadd853 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:37.751271 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-162f73e0-2f9b-486c-bc55-b0a83fadd853 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:37.752045 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-162f73e0-2f9b-486c-bc55-b0a83fadd853 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:37.752472 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-162f73e0-2f9b-486c-bc55-b0a83fadd853 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:37.784567 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-162f73e0-2f9b-486c-bc55-b0a83fadd853 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047575 Jul 26 07:33:37.785165 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 498/946] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:37 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:38.680837 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8374a407-7190-4f78-a6f1-0cb917b68c5e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:38.683268 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8374a407-7190-4f78-a6f1-0cb917b68c5e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:38.690688 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8374a407-7190-4f78-a6f1-0cb917b68c5e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:38.691049 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8374a407-7190-4f78-a6f1-0cb917b68c5e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:38.691831 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8374a407-7190-4f78-a6f1-0cb917b68c5e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:38.692262 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8374a407-7190-4f78-a6f1-0cb917b68c5e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:38.724479 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8374a407-7190-4f78-a6f1-0cb917b68c5e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047642 Jul 26 07:33:38.725063 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 449/947] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:38 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:38.797123 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-5c6578cb-84bd-4863-8c7b-1b80336bb099 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:38.799372 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-5c6578cb-84bd-4863-8c7b-1b80336bb099 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:38.802277 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=58 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:38.808060 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5c6578cb-84bd-4863-8c7b-1b80336bb099 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:38.808500 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5c6578cb-84bd-4863-8c7b-1b80336bb099 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:38.809548 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5c6578cb-84bd-4863-8c7b-1b80336bb099 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:38.810001 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5c6578cb-84bd-4863-8c7b-1b80336bb099 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:38.842363 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-5c6578cb-84bd-4863-8c7b-1b80336bb099 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049191 Jul 26 07:33:38.842938 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 499/948] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:38 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:39.738382 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-014bdae5-6845-4f8c-8971-2f0aad675fa3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:39.740719 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-014bdae5-6845-4f8c-8971-2f0aad675fa3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:39.748234 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-014bdae5-6845-4f8c-8971-2f0aad675fa3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:39.748688 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-014bdae5-6845-4f8c-8971-2f0aad675fa3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:39.749459 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-014bdae5-6845-4f8c-8971-2f0aad675fa3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:39.749947 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-014bdae5-6845-4f8c-8971-2f0aad675fa3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:39.788645 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-014bdae5-6845-4f8c-8971-2f0aad675fa3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054333 Jul 26 07:33:39.789249 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 450/949] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:39 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:39.855643 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-4ceef7b3-c671-4a2f-8d88-feea1d70fd82 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:39.858012 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-4ceef7b3-c671-4a2f-8d88-feea1d70fd82 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:39.865367 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4ceef7b3-c671-4a2f-8d88-feea1d70fd82 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:39.865847 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4ceef7b3-c671-4a2f-8d88-feea1d70fd82 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:39.866628 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4ceef7b3-c671-4a2f-8d88-feea1d70fd82 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:39.867061 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4ceef7b3-c671-4a2f-8d88-feea1d70fd82 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:39.899406 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-4ceef7b3-c671-4a2f-8d88-feea1d70fd82 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047961 Jul 26 07:33:39.899995 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 500/950] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:39 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:40.801778 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-eb4d72ba-2806-4d55-95b7-5ada01faa4c6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:40.804054 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-eb4d72ba-2806-4d55-95b7-5ada01faa4c6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:40.811539 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-eb4d72ba-2806-4d55-95b7-5ada01faa4c6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:40.811991 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-eb4d72ba-2806-4d55-95b7-5ada01faa4c6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:40.812798 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-eb4d72ba-2806-4d55-95b7-5ada01faa4c6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:40.813225 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-eb4d72ba-2806-4d55-95b7-5ada01faa4c6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:40.870538 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-eb4d72ba-2806-4d55-95b7-5ada01faa4c6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072462 Jul 26 07:33:40.871488 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 451/951] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:40 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:40.914866 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-5d0785f7-3b9b-4ddb-8e62-efcd5669e790 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:40.916997 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-5d0785f7-3b9b-4ddb-8e62-efcd5669e790 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:40.924471 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5d0785f7-3b9b-4ddb-8e62-efcd5669e790 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:40.924893 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5d0785f7-3b9b-4ddb-8e62-efcd5669e790 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:40.925702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5d0785f7-3b9b-4ddb-8e62-efcd5669e790 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:40.926172 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5d0785f7-3b9b-4ddb-8e62-efcd5669e790 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:40.960551 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-5d0785f7-3b9b-4ddb-8e62-efcd5669e790 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049957 Jul 26 07:33:40.961131 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 501/952] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:40 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:41.884629 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-bd8eadf0-2ae2-4293-8a20-439128ecf41b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:41.887160 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-bd8eadf0-2ae2-4293-8a20-439128ecf41b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:41.895525 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bd8eadf0-2ae2-4293-8a20-439128ecf41b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:41.896109 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bd8eadf0-2ae2-4293-8a20-439128ecf41b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:41.896938 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bd8eadf0-2ae2-4293-8a20-439128ecf41b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:41.897377 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bd8eadf0-2ae2-4293-8a20-439128ecf41b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:41.936515 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-bd8eadf0-2ae2-4293-8a20-439128ecf41b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056028 Jul 26 07:33:41.937146 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 452/953] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:41 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 07:33:41.974161 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-febd0467-e938-45a1-9682-d38b97028a46 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:41.976460 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-febd0467-e938-45a1-9682-d38b97028a46 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:41.985163 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-febd0467-e938-45a1-9682-d38b97028a46 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:41.985605 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-febd0467-e938-45a1-9682-d38b97028a46 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:41.986420 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-febd0467-e938-45a1-9682-d38b97028a46 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:41.986849 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-febd0467-e938-45a1-9682-d38b97028a46 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:42.019682 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-febd0467-e938-45a1-9682-d38b97028a46 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049966 Jul 26 07:33:42.020235 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 502/954] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:41 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:42.950233 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2a492517-3888-4199-802e-f2b2fe1381be tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:42.952873 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2a492517-3888-4199-802e-f2b2fe1381be tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:42.960888 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2a492517-3888-4199-802e-f2b2fe1381be tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:42.961349 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2a492517-3888-4199-802e-f2b2fe1381be tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:42.962198 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2a492517-3888-4199-802e-f2b2fe1381be tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:42.962626 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2a492517-3888-4199-802e-f2b2fe1381be tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:43.000726 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2a492517-3888-4199-802e-f2b2fe1381be tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055014 Jul 26 07:33:43.001389 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 453/955] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:42 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:43.035902 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-23c8d901-4885-4c31-893c-8f21c2799905 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:43.039704 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-23c8d901-4885-4c31-893c-8f21c2799905 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:43.051917 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-23c8d901-4885-4c31-893c-8f21c2799905 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:43.052704 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-23c8d901-4885-4c31-893c-8f21c2799905 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:43.054141 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-23c8d901-4885-4c31-893c-8f21c2799905 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:43.054921 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-23c8d901-4885-4c31-893c-8f21c2799905 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:43.094730 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-23c8d901-4885-4c31-893c-8f21c2799905 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065492 Jul 26 07:33:43.095318 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 503/956] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:43 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:44.013202 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-164fc803-cc76-45d6-bfb7-6ae8e5655f96 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:44.015514 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-164fc803-cc76-45d6-bfb7-6ae8e5655f96 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:44.023220 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-164fc803-cc76-45d6-bfb7-6ae8e5655f96 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:44.023895 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-164fc803-cc76-45d6-bfb7-6ae8e5655f96 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:44.024749 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-164fc803-cc76-45d6-bfb7-6ae8e5655f96 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:44.025294 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-164fc803-cc76-45d6-bfb7-6ae8e5655f96 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:44.058862 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-164fc803-cc76-45d6-bfb7-6ae8e5655f96 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049748 Jul 26 07:33:44.059503 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 454/957] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:44 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:44.111522 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-01409a4d-d9ce-48b3-998a-fae13b8e7dd9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:44.113725 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-01409a4d-d9ce-48b3-998a-fae13b8e7dd9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:44.121157 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-01409a4d-d9ce-48b3-998a-fae13b8e7dd9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:44.121887 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-01409a4d-d9ce-48b3-998a-fae13b8e7dd9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:44.122687 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-01409a4d-d9ce-48b3-998a-fae13b8e7dd9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:44.123121 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-01409a4d-d9ce-48b3-998a-fae13b8e7dd9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:44.155523 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-01409a4d-d9ce-48b3-998a-fae13b8e7dd9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048151 Jul 26 07:33:44.156109 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 504/958] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:44 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:45.072873 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-3ea32572-ef8a-44dc-8cb9-d600bef90f9c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:45.075183 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-3ea32572-ef8a-44dc-8cb9-d600bef90f9c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:45.081601 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3ea32572-ef8a-44dc-8cb9-d600bef90f9c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:45.082087 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3ea32572-ef8a-44dc-8cb9-d600bef90f9c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:45.082855 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3ea32572-ef8a-44dc-8cb9-d600bef90f9c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:45.083292 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3ea32572-ef8a-44dc-8cb9-d600bef90f9c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:45.115720 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-3ea32572-ef8a-44dc-8cb9-d600bef90f9c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047302 Jul 26 07:33:45.116311 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 455/959] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:45 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:45.172042 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b2a3ac40-337b-4361-9b67-4d312635d3b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:45.174252 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b2a3ac40-337b-4361-9b67-4d312635d3b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:45.180734 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b2a3ac40-337b-4361-9b67-4d312635d3b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:45.181177 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b2a3ac40-337b-4361-9b67-4d312635d3b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:45.181977 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b2a3ac40-337b-4361-9b67-4d312635d3b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:45.182408 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b2a3ac40-337b-4361-9b67-4d312635d3b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:45.213940 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b2a3ac40-337b-4361-9b67-4d312635d3b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046115 Jul 26 07:33:45.214515 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 505/960] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:45 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:46.128927 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2bcc5495-bc4a-4db2-baf2-2f3a85dedebf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:46.131241 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2bcc5495-bc4a-4db2-baf2-2f3a85dedebf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:46.138700 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2bcc5495-bc4a-4db2-baf2-2f3a85dedebf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:46.139200 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2bcc5495-bc4a-4db2-baf2-2f3a85dedebf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:46.140093 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2bcc5495-bc4a-4db2-baf2-2f3a85dedebf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:46.140620 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2bcc5495-bc4a-4db2-baf2-2f3a85dedebf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:46.174918 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2bcc5495-bc4a-4db2-baf2-2f3a85dedebf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050205 Jul 26 07:33:46.175507 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 456/961] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:46 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:46.231185 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e96e65d7-fa2a-4fab-aa3c-ecbd876edb78 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:46.234975 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e96e65d7-fa2a-4fab-aa3c-ecbd876edb78 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:46.247193 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e96e65d7-fa2a-4fab-aa3c-ecbd876edb78 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:46.247997 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e96e65d7-fa2a-4fab-aa3c-ecbd876edb78 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:46.249377 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e96e65d7-fa2a-4fab-aa3c-ecbd876edb78 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:46.250188 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e96e65d7-fa2a-4fab-aa3c-ecbd876edb78 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:46.286802 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e96e65d7-fa2a-4fab-aa3c-ecbd876edb78 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062967 Jul 26 07:33:46.287388 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 506/962] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:46 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:47.189100 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6bd6a12b-66ef-47aa-95b3-7a305af208ea tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:47.190796 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6bd6a12b-66ef-47aa-95b3-7a305af208ea tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:47.198604 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6bd6a12b-66ef-47aa-95b3-7a305af208ea tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:47.199051 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6bd6a12b-66ef-47aa-95b3-7a305af208ea tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:47.199826 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6bd6a12b-66ef-47aa-95b3-7a305af208ea tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:47.200429 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6bd6a12b-66ef-47aa-95b3-7a305af208ea tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:47.233293 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6bd6a12b-66ef-47aa-95b3-7a305af208ea tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049420 Jul 26 07:33:47.233950 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 457/963] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:47 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:47.300404 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-84c7b29d-0573-4643-9514-8f921f845224 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:47.302632 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-84c7b29d-0573-4643-9514-8f921f845224 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:47.310370 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-84c7b29d-0573-4643-9514-8f921f845224 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:47.310822 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-84c7b29d-0573-4643-9514-8f921f845224 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:47.311613 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-84c7b29d-0573-4643-9514-8f921f845224 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:47.312036 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-84c7b29d-0573-4643-9514-8f921f845224 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:47.346859 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-84c7b29d-0573-4643-9514-8f921f845224 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050513 Jul 26 07:33:47.347442 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 507/964] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:47 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 07:33:48.246751 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-97f58c0c-87cc-4e76-a315-27548db7d0f1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:48.248833 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-97f58c0c-87cc-4e76-a315-27548db7d0f1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:48.256830 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-97f58c0c-87cc-4e76-a315-27548db7d0f1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:48.257310 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-97f58c0c-87cc-4e76-a315-27548db7d0f1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:48.258141 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-97f58c0c-87cc-4e76-a315-27548db7d0f1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:48.258566 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-97f58c0c-87cc-4e76-a315-27548db7d0f1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:48.291378 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-97f58c0c-87cc-4e76-a315-27548db7d0f1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048806 Jul 26 07:33:48.291953 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 458/965] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:48 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:48.360622 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-02b92d4c-474c-491e-926e-de7e044e4d24 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:48.363017 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-02b92d4c-474c-491e-926e-de7e044e4d24 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:48.372776 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-02b92d4c-474c-491e-926e-de7e044e4d24 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:48.373225 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-02b92d4c-474c-491e-926e-de7e044e4d24 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:48.374063 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-02b92d4c-474c-491e-926e-de7e044e4d24 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:48.374475 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-02b92d4c-474c-491e-926e-de7e044e4d24 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:48.389854 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:48.407254 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-02b92d4c-474c-491e-926e-de7e044e4d24 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051267 Jul 26 07:33:48.407841 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 508/966] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:48 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:49.304910 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6850c917-af99-45c6-84b0-31fc20c46354 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:49.307161 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6850c917-af99-45c6-84b0-31fc20c46354 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:49.314439 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6850c917-af99-45c6-84b0-31fc20c46354 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:49.314880 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6850c917-af99-45c6-84b0-31fc20c46354 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:49.315653 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6850c917-af99-45c6-84b0-31fc20c46354 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:49.316077 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6850c917-af99-45c6-84b0-31fc20c46354 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:49.349082 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6850c917-af99-45c6-84b0-31fc20c46354 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048125 Jul 26 07:33:49.349655 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 459/967] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:49 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:49.426734 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-472d52a9-e314-483a-91dc-4aee807620cc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:49.430504 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-472d52a9-e314-483a-91dc-4aee807620cc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:49.442288 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-472d52a9-e314-483a-91dc-4aee807620cc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:49.443106 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-472d52a9-e314-483a-91dc-4aee807620cc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:49.444449 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-472d52a9-e314-483a-91dc-4aee807620cc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:49.445242 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-472d52a9-e314-483a-91dc-4aee807620cc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:49.486215 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-472d52a9-e314-483a-91dc-4aee807620cc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067258 Jul 26 07:33:49.486825 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 509/968] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:49 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:50.361115 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ddb8e15e-14eb-4ae3-80b9-4103f2311be3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:50.363597 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ddb8e15e-14eb-4ae3-80b9-4103f2311be3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:50.371135 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ddb8e15e-14eb-4ae3-80b9-4103f2311be3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:50.371585 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ddb8e15e-14eb-4ae3-80b9-4103f2311be3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:50.372373 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ddb8e15e-14eb-4ae3-80b9-4103f2311be3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:50.372777 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ddb8e15e-14eb-4ae3-80b9-4103f2311be3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:50.405221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ddb8e15e-14eb-4ae3-80b9-4103f2311be3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048050 Jul 26 07:33:50.405846 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 460/969] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:50 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:50.501125 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ccc0602b-d17c-4706-904c-6e092837edce tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:50.503363 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ccc0602b-d17c-4706-904c-6e092837edce tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:50.510280 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ccc0602b-d17c-4706-904c-6e092837edce tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:50.510722 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ccc0602b-d17c-4706-904c-6e092837edce tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:50.511487 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ccc0602b-d17c-4706-904c-6e092837edce tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:50.511914 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ccc0602b-d17c-4706-904c-6e092837edce tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:50.542491 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ccc0602b-d17c-4706-904c-6e092837edce tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047152 Jul 26 07:33:50.543066 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 510/970] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:50 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:51.418217 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d720e87b-a6c6-4b1b-b7be-08886d942a98 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:51.420304 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d720e87b-a6c6-4b1b-b7be-08886d942a98 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:51.427506 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d720e87b-a6c6-4b1b-b7be-08886d942a98 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:51.427960 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d720e87b-a6c6-4b1b-b7be-08886d942a98 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:51.428790 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d720e87b-a6c6-4b1b-b7be-08886d942a98 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:51.429237 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d720e87b-a6c6-4b1b-b7be-08886d942a98 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:51.462302 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d720e87b-a6c6-4b1b-b7be-08886d942a98 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048100 Jul 26 07:33:51.462970 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 461/971] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:51 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:51.557791 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-83851333-71f3-4d26-9b25-fa9582ab3259 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:51.560065 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-83851333-71f3-4d26-9b25-fa9582ab3259 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:51.567103 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-83851333-71f3-4d26-9b25-fa9582ab3259 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:51.567575 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-83851333-71f3-4d26-9b25-fa9582ab3259 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:51.568328 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-83851333-71f3-4d26-9b25-fa9582ab3259 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:51.568742 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-83851333-71f3-4d26-9b25-fa9582ab3259 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:51.603111 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-83851333-71f3-4d26-9b25-fa9582ab3259 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049380 Jul 26 07:33:51.603703 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 511/972] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:51 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:52.476235 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-09d0ee40-77f2-4365-8fca-c671f6cc5e17 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:52.478455 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-09d0ee40-77f2-4365-8fca-c671f6cc5e17 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:52.485881 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-09d0ee40-77f2-4365-8fca-c671f6cc5e17 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:52.486329 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-09d0ee40-77f2-4365-8fca-c671f6cc5e17 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:52.487132 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-09d0ee40-77f2-4365-8fca-c671f6cc5e17 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:52.487560 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-09d0ee40-77f2-4365-8fca-c671f6cc5e17 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:52.521370 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-09d0ee40-77f2-4365-8fca-c671f6cc5e17 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049290 Jul 26 07:33:52.521996 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 462/973] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:52 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:52.615982 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3e008a13-db5d-4539-9826-65fb0f7b884b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:52.618368 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3e008a13-db5d-4539-9826-65fb0f7b884b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:52.626038 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3e008a13-db5d-4539-9826-65fb0f7b884b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:52.626483 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3e008a13-db5d-4539-9826-65fb0f7b884b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:52.627259 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3e008a13-db5d-4539-9826-65fb0f7b884b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:52.627689 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3e008a13-db5d-4539-9826-65fb0f7b884b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:52.660112 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3e008a13-db5d-4539-9826-65fb0f7b884b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048250 Jul 26 07:33:52.660733 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 512/974] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:52 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:53.540520 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-644970aa-7121-4a6e-b143-7e5fbb86f3f1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:53.544519 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-644970aa-7121-4a6e-b143-7e5fbb86f3f1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:53.552839 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-644970aa-7121-4a6e-b143-7e5fbb86f3f1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:53.553289 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-644970aa-7121-4a6e-b143-7e5fbb86f3f1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:53.554117 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-644970aa-7121-4a6e-b143-7e5fbb86f3f1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:53.554585 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-644970aa-7121-4a6e-b143-7e5fbb86f3f1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:53.557348 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:53.589791 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-644970aa-7121-4a6e-b143-7e5fbb86f3f1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057528 Jul 26 07:33:53.590417 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 463/975] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:53 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:53.673402 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c6c30474-717b-4457-9fce-fe0b41f7c027 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:53.675647 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c6c30474-717b-4457-9fce-fe0b41f7c027 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:53.682947 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c6c30474-717b-4457-9fce-fe0b41f7c027 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:53.683400 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c6c30474-717b-4457-9fce-fe0b41f7c027 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:53.684190 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c6c30474-717b-4457-9fce-fe0b41f7c027 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:53.684711 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c6c30474-717b-4457-9fce-fe0b41f7c027 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:53.717668 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c6c30474-717b-4457-9fce-fe0b41f7c027 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048181 Jul 26 07:33:53.718181 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 513/976] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:53 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:54.604214 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8c516350-d4ef-40a7-a878-2b5c4528a9ee tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:54.606430 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8c516350-d4ef-40a7-a878-2b5c4528a9ee tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:54.613280 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8c516350-d4ef-40a7-a878-2b5c4528a9ee tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:54.613724 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8c516350-d4ef-40a7-a878-2b5c4528a9ee tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:54.614561 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8c516350-d4ef-40a7-a878-2b5c4528a9ee tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:54.614995 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8c516350-d4ef-40a7-a878-2b5c4528a9ee tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:54.645013 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8c516350-d4ef-40a7-a878-2b5c4528a9ee tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045028 Jul 26 07:33:54.645644 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 464/977] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:54 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:54.730683 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-62333dbe-dcb9-44bf-8b95-19d481638cb0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:54.733563 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-62333dbe-dcb9-44bf-8b95-19d481638cb0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:54.741604 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-62333dbe-dcb9-44bf-8b95-19d481638cb0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:54.742091 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-62333dbe-dcb9-44bf-8b95-19d481638cb0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:54.742867 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-62333dbe-dcb9-44bf-8b95-19d481638cb0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:54.743483 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-62333dbe-dcb9-44bf-8b95-19d481638cb0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:54.778322 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-62333dbe-dcb9-44bf-8b95-19d481638cb0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051976 Jul 26 07:33:54.778881 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 514/978] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:54 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:55.657768 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9e152771-bb6d-4b79-a25b-bd7d0da9bd82 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:55.659948 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-9e152771-bb6d-4b79-a25b-bd7d0da9bd82 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:55.666991 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9e152771-bb6d-4b79-a25b-bd7d0da9bd82 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:55.667421 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9e152771-bb6d-4b79-a25b-bd7d0da9bd82 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:55.668180 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9e152771-bb6d-4b79-a25b-bd7d0da9bd82 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:55.668783 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9e152771-bb6d-4b79-a25b-bd7d0da9bd82 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:55.699498 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-9e152771-bb6d-4b79-a25b-bd7d0da9bd82 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045795 Jul 26 07:33:55.700177 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 465/979] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:55 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:55.792079 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8d690889-2c26-4ac1-996f-aaf0eaeaf4ee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:55.794640 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8d690889-2c26-4ac1-996f-aaf0eaeaf4ee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:55.801876 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8d690889-2c26-4ac1-996f-aaf0eaeaf4ee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:55.802328 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8d690889-2c26-4ac1-996f-aaf0eaeaf4ee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:55.803163 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8d690889-2c26-4ac1-996f-aaf0eaeaf4ee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:55.803638 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8d690889-2c26-4ac1-996f-aaf0eaeaf4ee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:55.834126 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8d690889-2c26-4ac1-996f-aaf0eaeaf4ee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046353 Jul 26 07:33:55.834692 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 515/980] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:55 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:56.712038 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8dba9533-d69f-4475-83c0-89abd113ffc8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:56.714311 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8dba9533-d69f-4475-83c0-89abd113ffc8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:56.722280 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8dba9533-d69f-4475-83c0-89abd113ffc8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:56.722703 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8dba9533-d69f-4475-83c0-89abd113ffc8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:56.723507 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8dba9533-d69f-4475-83c0-89abd113ffc8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:56.723920 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8dba9533-d69f-4475-83c0-89abd113ffc8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:56.757761 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8dba9533-d69f-4475-83c0-89abd113ffc8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049695 Jul 26 07:33:56.758357 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 466/981] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:56 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:56.847747 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-382405ee-1842-421c-8d2a-8ade47ce4610 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:56.849911 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-382405ee-1842-421c-8d2a-8ade47ce4610 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:56.857308 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-382405ee-1842-421c-8d2a-8ade47ce4610 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:56.857761 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-382405ee-1842-421c-8d2a-8ade47ce4610 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:56.858537 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-382405ee-1842-421c-8d2a-8ade47ce4610 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:56.858965 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-382405ee-1842-421c-8d2a-8ade47ce4610 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:56.891509 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-382405ee-1842-421c-8d2a-8ade47ce4610 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047879 Jul 26 07:33:56.892096 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 516/982] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:56 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:57.041450 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 07:33:57.042998 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Tue Jul 26 07:33:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 07:33:57.770794 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f2f465c5-e9a4-4a90-911c-5192d56d57c6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:57.772822 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-f2f465c5-e9a4-4a90-911c-5192d56d57c6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:57.779923 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f2f465c5-e9a4-4a90-911c-5192d56d57c6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:57.780379 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f2f465c5-e9a4-4a90-911c-5192d56d57c6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:57.781134 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f2f465c5-e9a4-4a90-911c-5192d56d57c6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:57.781561 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f2f465c5-e9a4-4a90-911c-5192d56d57c6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:57.813295 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f2f465c5-e9a4-4a90-911c-5192d56d57c6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046568 Jul 26 07:33:57.813914 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 467/983] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:57 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:57.904618 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-71eede39-cad6-4abf-81b5-cc1c5ee10c68 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:57.906908 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-71eede39-cad6-4abf-81b5-cc1c5ee10c68 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:57.914129 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-71eede39-cad6-4abf-81b5-cc1c5ee10c68 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:57.914599 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-71eede39-cad6-4abf-81b5-cc1c5ee10c68 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:57.915358 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-71eede39-cad6-4abf-81b5-cc1c5ee10c68 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:57.915806 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-71eede39-cad6-4abf-81b5-cc1c5ee10c68 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:57.948263 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-71eede39-cad6-4abf-81b5-cc1c5ee10c68 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047828 Jul 26 07:33:57.948854 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 517/984] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:57 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:58.825903 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c8a10a51-95c0-4534-a216-d916bdf07e4a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:58.828091 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c8a10a51-95c0-4534-a216-d916bdf07e4a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:58.835479 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c8a10a51-95c0-4534-a216-d916bdf07e4a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:58.836024 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c8a10a51-95c0-4534-a216-d916bdf07e4a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:58.836942 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c8a10a51-95c0-4534-a216-d916bdf07e4a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:58.837381 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c8a10a51-95c0-4534-a216-d916bdf07e4a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:58.870318 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c8a10a51-95c0-4534-a216-d916bdf07e4a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048355 Jul 26 07:33:58.871144 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 468/985] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:58 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:33:58.964808 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a5d6c9f6-4c70-484f-830b-ff44d64f3f61 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:58.967461 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a5d6c9f6-4c70-484f-830b-ff44d64f3f61 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:58.974390 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a5d6c9f6-4c70-484f-830b-ff44d64f3f61 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:58.974837 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a5d6c9f6-4c70-484f-830b-ff44d64f3f61 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:58.975620 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a5d6c9f6-4c70-484f-830b-ff44d64f3f61 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:58.976053 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a5d6c9f6-4c70-484f-830b-ff44d64f3f61 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:59.010129 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a5d6c9f6-4c70-484f-830b-ff44d64f3f61 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049380 Jul 26 07:33:59.010699 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 518/986] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:33:58 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:33:59.884335 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-e66aec5f-a63b-4c1f-929e-1c6e23a15655 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:33:59.886910 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-e66aec5f-a63b-4c1f-929e-1c6e23a15655 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:33:59.893769 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e66aec5f-a63b-4c1f-929e-1c6e23a15655 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:59.894251 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e66aec5f-a63b-4c1f-929e-1c6e23a15655 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:59.895007 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e66aec5f-a63b-4c1f-929e-1c6e23a15655 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:33:59.895432 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e66aec5f-a63b-4c1f-929e-1c6e23a15655 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:33:59.927574 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-e66aec5f-a63b-4c1f-929e-1c6e23a15655 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047534 Jul 26 07:33:59.928340 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 469/987] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:33:59 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:00.023716 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-78d2d4a8-2184-43bf-8aa2-65da04ecd278 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:00.026209 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-78d2d4a8-2184-43bf-8aa2-65da04ecd278 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:00.035033 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-78d2d4a8-2184-43bf-8aa2-65da04ecd278 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:00.035707 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-78d2d4a8-2184-43bf-8aa2-65da04ecd278 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:00.036895 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-78d2d4a8-2184-43bf-8aa2-65da04ecd278 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:00.037867 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-78d2d4a8-2184-43bf-8aa2-65da04ecd278 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:00.085794 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-78d2d4a8-2184-43bf-8aa2-65da04ecd278 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066435 Jul 26 07:34:00.086404 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 519/988] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:00 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:00.940230 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-94b78215-bc6f-48d4-88c4-5e990b8dd51e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:00.942437 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-94b78215-bc6f-48d4-88c4-5e990b8dd51e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:00.949288 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-94b78215-bc6f-48d4-88c4-5e990b8dd51e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:00.949855 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-94b78215-bc6f-48d4-88c4-5e990b8dd51e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:00.950655 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-94b78215-bc6f-48d4-88c4-5e990b8dd51e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:00.951087 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-94b78215-bc6f-48d4-88c4-5e990b8dd51e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:00.987449 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-94b78215-bc6f-48d4-88c4-5e990b8dd51e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051095 Jul 26 07:34:00.987951 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 470/989] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:00 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:01.101322 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8bbdce71-cb49-496e-842e-8bd1990796ea tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:01.103624 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8bbdce71-cb49-496e-842e-8bd1990796ea tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:01.111114 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8bbdce71-cb49-496e-842e-8bd1990796ea tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:01.111562 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8bbdce71-cb49-496e-842e-8bd1990796ea tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:01.112348 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8bbdce71-cb49-496e-842e-8bd1990796ea tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:01.112781 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8bbdce71-cb49-496e-842e-8bd1990796ea tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:01.146554 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8bbdce71-cb49-496e-842e-8bd1990796ea tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049380 Jul 26 07:34:01.147145 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 520/990] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:01 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:02.000534 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9cac1210-b991-44c2-aaf6-67abdb1adeca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:02.003088 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-9cac1210-b991-44c2-aaf6-67abdb1adeca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:02.010357 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9cac1210-b991-44c2-aaf6-67abdb1adeca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:02.010888 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9cac1210-b991-44c2-aaf6-67abdb1adeca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:02.011793 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9cac1210-b991-44c2-aaf6-67abdb1adeca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:02.012144 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9cac1210-b991-44c2-aaf6-67abdb1adeca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:02.047386 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-9cac1210-b991-44c2-aaf6-67abdb1adeca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050962 Jul 26 07:34:02.048007 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 471/991] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:01 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:02.160823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9fb16ffc-3110-4be5-8c5f-5efe5592ef4e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:02.163325 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-9fb16ffc-3110-4be5-8c5f-5efe5592ef4e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:02.171199 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9fb16ffc-3110-4be5-8c5f-5efe5592ef4e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:02.171762 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9fb16ffc-3110-4be5-8c5f-5efe5592ef4e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:02.172539 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9fb16ffc-3110-4be5-8c5f-5efe5592ef4e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:02.172966 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9fb16ffc-3110-4be5-8c5f-5efe5592ef4e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:02.208013 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-9fb16ffc-3110-4be5-8c5f-5efe5592ef4e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051793 Jul 26 07:34:02.208611 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 521/992] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:02 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:03.060728 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2256ed0a-3ca9-4885-bab8-4ef257ca31cc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:03.063008 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2256ed0a-3ca9-4885-bab8-4ef257ca31cc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:03.070115 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2256ed0a-3ca9-4885-bab8-4ef257ca31cc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:03.070560 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2256ed0a-3ca9-4885-bab8-4ef257ca31cc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:03.071331 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2256ed0a-3ca9-4885-bab8-4ef257ca31cc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:03.071755 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2256ed0a-3ca9-4885-bab8-4ef257ca31cc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:03.104259 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2256ed0a-3ca9-4885-bab8-4ef257ca31cc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047691 Jul 26 07:34:03.104845 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 472/993] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:03 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:03.221646 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8ee20352-8ee6-4a3f-a260-54afe58be7b4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:03.223860 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8ee20352-8ee6-4a3f-a260-54afe58be7b4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:03.230955 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ee20352-8ee6-4a3f-a260-54afe58be7b4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:03.231492 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ee20352-8ee6-4a3f-a260-54afe58be7b4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:03.232272 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ee20352-8ee6-4a3f-a260-54afe58be7b4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:03.232706 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ee20352-8ee6-4a3f-a260-54afe58be7b4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:03.264387 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8ee20352-8ee6-4a3f-a260-54afe58be7b4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046798 Jul 26 07:34:03.265028 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 522/994] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:03 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:04.116950 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0c813a68-f8ad-40c9-8518-8db97a54f295 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:04.119585 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0c813a68-f8ad-40c9-8518-8db97a54f295 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:04.127044 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0c813a68-f8ad-40c9-8518-8db97a54f295 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:04.127468 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0c813a68-f8ad-40c9-8518-8db97a54f295 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:04.128275 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0c813a68-f8ad-40c9-8518-8db97a54f295 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:04.128708 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0c813a68-f8ad-40c9-8518-8db97a54f295 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:04.162467 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0c813a68-f8ad-40c9-8518-8db97a54f295 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049514 Jul 26 07:34:04.163050 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 473/995] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:04 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:04.277400 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8f50493c-d90b-46a3-ae74-277ca1156177 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:04.279720 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8f50493c-d90b-46a3-ae74-277ca1156177 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:04.287324 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8f50493c-d90b-46a3-ae74-277ca1156177 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:04.287758 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8f50493c-d90b-46a3-ae74-277ca1156177 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:04.288565 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8f50493c-d90b-46a3-ae74-277ca1156177 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:04.289001 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8f50493c-d90b-46a3-ae74-277ca1156177 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:04.326472 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8f50493c-d90b-46a3-ae74-277ca1156177 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053129 Jul 26 07:34:04.327085 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 523/996] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:04 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:05.184734 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-006dae09-c7af-48de-a50d-fb4357baaf5e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:05.188265 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-006dae09-c7af-48de-a50d-fb4357baaf5e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:05.197832 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-006dae09-c7af-48de-a50d-fb4357baaf5e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:05.198522 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-006dae09-c7af-48de-a50d-fb4357baaf5e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:05.199380 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-006dae09-c7af-48de-a50d-fb4357baaf5e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:05.199996 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-006dae09-c7af-48de-a50d-fb4357baaf5e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:05.233406 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-006dae09-c7af-48de-a50d-fb4357baaf5e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060178 Jul 26 07:34:05.234034 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 474/997] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:05 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:05.343380 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c0e878be-022a-4add-b196-6c3e53a8cdf6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:05.345968 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c0e878be-022a-4add-b196-6c3e53a8cdf6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:05.355063 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c0e878be-022a-4add-b196-6c3e53a8cdf6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:05.355713 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c0e878be-022a-4add-b196-6c3e53a8cdf6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:05.356801 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c0e878be-022a-4add-b196-6c3e53a8cdf6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:05.357240 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c0e878be-022a-4add-b196-6c3e53a8cdf6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:05.388296 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c0e878be-022a-4add-b196-6c3e53a8cdf6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050269 Jul 26 07:34:05.388896 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 524/998] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:05 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:06.247054 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b0cbc7db-7d11-4d4b-bd25-485549923d11 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:06.249181 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-b0cbc7db-7d11-4d4b-bd25-485549923d11 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:06.256801 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b0cbc7db-7d11-4d4b-bd25-485549923d11 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:06.257252 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b0cbc7db-7d11-4d4b-bd25-485549923d11 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:06.258153 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b0cbc7db-7d11-4d4b-bd25-485549923d11 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:06.258594 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b0cbc7db-7d11-4d4b-bd25-485549923d11 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:06.292179 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b0cbc7db-7d11-4d4b-bd25-485549923d11 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049510 Jul 26 07:34:06.292767 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 475/999] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:06 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:06.401258 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7bc3605a-6fef-461b-ab17-60e05a33c182 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:06.403541 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7bc3605a-6fef-461b-ab17-60e05a33c182 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:06.411751 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7bc3605a-6fef-461b-ab17-60e05a33c182 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:06.412470 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7bc3605a-6fef-461b-ab17-60e05a33c182 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:06.413302 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7bc3605a-6fef-461b-ab17-60e05a33c182 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:06.413843 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7bc3605a-6fef-461b-ab17-60e05a33c182 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:06.417420 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:06.451652 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7bc3605a-6fef-461b-ab17-60e05a33c182 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054294 Jul 26 07:34:06.452522 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 525/1000] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:06 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:07.310216 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0c3fd502-9b90-4209-95e4-c7c73cc43eca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:07.312410 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0c3fd502-9b90-4209-95e4-c7c73cc43eca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:07.319497 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0c3fd502-9b90-4209-95e4-c7c73cc43eca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:07.319909 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0c3fd502-9b90-4209-95e4-c7c73cc43eca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:07.320672 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0c3fd502-9b90-4209-95e4-c7c73cc43eca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:07.321092 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0c3fd502-9b90-4209-95e4-c7c73cc43eca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:07.353842 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0c3fd502-9b90-4209-95e4-c7c73cc43eca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049657 Jul 26 07:34:07.354419 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 476/1001] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:07 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:07.469525 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-bee1eac3-08f5-40ff-a135-c8f771428db7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:07.471830 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-bee1eac3-08f5-40ff-a135-c8f771428db7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:07.480667 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bee1eac3-08f5-40ff-a135-c8f771428db7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:07.481207 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bee1eac3-08f5-40ff-a135-c8f771428db7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:07.482045 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bee1eac3-08f5-40ff-a135-c8f771428db7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:07.482480 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bee1eac3-08f5-40ff-a135-c8f771428db7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:07.516124 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-bee1eac3-08f5-40ff-a135-c8f771428db7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050901 Jul 26 07:34:07.517008 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 526/1002] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:07 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:08.366933 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0d5ee2d4-2648-40b3-abf9-dc3e44dae8fd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:08.369084 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0d5ee2d4-2648-40b3-abf9-dc3e44dae8fd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:08.371972 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=58 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:08.380347 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0d5ee2d4-2648-40b3-abf9-dc3e44dae8fd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:08.380787 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0d5ee2d4-2648-40b3-abf9-dc3e44dae8fd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:08.381920 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0d5ee2d4-2648-40b3-abf9-dc3e44dae8fd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:08.382458 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0d5ee2d4-2648-40b3-abf9-dc3e44dae8fd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:08.414567 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0d5ee2d4-2648-40b3-abf9-dc3e44dae8fd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051541 Jul 26 07:34:08.415134 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 477/1003] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:08 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:08.529018 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b5325668-45c5-493b-913b-d4cb15d73302 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:08.531191 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b5325668-45c5-493b-913b-d4cb15d73302 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:08.538374 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b5325668-45c5-493b-913b-d4cb15d73302 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:08.538810 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b5325668-45c5-493b-913b-d4cb15d73302 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:08.539572 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b5325668-45c5-493b-913b-d4cb15d73302 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:08.539996 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b5325668-45c5-493b-913b-d4cb15d73302 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:08.571972 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b5325668-45c5-493b-913b-d4cb15d73302 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046942 Jul 26 07:34:08.572537 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 527/1004] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:08 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:09.427987 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9a134687-0588-40de-a107-da3f68564ee4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:09.432725 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-9a134687-0588-40de-a107-da3f68564ee4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:09.439958 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9a134687-0588-40de-a107-da3f68564ee4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:09.440399 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9a134687-0588-40de-a107-da3f68564ee4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:09.441181 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9a134687-0588-40de-a107-da3f68564ee4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:09.441610 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9a134687-0588-40de-a107-da3f68564ee4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:09.476206 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-9a134687-0588-40de-a107-da3f68564ee4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052478 Jul 26 07:34:09.476873 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 478/1005] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:09 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:09.585030 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-842011c9-d2c9-4886-9dee-a12d7e0b8252 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:09.587250 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-842011c9-d2c9-4886-9dee-a12d7e0b8252 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:09.589700 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=58 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:09.596168 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-842011c9-d2c9-4886-9dee-a12d7e0b8252 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:09.596765 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-842011c9-d2c9-4886-9dee-a12d7e0b8252 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:09.597715 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-842011c9-d2c9-4886-9dee-a12d7e0b8252 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:09.598188 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-842011c9-d2c9-4886-9dee-a12d7e0b8252 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:09.632297 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-842011c9-d2c9-4886-9dee-a12d7e0b8252 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050884 Jul 26 07:34:09.632852 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 528/1006] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:09 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:10.489414 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8d7262f3-a8aa-4f49-9c94-6cbb4873bbf4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:10.491598 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8d7262f3-a8aa-4f49-9c94-6cbb4873bbf4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:10.498576 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8d7262f3-a8aa-4f49-9c94-6cbb4873bbf4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:10.499017 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8d7262f3-a8aa-4f49-9c94-6cbb4873bbf4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:10.499769 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8d7262f3-a8aa-4f49-9c94-6cbb4873bbf4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:10.500198 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8d7262f3-a8aa-4f49-9c94-6cbb4873bbf4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:10.524914 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:10.532213 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8d7262f3-a8aa-4f49-9c94-6cbb4873bbf4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046808 Jul 26 07:34:10.532782 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 479/1007] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:10 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:10.646106 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-38c0f452-5ff6-4dd6-8c8a-1f727687a815 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:10.648277 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-38c0f452-5ff6-4dd6-8c8a-1f727687a815 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:10.655330 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-38c0f452-5ff6-4dd6-8c8a-1f727687a815 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:10.655744 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-38c0f452-5ff6-4dd6-8c8a-1f727687a815 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:10.656512 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-38c0f452-5ff6-4dd6-8c8a-1f727687a815 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:10.656939 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-38c0f452-5ff6-4dd6-8c8a-1f727687a815 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:10.689372 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-38c0f452-5ff6-4dd6-8c8a-1f727687a815 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047144 Jul 26 07:34:10.689888 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 529/1008] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:10 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:11.548095 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f7ada381-86d9-4b1a-8178-ba584a5a1791 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:11.550270 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-f7ada381-86d9-4b1a-8178-ba584a5a1791 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:11.557632 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f7ada381-86d9-4b1a-8178-ba584a5a1791 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:11.558101 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f7ada381-86d9-4b1a-8178-ba584a5a1791 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:11.558854 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f7ada381-86d9-4b1a-8178-ba584a5a1791 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:11.559285 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f7ada381-86d9-4b1a-8178-ba584a5a1791 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:11.592219 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f7ada381-86d9-4b1a-8178-ba584a5a1791 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048207 Jul 26 07:34:11.592788 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 480/1009] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:11 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:11.707885 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-96d5457a-4c13-4ab6-adb4-707d171085a9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:11.710890 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-96d5457a-4c13-4ab6-adb4-707d171085a9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:11.720615 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-96d5457a-4c13-4ab6-adb4-707d171085a9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:11.721065 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-96d5457a-4c13-4ab6-adb4-707d171085a9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:11.721871 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-96d5457a-4c13-4ab6-adb4-707d171085a9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:11.722308 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-96d5457a-4c13-4ab6-adb4-707d171085a9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:11.753494 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-96d5457a-4c13-4ab6-adb4-707d171085a9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052069 Jul 26 07:34:11.754085 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 530/1010] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:11 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:12.605066 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ea6b7f8d-e127-46d4-952c-719e2875c9d3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:12.607222 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ea6b7f8d-e127-46d4-952c-719e2875c9d3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:12.614050 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ea6b7f8d-e127-46d4-952c-719e2875c9d3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:12.614494 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ea6b7f8d-e127-46d4-952c-719e2875c9d3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:12.615247 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ea6b7f8d-e127-46d4-952c-719e2875c9d3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:12.615676 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ea6b7f8d-e127-46d4-952c-719e2875c9d3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:12.646758 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ea6b7f8d-e127-46d4-952c-719e2875c9d3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045601 Jul 26 07:34:12.647315 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 481/1011] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:12 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:12.768492 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-53b1baee-12e5-4b4f-8fa6-1ef86b30e87a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:12.770700 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-53b1baee-12e5-4b4f-8fa6-1ef86b30e87a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:12.777803 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-53b1baee-12e5-4b4f-8fa6-1ef86b30e87a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:12.778263 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-53b1baee-12e5-4b4f-8fa6-1ef86b30e87a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:12.779049 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-53b1baee-12e5-4b4f-8fa6-1ef86b30e87a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:12.779471 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-53b1baee-12e5-4b4f-8fa6-1ef86b30e87a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:12.808964 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-53b1baee-12e5-4b4f-8fa6-1ef86b30e87a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045115 Jul 26 07:34:12.809433 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 531/1012] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:12 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:13.659946 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-4b8b05dc-8ea0-4671-b591-a6038bf13458 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:13.662093 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-4b8b05dc-8ea0-4671-b591-a6038bf13458 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:13.669169 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4b8b05dc-8ea0-4671-b591-a6038bf13458 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:13.669616 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4b8b05dc-8ea0-4671-b591-a6038bf13458 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:13.670414 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4b8b05dc-8ea0-4671-b591-a6038bf13458 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:13.670849 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4b8b05dc-8ea0-4671-b591-a6038bf13458 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:13.703591 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-4b8b05dc-8ea0-4671-b591-a6038bf13458 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047807 Jul 26 07:34:13.704141 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 482/1013] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:13 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:13.825772 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-521b8802-e58b-4a02-9557-4bc6db3da7a0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:13.828687 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-521b8802-e58b-4a02-9557-4bc6db3da7a0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:13.835828 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-521b8802-e58b-4a02-9557-4bc6db3da7a0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:13.836274 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-521b8802-e58b-4a02-9557-4bc6db3da7a0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:13.837083 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-521b8802-e58b-4a02-9557-4bc6db3da7a0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:13.837520 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-521b8802-e58b-4a02-9557-4bc6db3da7a0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:13.870567 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-521b8802-e58b-4a02-9557-4bc6db3da7a0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051233 Jul 26 07:34:13.871127 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 532/1014] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:13 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:14.716062 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-de2d22f0-44ac-4560-85fb-34e2aa74942d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:14.718817 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-de2d22f0-44ac-4560-85fb-34e2aa74942d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:14.725293 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-de2d22f0-44ac-4560-85fb-34e2aa74942d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:14.725766 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-de2d22f0-44ac-4560-85fb-34e2aa74942d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:14.726567 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-de2d22f0-44ac-4560-85fb-34e2aa74942d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:14.727007 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-de2d22f0-44ac-4560-85fb-34e2aa74942d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:14.759441 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-de2d22f0-44ac-4560-85fb-34e2aa74942d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047517 Jul 26 07:34:14.760036 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 483/1015] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:14 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:14.883444 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9d823643-8d88-4fdd-a9ad-2c9e21f440dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:14.885717 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-9d823643-8d88-4fdd-a9ad-2c9e21f440dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:14.892504 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9d823643-8d88-4fdd-a9ad-2c9e21f440dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:14.892970 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9d823643-8d88-4fdd-a9ad-2c9e21f440dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:14.893726 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9d823643-8d88-4fdd-a9ad-2c9e21f440dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:14.894164 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9d823643-8d88-4fdd-a9ad-2c9e21f440dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:14.924896 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-9d823643-8d88-4fdd-a9ad-2c9e21f440dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045509 Jul 26 07:34:14.925455 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 533/1016] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:14 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:15.771885 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-abe4f14d-7159-4388-a641-e368c4531ea0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:15.774081 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-abe4f14d-7159-4388-a641-e368c4531ea0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:15.784894 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-abe4f14d-7159-4388-a641-e368c4531ea0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:15.785675 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-abe4f14d-7159-4388-a641-e368c4531ea0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:15.787140 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-abe4f14d-7159-4388-a641-e368c4531ea0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:15.787925 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-abe4f14d-7159-4388-a641-e368c4531ea0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:15.824781 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-abe4f14d-7159-4388-a641-e368c4531ea0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057167 Jul 26 07:34:15.825374 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 484/1017] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:15 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:15.938393 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-78fd4c41-874f-450b-978a-cb252e78c8a4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:15.940605 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-78fd4c41-874f-450b-978a-cb252e78c8a4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:15.947603 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-78fd4c41-874f-450b-978a-cb252e78c8a4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:15.948048 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-78fd4c41-874f-450b-978a-cb252e78c8a4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:15.948807 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-78fd4c41-874f-450b-978a-cb252e78c8a4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:15.949254 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-78fd4c41-874f-450b-978a-cb252e78c8a4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:15.983212 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-78fd4c41-874f-450b-978a-cb252e78c8a4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048916 Jul 26 07:34:15.983790 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 534/1018] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:15 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:16.665303 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 07:34:16.665585 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Tue Jul 26 07:34:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 07:34:16.839442 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-05ebbf44-3cdf-4fab-a17f-ef1a933c2cf9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:16.842037 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-05ebbf44-3cdf-4fab-a17f-ef1a933c2cf9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:16.849182 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-05ebbf44-3cdf-4fab-a17f-ef1a933c2cf9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:16.849632 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-05ebbf44-3cdf-4fab-a17f-ef1a933c2cf9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:16.850441 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-05ebbf44-3cdf-4fab-a17f-ef1a933c2cf9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:16.850871 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-05ebbf44-3cdf-4fab-a17f-ef1a933c2cf9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:16.882178 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-05ebbf44-3cdf-4fab-a17f-ef1a933c2cf9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046712 Jul 26 07:34:16.882771 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 485/1019] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:16 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:16.995514 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-96c9bbcc-6501-477b-a841-5dc054928679 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:16.997761 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-96c9bbcc-6501-477b-a841-5dc054928679 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:17.006136 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-96c9bbcc-6501-477b-a841-5dc054928679 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:17.006572 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-96c9bbcc-6501-477b-a841-5dc054928679 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:17.007451 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-96c9bbcc-6501-477b-a841-5dc054928679 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:17.008114 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-96c9bbcc-6501-477b-a841-5dc054928679 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:17.043700 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-96c9bbcc-6501-477b-a841-5dc054928679 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052175 Jul 26 07:34:17.044360 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 535/1020] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:16 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:17.894684 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-e782d072-548d-4195-818a-b5d819b5cf19 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:17.896899 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-e782d072-548d-4195-818a-b5d819b5cf19 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:17.904893 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e782d072-548d-4195-818a-b5d819b5cf19 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:17.905521 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e782d072-548d-4195-818a-b5d819b5cf19 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:17.906619 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e782d072-548d-4195-818a-b5d819b5cf19 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:17.907057 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e782d072-548d-4195-818a-b5d819b5cf19 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:17.940332 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-e782d072-548d-4195-818a-b5d819b5cf19 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049684 Jul 26 07:34:17.940915 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 486/1021] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:17 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:18.058795 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e1f11d66-f190-45bc-97e2-6bf0cd34d051 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:18.061274 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e1f11d66-f190-45bc-97e2-6bf0cd34d051 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:18.069133 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e1f11d66-f190-45bc-97e2-6bf0cd34d051 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:18.069580 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e1f11d66-f190-45bc-97e2-6bf0cd34d051 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:18.070420 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e1f11d66-f190-45bc-97e2-6bf0cd34d051 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:18.070853 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e1f11d66-f190-45bc-97e2-6bf0cd34d051 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:18.103626 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e1f11d66-f190-45bc-97e2-6bf0cd34d051 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050045 Jul 26 07:34:18.104406 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 536/1022] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:18 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:18.954174 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-5f3ef730-62a1-4825-84fb-ba4ee617dc73 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:18.957513 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-5f3ef730-62a1-4825-84fb-ba4ee617dc73 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:18.964750 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5f3ef730-62a1-4825-84fb-ba4ee617dc73 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:18.965153 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5f3ef730-62a1-4825-84fb-ba4ee617dc73 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:18.966672 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5f3ef730-62a1-4825-84fb-ba4ee617dc73 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:18.967119 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5f3ef730-62a1-4825-84fb-ba4ee617dc73 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:19.000184 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-5f3ef730-62a1-4825-84fb-ba4ee617dc73 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050552 Jul 26 07:34:19.000749 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 487/1023] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:18 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 07:34:19.116268 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-11fa211b-4148-480a-a506-3b55b0ef57e6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:19.118453 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-11fa211b-4148-480a-a506-3b55b0ef57e6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:19.125835 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-11fa211b-4148-480a-a506-3b55b0ef57e6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:19.126279 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-11fa211b-4148-480a-a506-3b55b0ef57e6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:19.127097 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-11fa211b-4148-480a-a506-3b55b0ef57e6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:19.127524 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-11fa211b-4148-480a-a506-3b55b0ef57e6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:19.157994 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-11fa211b-4148-480a-a506-3b55b0ef57e6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045734 Jul 26 07:34:19.158563 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 537/1024] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:19 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:20.013687 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-e60f9e13-6847-4c92-8266-266d0128bbba tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:20.015963 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-e60f9e13-6847-4c92-8266-266d0128bbba tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:20.023501 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e60f9e13-6847-4c92-8266-266d0128bbba tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:20.023959 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e60f9e13-6847-4c92-8266-266d0128bbba tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:20.024730 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e60f9e13-6847-4c92-8266-266d0128bbba tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:20.025229 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e60f9e13-6847-4c92-8266-266d0128bbba tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:20.065460 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-e60f9e13-6847-4c92-8266-266d0128bbba tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056226 Jul 26 07:34:20.066135 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 488/1025] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:20 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:20.172866 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e2fbdc88-b9b7-4db9-b4ad-ff0d5336fef8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:20.177415 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e2fbdc88-b9b7-4db9-b4ad-ff0d5336fef8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:20.184849 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e2fbdc88-b9b7-4db9-b4ad-ff0d5336fef8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:20.185298 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e2fbdc88-b9b7-4db9-b4ad-ff0d5336fef8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:20.186117 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e2fbdc88-b9b7-4db9-b4ad-ff0d5336fef8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:20.186559 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e2fbdc88-b9b7-4db9-b4ad-ff0d5336fef8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:20.218310 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e2fbdc88-b9b7-4db9-b4ad-ff0d5336fef8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051021 Jul 26 07:34:20.218891 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 538/1026] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:20 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:21.079128 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6e55191d-a6d3-402f-bf34-f2ee89dd1faa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:21.081336 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6e55191d-a6d3-402f-bf34-f2ee89dd1faa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:21.099320 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6e55191d-a6d3-402f-bf34-f2ee89dd1faa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:21.099693 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6e55191d-a6d3-402f-bf34-f2ee89dd1faa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:21.100480 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6e55191d-a6d3-402f-bf34-f2ee89dd1faa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:21.100913 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6e55191d-a6d3-402f-bf34-f2ee89dd1faa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:21.149761 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6e55191d-a6d3-402f-bf34-f2ee89dd1faa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075236 Jul 26 07:34:21.150322 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 489/1027] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:21 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:21.231417 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-14ba84ec-c7ea-46f0-a638-63008c725e6b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:21.233718 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-14ba84ec-c7ea-46f0-a638-63008c725e6b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:21.241364 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-14ba84ec-c7ea-46f0-a638-63008c725e6b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:21.241848 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-14ba84ec-c7ea-46f0-a638-63008c725e6b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:21.242646 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-14ba84ec-c7ea-46f0-a638-63008c725e6b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:21.243077 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-14ba84ec-c7ea-46f0-a638-63008c725e6b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:21.283756 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-14ba84ec-c7ea-46f0-a638-63008c725e6b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056303 Jul 26 07:34:21.284351 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 539/1028] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:21 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:22.165395 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-5cced8fd-1846-40e3-9428-b887e22614bb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:22.167468 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-5cced8fd-1846-40e3-9428-b887e22614bb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:22.175686 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5cced8fd-1846-40e3-9428-b887e22614bb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:22.176124 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5cced8fd-1846-40e3-9428-b887e22614bb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:22.177310 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5cced8fd-1846-40e3-9428-b887e22614bb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:22.177984 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5cced8fd-1846-40e3-9428-b887e22614bb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:22.212624 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-5cced8fd-1846-40e3-9428-b887e22614bb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053282 Jul 26 07:34:22.213178 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 490/1029] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:22 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:22.298741 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-5426f948-e34b-412c-b1ab-0853cfa3f9cb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:22.300931 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-5426f948-e34b-412c-b1ab-0853cfa3f9cb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:22.310313 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5426f948-e34b-412c-b1ab-0853cfa3f9cb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:22.311035 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5426f948-e34b-412c-b1ab-0853cfa3f9cb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:22.312242 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5426f948-e34b-412c-b1ab-0853cfa3f9cb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:22.312948 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5426f948-e34b-412c-b1ab-0853cfa3f9cb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:22.350386 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-5426f948-e34b-412c-b1ab-0853cfa3f9cb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055326 Jul 26 07:34:22.351293 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 540/1030] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:22 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:23.226517 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-58cba7ac-a21a-4b30-ad88-8ee61c9c16a5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:23.228556 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-58cba7ac-a21a-4b30-ad88-8ee61c9c16a5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:23.235581 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-58cba7ac-a21a-4b30-ad88-8ee61c9c16a5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:23.236088 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-58cba7ac-a21a-4b30-ad88-8ee61c9c16a5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:23.236839 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-58cba7ac-a21a-4b30-ad88-8ee61c9c16a5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:23.237404 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-58cba7ac-a21a-4b30-ad88-8ee61c9c16a5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:23.268557 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-58cba7ac-a21a-4b30-ad88-8ee61c9c16a5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046032 Jul 26 07:34:23.269125 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 491/1031] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:23 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:23.366571 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3fdd7193-b1e5-43b5-be0f-3026873654d4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:23.369137 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3fdd7193-b1e5-43b5-be0f-3026873654d4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:23.378966 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3fdd7193-b1e5-43b5-be0f-3026873654d4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:23.379463 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3fdd7193-b1e5-43b5-be0f-3026873654d4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:23.380616 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3fdd7193-b1e5-43b5-be0f-3026873654d4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:23.381099 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3fdd7193-b1e5-43b5-be0f-3026873654d4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:23.410249 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:23.417778 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3fdd7193-b1e5-43b5-be0f-3026873654d4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055651 Jul 26 07:34:23.418373 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 541/1032] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:23 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:24.281688 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c3817578-4dc0-4565-a4b7-84fc35c68af9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:24.283916 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c3817578-4dc0-4565-a4b7-84fc35c68af9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:24.291426 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c3817578-4dc0-4565-a4b7-84fc35c68af9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:24.291874 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c3817578-4dc0-4565-a4b7-84fc35c68af9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:24.292668 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c3817578-4dc0-4565-a4b7-84fc35c68af9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:24.293109 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c3817578-4dc0-4565-a4b7-84fc35c68af9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:24.331933 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c3817578-4dc0-4565-a4b7-84fc35c68af9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054353 Jul 26 07:34:24.332503 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 492/1033] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:24 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:24.430801 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-fd278dfc-f3f3-446a-b182-d0caaa57c7e8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:24.432996 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-fd278dfc-f3f3-446a-b182-d0caaa57c7e8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:24.440305 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fd278dfc-f3f3-446a-b182-d0caaa57c7e8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:24.440842 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fd278dfc-f3f3-446a-b182-d0caaa57c7e8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:24.441630 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fd278dfc-f3f3-446a-b182-d0caaa57c7e8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:24.442928 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fd278dfc-f3f3-446a-b182-d0caaa57c7e8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:24.475769 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-fd278dfc-f3f3-446a-b182-d0caaa57c7e8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049035 Jul 26 07:34:24.476350 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 542/1034] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:24 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:25.345467 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0df3b107-fe57-4719-90b7-2ca727853609 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:25.347684 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0df3b107-fe57-4719-90b7-2ca727853609 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:25.354661 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0df3b107-fe57-4719-90b7-2ca727853609 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:25.355110 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0df3b107-fe57-4719-90b7-2ca727853609 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:25.355892 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0df3b107-fe57-4719-90b7-2ca727853609 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:25.356325 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0df3b107-fe57-4719-90b7-2ca727853609 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:25.389425 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0df3b107-fe57-4719-90b7-2ca727853609 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048473 Jul 26 07:34:25.390031 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 493/1035] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:25 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:25.488936 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-34870614-9114-4693-a23d-3eeda1290853 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:25.491282 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-34870614-9114-4693-a23d-3eeda1290853 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:25.499059 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-34870614-9114-4693-a23d-3eeda1290853 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:25.499569 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-34870614-9114-4693-a23d-3eeda1290853 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:25.500447 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-34870614-9114-4693-a23d-3eeda1290853 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:25.500893 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-34870614-9114-4693-a23d-3eeda1290853 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:25.533461 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-34870614-9114-4693-a23d-3eeda1290853 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048717 Jul 26 07:34:25.534081 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 543/1036] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:25 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:26.402741 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-fe90561f-b9cb-4dab-aa82-07131605753f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:26.404800 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-fe90561f-b9cb-4dab-aa82-07131605753f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:26.411770 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fe90561f-b9cb-4dab-aa82-07131605753f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:26.412211 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fe90561f-b9cb-4dab-aa82-07131605753f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:26.412976 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fe90561f-b9cb-4dab-aa82-07131605753f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:26.413405 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fe90561f-b9cb-4dab-aa82-07131605753f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:26.446141 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-fe90561f-b9cb-4dab-aa82-07131605753f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047424 Jul 26 07:34:26.446719 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 494/1037] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:26 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:26.546903 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f1efceb2-a93a-4714-9949-f2a2c0debe9e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:26.549167 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f1efceb2-a93a-4714-9949-f2a2c0debe9e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:26.557148 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f1efceb2-a93a-4714-9949-f2a2c0debe9e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:26.557660 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f1efceb2-a93a-4714-9949-f2a2c0debe9e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:26.558543 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f1efceb2-a93a-4714-9949-f2a2c0debe9e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:26.559053 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f1efceb2-a93a-4714-9949-f2a2c0debe9e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:26.591584 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f1efceb2-a93a-4714-9949-f2a2c0debe9e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048408 Jul 26 07:34:26.592324 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 544/1038] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:26 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:27.462220 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8810d301-af95-496d-902d-0080500f5aae tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:27.465134 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8810d301-af95-496d-902d-0080500f5aae tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:27.474437 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8810d301-af95-496d-902d-0080500f5aae tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:27.474890 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8810d301-af95-496d-902d-0080500f5aae tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:27.475667 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8810d301-af95-496d-902d-0080500f5aae tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:27.476100 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8810d301-af95-496d-902d-0080500f5aae tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:27.511627 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8810d301-af95-496d-902d-0080500f5aae tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055729 Jul 26 07:34:27.512220 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 495/1039] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:27 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:27.608337 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-58ff8844-84f8-4e4e-83a7-f67b3b1b0be2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:27.610542 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-58ff8844-84f8-4e4e-83a7-f67b3b1b0be2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:27.618247 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-58ff8844-84f8-4e4e-83a7-f67b3b1b0be2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:27.618686 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-58ff8844-84f8-4e4e-83a7-f67b3b1b0be2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:27.619475 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-58ff8844-84f8-4e4e-83a7-f67b3b1b0be2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:27.619898 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-58ff8844-84f8-4e4e-83a7-f67b3b1b0be2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:27.656692 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-58ff8844-84f8-4e4e-83a7-f67b3b1b0be2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052494 Jul 26 07:34:27.657282 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 545/1040] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:27 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:28.525542 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-31dc6323-2991-451d-9373-67e23ea7e66c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:28.527598 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-31dc6323-2991-451d-9373-67e23ea7e66c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:28.534528 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-31dc6323-2991-451d-9373-67e23ea7e66c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:28.534965 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-31dc6323-2991-451d-9373-67e23ea7e66c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:28.535724 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-31dc6323-2991-451d-9373-67e23ea7e66c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:28.536145 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-31dc6323-2991-451d-9373-67e23ea7e66c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:28.549985 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:28.568350 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-31dc6323-2991-451d-9373-67e23ea7e66c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046904 Jul 26 07:34:28.568905 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 496/1041] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:28 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:28.669263 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a09b9edf-e525-455b-841c-16fe9d549ff3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:28.671460 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a09b9edf-e525-455b-841c-16fe9d549ff3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:28.678382 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a09b9edf-e525-455b-841c-16fe9d549ff3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:28.678799 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a09b9edf-e525-455b-841c-16fe9d549ff3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:28.679585 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a09b9edf-e525-455b-841c-16fe9d549ff3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:28.680015 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a09b9edf-e525-455b-841c-16fe9d549ff3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:28.712726 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a09b9edf-e525-455b-841c-16fe9d549ff3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047514 Jul 26 07:34:28.713530 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 546/1042] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:28 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:29.581087 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c8b9eaeb-0e46-48d6-8c5e-edd174591cc3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:29.583145 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c8b9eaeb-0e46-48d6-8c5e-edd174591cc3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:29.590486 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c8b9eaeb-0e46-48d6-8c5e-edd174591cc3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:29.590931 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c8b9eaeb-0e46-48d6-8c5e-edd174591cc3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:29.592052 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c8b9eaeb-0e46-48d6-8c5e-edd174591cc3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:29.592479 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c8b9eaeb-0e46-48d6-8c5e-edd174591cc3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:29.624098 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c8b9eaeb-0e46-48d6-8c5e-edd174591cc3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047104 Jul 26 07:34:29.624675 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 497/1043] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:29 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:29.726761 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b43dbb1c-af21-47c5-ab1e-5e63af947ee7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:29.729008 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b43dbb1c-af21-47c5-ab1e-5e63af947ee7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:29.736183 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b43dbb1c-af21-47c5-ab1e-5e63af947ee7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:29.736625 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b43dbb1c-af21-47c5-ab1e-5e63af947ee7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:29.737436 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b43dbb1c-af21-47c5-ab1e-5e63af947ee7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:29.737877 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b43dbb1c-af21-47c5-ab1e-5e63af947ee7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:29.769561 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b43dbb1c-af21-47c5-ab1e-5e63af947ee7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047085 Jul 26 07:34:29.770157 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 547/1044] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:29 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:30.638347 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-e645b721-3324-4ad9-bfd5-96eb141e1c31 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:30.640380 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-e645b721-3324-4ad9-bfd5-96eb141e1c31 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:30.647406 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e645b721-3324-4ad9-bfd5-96eb141e1c31 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:30.647838 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e645b721-3324-4ad9-bfd5-96eb141e1c31 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:30.648600 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e645b721-3324-4ad9-bfd5-96eb141e1c31 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:30.649021 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e645b721-3324-4ad9-bfd5-96eb141e1c31 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:30.679274 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-e645b721-3324-4ad9-bfd5-96eb141e1c31 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045300 Jul 26 07:34:30.679807 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 498/1045] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:30 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:30.781902 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a97a4205-e95a-47a5-9d48-cb9046b453b0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:30.784127 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a97a4205-e95a-47a5-9d48-cb9046b453b0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:30.791159 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a97a4205-e95a-47a5-9d48-cb9046b453b0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:30.791608 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a97a4205-e95a-47a5-9d48-cb9046b453b0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:30.792381 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a97a4205-e95a-47a5-9d48-cb9046b453b0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:30.792817 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a97a4205-e95a-47a5-9d48-cb9046b453b0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:30.823375 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a97a4205-e95a-47a5-9d48-cb9046b453b0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045611 Jul 26 07:34:30.823947 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 548/1046] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:30 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 07:34:31.692038 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-734af9c7-3b57-4e34-9318-e6f7db3e3b59 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:31.694269 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-734af9c7-3b57-4e34-9318-e6f7db3e3b59 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:31.701083 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-734af9c7-3b57-4e34-9318-e6f7db3e3b59 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:31.701527 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-734af9c7-3b57-4e34-9318-e6f7db3e3b59 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:31.702316 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-734af9c7-3b57-4e34-9318-e6f7db3e3b59 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:31.702739 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-734af9c7-3b57-4e34-9318-e6f7db3e3b59 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:31.735246 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-734af9c7-3b57-4e34-9318-e6f7db3e3b59 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046838 Jul 26 07:34:31.735830 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 499/1047] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:31 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:31.836748 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d593df4e-2f8f-46a4-b1c3-a4def6daeead tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:31.838961 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d593df4e-2f8f-46a4-b1c3-a4def6daeead tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:31.846310 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d593df4e-2f8f-46a4-b1c3-a4def6daeead tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:31.846767 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d593df4e-2f8f-46a4-b1c3-a4def6daeead tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:31.847550 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d593df4e-2f8f-46a4-b1c3-a4def6daeead tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:31.847981 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d593df4e-2f8f-46a4-b1c3-a4def6daeead tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:31.878810 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d593df4e-2f8f-46a4-b1c3-a4def6daeead tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046093 Jul 26 07:34:31.879394 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 549/1048] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:31 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:32.748506 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-4797baf8-51ea-4ec3-8d42-10c459ed6582 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:32.750620 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-4797baf8-51ea-4ec3-8d42-10c459ed6582 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:32.757732 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4797baf8-51ea-4ec3-8d42-10c459ed6582 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:32.758208 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4797baf8-51ea-4ec3-8d42-10c459ed6582 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:32.758979 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4797baf8-51ea-4ec3-8d42-10c459ed6582 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:32.759409 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4797baf8-51ea-4ec3-8d42-10c459ed6582 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:32.790605 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-4797baf8-51ea-4ec3-8d42-10c459ed6582 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046316 Jul 26 07:34:32.791177 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 500/1049] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:32 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:32.891846 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-aacea2aa-81ae-4a7f-9cdc-d59d46403551 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:32.894143 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-aacea2aa-81ae-4a7f-9cdc-d59d46403551 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:32.901393 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-aacea2aa-81ae-4a7f-9cdc-d59d46403551 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:32.901867 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-aacea2aa-81ae-4a7f-9cdc-d59d46403551 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:32.902645 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-aacea2aa-81ae-4a7f-9cdc-d59d46403551 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:32.903079 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-aacea2aa-81ae-4a7f-9cdc-d59d46403551 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:32.934568 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-aacea2aa-81ae-4a7f-9cdc-d59d46403551 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046737 Jul 26 07:34:32.935144 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 550/1050] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:32 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:33.803498 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f0855f27-6cf6-4636-a39b-9d5bff275310 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:33.805706 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-f0855f27-6cf6-4636-a39b-9d5bff275310 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:33.812777 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f0855f27-6cf6-4636-a39b-9d5bff275310 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:33.813224 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f0855f27-6cf6-4636-a39b-9d5bff275310 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:33.814076 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f0855f27-6cf6-4636-a39b-9d5bff275310 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:33.814505 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f0855f27-6cf6-4636-a39b-9d5bff275310 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:33.847560 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f0855f27-6cf6-4636-a39b-9d5bff275310 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047270 Jul 26 07:34:33.847560 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 501/1051] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:33 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:33.950047 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-992b460d-8a07-421e-9548-c37551eb2ad3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:33.952778 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-992b460d-8a07-421e-9548-c37551eb2ad3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:33.962274 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-992b460d-8a07-421e-9548-c37551eb2ad3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:33.962907 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-992b460d-8a07-421e-9548-c37551eb2ad3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:33.964034 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-992b460d-8a07-421e-9548-c37551eb2ad3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:33.964649 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-992b460d-8a07-421e-9548-c37551eb2ad3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:33.998529 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-992b460d-8a07-421e-9548-c37551eb2ad3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054942 Jul 26 07:34:33.999136 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 551/1052] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:33 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:34.860057 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f71fdf20-f47c-4b75-ab9d-1abd21737e38 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:34.862482 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-f71fdf20-f47c-4b75-ab9d-1abd21737e38 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:34.870478 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f71fdf20-f47c-4b75-ab9d-1abd21737e38 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:34.870922 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f71fdf20-f47c-4b75-ab9d-1abd21737e38 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:34.871699 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f71fdf20-f47c-4b75-ab9d-1abd21737e38 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:34.872123 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f71fdf20-f47c-4b75-ab9d-1abd21737e38 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:34.903896 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f71fdf20-f47c-4b75-ab9d-1abd21737e38 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047964 Jul 26 07:34:34.904495 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 502/1053] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:34 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:35.011404 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f2e6f753-7a0c-4013-822a-124f36974f70 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:35.013627 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f2e6f753-7a0c-4013-822a-124f36974f70 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:35.020661 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f2e6f753-7a0c-4013-822a-124f36974f70 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:35.021073 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f2e6f753-7a0c-4013-822a-124f36974f70 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:35.021930 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f2e6f753-7a0c-4013-822a-124f36974f70 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:35.022392 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f2e6f753-7a0c-4013-822a-124f36974f70 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:35.055487 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f2e6f753-7a0c-4013-822a-124f36974f70 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048061 Jul 26 07:34:35.056071 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 552/1054] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:35 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:35.917290 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a2dbe80e-9635-44f0-91a7-d0c030fff884 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:35.919493 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a2dbe80e-9635-44f0-91a7-d0c030fff884 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:35.926833 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a2dbe80e-9635-44f0-91a7-d0c030fff884 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:35.927284 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a2dbe80e-9635-44f0-91a7-d0c030fff884 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:35.928113 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a2dbe80e-9635-44f0-91a7-d0c030fff884 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:35.928551 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a2dbe80e-9635-44f0-91a7-d0c030fff884 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:35.960120 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a2dbe80e-9635-44f0-91a7-d0c030fff884 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046839 Jul 26 07:34:35.960622 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 503/1055] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:35 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:36.068996 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-fa873851-8002-4989-a86b-f783d3d77727 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:36.071235 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-fa873851-8002-4989-a86b-f783d3d77727 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:36.078417 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fa873851-8002-4989-a86b-f783d3d77727 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:36.078892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fa873851-8002-4989-a86b-f783d3d77727 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:36.079668 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fa873851-8002-4989-a86b-f783d3d77727 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:36.080094 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fa873851-8002-4989-a86b-f783d3d77727 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:36.111586 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-fa873851-8002-4989-a86b-f783d3d77727 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046687 Jul 26 07:34:36.112142 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 553/1056] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:36 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:36.973686 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-91691e7b-5050-474b-bfeb-e7232bfb2a55 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:36.975870 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-91691e7b-5050-474b-bfeb-e7232bfb2a55 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:36.983186 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-91691e7b-5050-474b-bfeb-e7232bfb2a55 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:36.983644 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-91691e7b-5050-474b-bfeb-e7232bfb2a55 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:36.984423 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-91691e7b-5050-474b-bfeb-e7232bfb2a55 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:36.984859 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-91691e7b-5050-474b-bfeb-e7232bfb2a55 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:37.018688 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-91691e7b-5050-474b-bfeb-e7232bfb2a55 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049284 Jul 26 07:34:37.019299 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 504/1057] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:36 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:37.125057 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-bed9e0f1-0e87-4e4e-bf18-be2eb9fa007f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:37.127348 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-bed9e0f1-0e87-4e4e-bf18-be2eb9fa007f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:37.134826 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bed9e0f1-0e87-4e4e-bf18-be2eb9fa007f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:37.135321 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bed9e0f1-0e87-4e4e-bf18-be2eb9fa007f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:37.136292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bed9e0f1-0e87-4e4e-bf18-be2eb9fa007f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:37.136756 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bed9e0f1-0e87-4e4e-bf18-be2eb9fa007f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:37.172713 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-bed9e0f1-0e87-4e4e-bf18-be2eb9fa007f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051815 Jul 26 07:34:37.173311 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 554/1058] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:37 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:38.032119 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f3a9180d-8d3f-493b-9db4-2246e8ad79e4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:38.034390 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-f3a9180d-8d3f-493b-9db4-2246e8ad79e4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:38.042260 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f3a9180d-8d3f-493b-9db4-2246e8ad79e4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:38.042704 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f3a9180d-8d3f-493b-9db4-2246e8ad79e4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:38.043503 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f3a9180d-8d3f-493b-9db4-2246e8ad79e4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:38.043942 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f3a9180d-8d3f-493b-9db4-2246e8ad79e4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:38.076339 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f3a9180d-8d3f-493b-9db4-2246e8ad79e4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048678 Jul 26 07:34:38.076935 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 505/1059] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:38 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:38.188765 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3fe7ef37-0ac1-4f5f-9be1-c4bed922f54d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:38.191904 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3fe7ef37-0ac1-4f5f-9be1-c4bed922f54d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:38.203604 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3fe7ef37-0ac1-4f5f-9be1-c4bed922f54d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:38.204358 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3fe7ef37-0ac1-4f5f-9be1-c4bed922f54d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:38.205694 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3fe7ef37-0ac1-4f5f-9be1-c4bed922f54d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:38.206630 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3fe7ef37-0ac1-4f5f-9be1-c4bed922f54d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:38.244857 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3fe7ef37-0ac1-4f5f-9be1-c4bed922f54d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060220 Jul 26 07:34:38.245428 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 555/1060] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:38 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:39.092697 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-dc291e66-c362-46c7-b351-be9e90f8df0e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:39.095024 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-dc291e66-c362-46c7-b351-be9e90f8df0e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:39.097810 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=58 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:39.103853 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dc291e66-c362-46c7-b351-be9e90f8df0e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:39.104305 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dc291e66-c362-46c7-b351-be9e90f8df0e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:39.105102 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dc291e66-c362-46c7-b351-be9e90f8df0e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:39.105535 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dc291e66-c362-46c7-b351-be9e90f8df0e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:39.138914 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-dc291e66-c362-46c7-b351-be9e90f8df0e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050768 Jul 26 07:34:39.139570 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 506/1061] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:39 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:39.257854 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-4f3ed689-611b-4eb2-bef7-00e446743d16 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:39.260449 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-4f3ed689-611b-4eb2-bef7-00e446743d16 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:39.268158 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4f3ed689-611b-4eb2-bef7-00e446743d16 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:39.268610 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4f3ed689-611b-4eb2-bef7-00e446743d16 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:39.269442 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4f3ed689-611b-4eb2-bef7-00e446743d16 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:39.269958 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4f3ed689-611b-4eb2-bef7-00e446743d16 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:39.305189 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-4f3ed689-611b-4eb2-bef7-00e446743d16 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051426 Jul 26 07:34:39.305854 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 556/1062] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:39 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:40.152275 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-157d8be0-c7d8-4497-b4f3-f8efbccf809b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:40.154392 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-157d8be0-c7d8-4497-b4f3-f8efbccf809b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:40.161202 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-157d8be0-c7d8-4497-b4f3-f8efbccf809b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:40.161663 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-157d8be0-c7d8-4497-b4f3-f8efbccf809b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:40.162539 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-157d8be0-c7d8-4497-b4f3-f8efbccf809b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:40.162966 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-157d8be0-c7d8-4497-b4f3-f8efbccf809b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:40.194018 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-157d8be0-c7d8-4497-b4f3-f8efbccf809b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045830 Jul 26 07:34:40.194595 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 507/1063] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:40 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:40.318308 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-dbc91249-bf63-428c-a42b-5cddccf5dcba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:40.320532 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-dbc91249-bf63-428c-a42b-5cddccf5dcba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:40.322992 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=58 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:40.328986 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dbc91249-bf63-428c-a42b-5cddccf5dcba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:40.329504 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dbc91249-bf63-428c-a42b-5cddccf5dcba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:40.330320 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dbc91249-bf63-428c-a42b-5cddccf5dcba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:40.330751 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dbc91249-bf63-428c-a42b-5cddccf5dcba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:40.362077 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-dbc91249-bf63-428c-a42b-5cddccf5dcba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047717 Jul 26 07:34:40.362661 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 557/1064] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:40 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:41.207168 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0de01a14-38fb-41c3-aaaa-8976ee99e6c6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:41.209479 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0de01a14-38fb-41c3-aaaa-8976ee99e6c6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:41.217106 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0de01a14-38fb-41c3-aaaa-8976ee99e6c6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:41.217531 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0de01a14-38fb-41c3-aaaa-8976ee99e6c6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:41.218353 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0de01a14-38fb-41c3-aaaa-8976ee99e6c6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:41.218779 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0de01a14-38fb-41c3-aaaa-8976ee99e6c6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:41.251227 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0de01a14-38fb-41c3-aaaa-8976ee99e6c6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048181 Jul 26 07:34:41.251806 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 508/1065] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:41 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:41.376005 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-69024698-9e46-471d-981b-9f930cf2a5de tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:41.378191 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-69024698-9e46-471d-981b-9f930cf2a5de tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:41.385111 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-69024698-9e46-471d-981b-9f930cf2a5de tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:41.385558 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-69024698-9e46-471d-981b-9f930cf2a5de tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:41.386356 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-69024698-9e46-471d-981b-9f930cf2a5de tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:41.386785 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-69024698-9e46-471d-981b-9f930cf2a5de tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:41.402541 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:41.420602 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-69024698-9e46-471d-981b-9f930cf2a5de tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048661 Jul 26 07:34:41.421194 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 558/1066] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:41 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:42.268478 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-dddac8a3-5ef9-4a67-9f97-7b14d398587d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:42.271322 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-dddac8a3-5ef9-4a67-9f97-7b14d398587d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:42.279755 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dddac8a3-5ef9-4a67-9f97-7b14d398587d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:42.280313 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dddac8a3-5ef9-4a67-9f97-7b14d398587d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:42.281251 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dddac8a3-5ef9-4a67-9f97-7b14d398587d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:42.281901 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dddac8a3-5ef9-4a67-9f97-7b14d398587d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:42.315276 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-dddac8a3-5ef9-4a67-9f97-7b14d398587d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053779 Jul 26 07:34:42.315837 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 509/1067] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:42 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:42.433788 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-41d5eb3f-6211-4260-bcb5-7df700e83665 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:42.435949 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-41d5eb3f-6211-4260-bcb5-7df700e83665 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:42.444274 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-41d5eb3f-6211-4260-bcb5-7df700e83665 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:42.444965 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-41d5eb3f-6211-4260-bcb5-7df700e83665 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:42.446019 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-41d5eb3f-6211-4260-bcb5-7df700e83665 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:42.446452 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-41d5eb3f-6211-4260-bcb5-7df700e83665 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:42.478040 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-41d5eb3f-6211-4260-bcb5-7df700e83665 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048700 Jul 26 07:34:42.478588 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 559/1068] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:42 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:43.328297 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ccaf356a-f6c9-4cd9-90f6-afba6a2d1992 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:43.330676 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ccaf356a-f6c9-4cd9-90f6-afba6a2d1992 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:43.337763 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ccaf356a-f6c9-4cd9-90f6-afba6a2d1992 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:43.338219 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ccaf356a-f6c9-4cd9-90f6-afba6a2d1992 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:43.338995 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ccaf356a-f6c9-4cd9-90f6-afba6a2d1992 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:43.339427 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ccaf356a-f6c9-4cd9-90f6-afba6a2d1992 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:43.372367 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ccaf356a-f6c9-4cd9-90f6-afba6a2d1992 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048128 Jul 26 07:34:43.372960 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 510/1069] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:43 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:43.491882 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-07509ab8-d015-4609-8ea1-97e548daff05 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:43.494444 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-07509ab8-d015-4609-8ea1-97e548daff05 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:43.503176 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-07509ab8-d015-4609-8ea1-97e548daff05 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:43.503591 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-07509ab8-d015-4609-8ea1-97e548daff05 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:43.504380 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-07509ab8-d015-4609-8ea1-97e548daff05 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:43.504803 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-07509ab8-d015-4609-8ea1-97e548daff05 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:43.537684 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-07509ab8-d015-4609-8ea1-97e548daff05 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050576 Jul 26 07:34:43.538326 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 560/1070] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:43 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:44.385424 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9bbebbe2-26e1-4fa0-b47d-6ff1dfc13358 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:44.387744 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-9bbebbe2-26e1-4fa0-b47d-6ff1dfc13358 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:44.394726 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9bbebbe2-26e1-4fa0-b47d-6ff1dfc13358 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:44.395170 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9bbebbe2-26e1-4fa0-b47d-6ff1dfc13358 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:44.395950 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9bbebbe2-26e1-4fa0-b47d-6ff1dfc13358 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:44.396416 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9bbebbe2-26e1-4fa0-b47d-6ff1dfc13358 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:44.429046 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-9bbebbe2-26e1-4fa0-b47d-6ff1dfc13358 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047823 Jul 26 07:34:44.429632 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 511/1071] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:44 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:44.550889 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-47d97cd0-0aeb-44cd-a448-2828c6396223 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:44.553084 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-47d97cd0-0aeb-44cd-a448-2828c6396223 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:44.559898 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-47d97cd0-0aeb-44cd-a448-2828c6396223 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:44.560338 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-47d97cd0-0aeb-44cd-a448-2828c6396223 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:44.561109 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-47d97cd0-0aeb-44cd-a448-2828c6396223 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:44.561536 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-47d97cd0-0aeb-44cd-a448-2828c6396223 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:44.593937 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-47d97cd0-0aeb-44cd-a448-2828c6396223 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047119 Jul 26 07:34:44.594501 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 561/1072] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:44 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:45.441529 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-3d417e0e-2cc7-4c0a-94e9-84a13b7eea9f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:45.444592 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-3d417e0e-2cc7-4c0a-94e9-84a13b7eea9f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:45.455732 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3d417e0e-2cc7-4c0a-94e9-84a13b7eea9f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:45.456181 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3d417e0e-2cc7-4c0a-94e9-84a13b7eea9f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:45.456939 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3d417e0e-2cc7-4c0a-94e9-84a13b7eea9f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:45.457357 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3d417e0e-2cc7-4c0a-94e9-84a13b7eea9f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:45.502457 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-3d417e0e-2cc7-4c0a-94e9-84a13b7eea9f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065449 Jul 26 07:34:45.503155 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 512/1073] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:45 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:45.607027 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-45e30489-8954-4d21-ac17-f1a57b945664 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:45.609214 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-45e30489-8954-4d21-ac17-f1a57b945664 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:45.616703 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-45e30489-8954-4d21-ac17-f1a57b945664 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:45.617152 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-45e30489-8954-4d21-ac17-f1a57b945664 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:45.618021 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-45e30489-8954-4d21-ac17-f1a57b945664 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:45.618897 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-45e30489-8954-4d21-ac17-f1a57b945664 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:45.651376 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-45e30489-8954-4d21-ac17-f1a57b945664 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048498 Jul 26 07:34:45.651942 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 562/1074] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:45 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:46.515479 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-1e702288-290a-4337-b9ca-2b489665f0d6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:46.517718 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-1e702288-290a-4337-b9ca-2b489665f0d6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:46.524818 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1e702288-290a-4337-b9ca-2b489665f0d6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:46.525260 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1e702288-290a-4337-b9ca-2b489665f0d6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:46.526098 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1e702288-290a-4337-b9ca-2b489665f0d6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:46.526526 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1e702288-290a-4337-b9ca-2b489665f0d6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:46.529261 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:46.559102 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-1e702288-290a-4337-b9ca-2b489665f0d6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047553 Jul 26 07:34:46.559676 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 513/1075] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:46 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:46.664349 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-710c8a08-4275-4a81-91c2-fb45e79ef2c2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:46.666569 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-710c8a08-4275-4a81-91c2-fb45e79ef2c2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:46.673519 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-710c8a08-4275-4a81-91c2-fb45e79ef2c2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:46.674016 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-710c8a08-4275-4a81-91c2-fb45e79ef2c2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:46.674799 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-710c8a08-4275-4a81-91c2-fb45e79ef2c2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:46.675235 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-710c8a08-4275-4a81-91c2-fb45e79ef2c2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:46.709516 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-710c8a08-4275-4a81-91c2-fb45e79ef2c2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049173 Jul 26 07:34:46.710158 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 563/1076] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:46 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:47.571785 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f3111d64-4e60-44f6-8df9-c87919b6156b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:47.574116 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-f3111d64-4e60-44f6-8df9-c87919b6156b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:47.581295 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f3111d64-4e60-44f6-8df9-c87919b6156b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:47.581768 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f3111d64-4e60-44f6-8df9-c87919b6156b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:47.582548 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f3111d64-4e60-44f6-8df9-c87919b6156b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:47.582987 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f3111d64-4e60-44f6-8df9-c87919b6156b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:47.616160 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f3111d64-4e60-44f6-8df9-c87919b6156b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048739 Jul 26 07:34:47.616739 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 514/1077] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:47 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:47.722685 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6e95040b-cb95-486a-a533-98b43e4be8d0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:47.725008 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-6e95040b-cb95-486a-a533-98b43e4be8d0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:47.732478 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6e95040b-cb95-486a-a533-98b43e4be8d0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:47.732948 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6e95040b-cb95-486a-a533-98b43e4be8d0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:47.733786 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6e95040b-cb95-486a-a533-98b43e4be8d0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:47.734209 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6e95040b-cb95-486a-a533-98b43e4be8d0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:47.766312 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6e95040b-cb95-486a-a533-98b43e4be8d0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047567 Jul 26 07:34:47.766902 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 564/1078] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:47 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:48.630579 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-3b6c4849-acce-433e-813d-371f26238941 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:48.633281 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-3b6c4849-acce-433e-813d-371f26238941 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:48.643281 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3b6c4849-acce-433e-813d-371f26238941 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:48.643978 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3b6c4849-acce-433e-813d-371f26238941 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:48.645116 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3b6c4849-acce-433e-813d-371f26238941 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:48.645548 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3b6c4849-acce-433e-813d-371f26238941 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:48.677006 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-3b6c4849-acce-433e-813d-371f26238941 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051790 Jul 26 07:34:48.677683 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 515/1079] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:48 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:48.780147 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-5895a016-375a-4547-bd6e-aa99776d76c5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:48.782318 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-5895a016-375a-4547-bd6e-aa99776d76c5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:48.789317 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5895a016-375a-4547-bd6e-aa99776d76c5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:48.789770 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5895a016-375a-4547-bd6e-aa99776d76c5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:48.790636 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5895a016-375a-4547-bd6e-aa99776d76c5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:48.791059 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5895a016-375a-4547-bd6e-aa99776d76c5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:48.822792 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-5895a016-375a-4547-bd6e-aa99776d76c5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047380 Jul 26 07:34:48.823392 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 565/1080] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:48 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:49.695050 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-cc62e969-208b-4d10-8806-0e7ea1c34ee6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:49.698754 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-cc62e969-208b-4d10-8806-0e7ea1c34ee6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:49.710839 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cc62e969-208b-4d10-8806-0e7ea1c34ee6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:49.711641 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cc62e969-208b-4d10-8806-0e7ea1c34ee6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:49.713050 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cc62e969-208b-4d10-8806-0e7ea1c34ee6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:49.713892 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cc62e969-208b-4d10-8806-0e7ea1c34ee6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:49.770763 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-cc62e969-208b-4d10-8806-0e7ea1c34ee6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083474 Jul 26 07:34:49.771831 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 516/1081] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:49 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:49.835379 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e7c10af4-d9a6-44bf-ac4d-dd39d8619224 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:49.837584 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e7c10af4-d9a6-44bf-ac4d-dd39d8619224 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:49.845022 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e7c10af4-d9a6-44bf-ac4d-dd39d8619224 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:49.845500 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e7c10af4-d9a6-44bf-ac4d-dd39d8619224 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:49.846521 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e7c10af4-d9a6-44bf-ac4d-dd39d8619224 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:49.846949 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e7c10af4-d9a6-44bf-ac4d-dd39d8619224 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:49.878089 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e7c10af4-d9a6-44bf-ac4d-dd39d8619224 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047021 Jul 26 07:34:49.878664 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 566/1082] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:49 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:50.789104 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-fc376551-3776-4e53-9c98-19aaa70cd44e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:50.792029 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-fc376551-3776-4e53-9c98-19aaa70cd44e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:50.801769 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fc376551-3776-4e53-9c98-19aaa70cd44e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:50.802606 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fc376551-3776-4e53-9c98-19aaa70cd44e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:50.803259 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fc376551-3776-4e53-9c98-19aaa70cd44e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:50.803740 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fc376551-3776-4e53-9c98-19aaa70cd44e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:50.845615 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-fc376551-3776-4e53-9c98-19aaa70cd44e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062067 Jul 26 07:34:50.846526 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 517/1083] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:50 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:50.894687 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-93db9eaf-239f-42d9-ade1-9f54ed4b6478 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:50.897098 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-93db9eaf-239f-42d9-ade1-9f54ed4b6478 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:50.904585 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-93db9eaf-239f-42d9-ade1-9f54ed4b6478 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:50.905039 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-93db9eaf-239f-42d9-ade1-9f54ed4b6478 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:50.905848 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-93db9eaf-239f-42d9-ade1-9f54ed4b6478 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:50.906282 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-93db9eaf-239f-42d9-ade1-9f54ed4b6478 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:50.940214 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-93db9eaf-239f-42d9-ade1-9f54ed4b6478 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049944 Jul 26 07:34:50.940788 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 567/1084] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:50 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:51.861052 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-357238ba-be11-4689-bf8e-212d561ae08e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:51.863297 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-357238ba-be11-4689-bf8e-212d561ae08e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:51.870271 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-357238ba-be11-4689-bf8e-212d561ae08e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:51.870728 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-357238ba-be11-4689-bf8e-212d561ae08e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:51.871499 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-357238ba-be11-4689-bf8e-212d561ae08e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:51.871933 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-357238ba-be11-4689-bf8e-212d561ae08e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:51.907052 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-357238ba-be11-4689-bf8e-212d561ae08e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050526 Jul 26 07:34:51.907630 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 518/1085] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:51 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:51.953898 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f8c3f560-b151-409c-ba6c-82f8176b73a9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:51.956469 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f8c3f560-b151-409c-ba6c-82f8176b73a9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:51.963475 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f8c3f560-b151-409c-ba6c-82f8176b73a9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:51.963920 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f8c3f560-b151-409c-ba6c-82f8176b73a9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:51.964698 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f8c3f560-b151-409c-ba6c-82f8176b73a9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:51.965131 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f8c3f560-b151-409c-ba6c-82f8176b73a9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:51.997921 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f8c3f560-b151-409c-ba6c-82f8176b73a9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048810 Jul 26 07:34:51.998488 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 568/1086] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:51 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 07:34:52.920868 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9ab9253b-63ce-4156-9381-bcde6bf16f4a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:52.923184 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-9ab9253b-63ce-4156-9381-bcde6bf16f4a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:52.930724 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9ab9253b-63ce-4156-9381-bcde6bf16f4a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:52.931166 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9ab9253b-63ce-4156-9381-bcde6bf16f4a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:52.931938 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9ab9253b-63ce-4156-9381-bcde6bf16f4a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:52.932350 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9ab9253b-63ce-4156-9381-bcde6bf16f4a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:52.963603 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-9ab9253b-63ce-4156-9381-bcde6bf16f4a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046593 Jul 26 07:34:52.964091 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 519/1087] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:52 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:53.011148 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e3f994dd-b044-4825-aa4c-6c8385992597 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:53.013277 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e3f994dd-b044-4825-aa4c-6c8385992597 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:53.020056 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e3f994dd-b044-4825-aa4c-6c8385992597 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:53.020497 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e3f994dd-b044-4825-aa4c-6c8385992597 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:53.021437 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e3f994dd-b044-4825-aa4c-6c8385992597 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:53.021906 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e3f994dd-b044-4825-aa4c-6c8385992597 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:53.052882 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e3f994dd-b044-4825-aa4c-6c8385992597 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045740 Jul 26 07:34:53.053450 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 569/1088] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:53 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:53.975758 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d60649e2-d932-4611-bc56-a3f71def84a0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:53.978020 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d60649e2-d932-4611-bc56-a3f71def84a0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:53.985302 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d60649e2-d932-4611-bc56-a3f71def84a0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:53.985770 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d60649e2-d932-4611-bc56-a3f71def84a0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:53.986536 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d60649e2-d932-4611-bc56-a3f71def84a0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:53.986973 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d60649e2-d932-4611-bc56-a3f71def84a0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:54.020305 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d60649e2-d932-4611-bc56-a3f71def84a0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048512 Jul 26 07:34:54.020895 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 520/1089] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:53 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:54.066143 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9b505a13-e933-495b-9532-d6338bdb8842 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:54.068770 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-9b505a13-e933-495b-9532-d6338bdb8842 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:54.076033 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9b505a13-e933-495b-9532-d6338bdb8842 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:54.076475 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9b505a13-e933-495b-9532-d6338bdb8842 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:54.077250 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9b505a13-e933-495b-9532-d6338bdb8842 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:54.077685 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9b505a13-e933-495b-9532-d6338bdb8842 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:54.110931 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-9b505a13-e933-495b-9532-d6338bdb8842 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048935 Jul 26 07:34:54.111518 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 570/1090] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:54 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 07:34:55.039874 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b005c936-35cc-40fd-b0c5-043bfcb65d5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:55.042055 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-b005c936-35cc-40fd-b0c5-043bfcb65d5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:55.048977 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b005c936-35cc-40fd-b0c5-043bfcb65d5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:55.049425 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b005c936-35cc-40fd-b0c5-043bfcb65d5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:55.050229 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b005c936-35cc-40fd-b0c5-043bfcb65d5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:55.050670 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b005c936-35cc-40fd-b0c5-043bfcb65d5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:55.083048 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b005c936-35cc-40fd-b0c5-043bfcb65d5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049516 Jul 26 07:34:55.083620 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 521/1091] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:55 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:55.123855 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-55e797b3-8446-4e69-9cae-b65ca0071e5c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:55.126040 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-55e797b3-8446-4e69-9cae-b65ca0071e5c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:55.133177 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-55e797b3-8446-4e69-9cae-b65ca0071e5c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:55.133618 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-55e797b3-8446-4e69-9cae-b65ca0071e5c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:55.134419 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-55e797b3-8446-4e69-9cae-b65ca0071e5c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:55.134850 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-55e797b3-8446-4e69-9cae-b65ca0071e5c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:55.166696 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-55e797b3-8446-4e69-9cae-b65ca0071e5c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046800 Jul 26 07:34:55.167245 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 571/1092] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:55 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:56.096315 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b6af390b-af69-4d35-b3a5-931a6d88bdf4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:56.098526 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-b6af390b-af69-4d35-b3a5-931a6d88bdf4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:56.105972 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b6af390b-af69-4d35-b3a5-931a6d88bdf4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:56.106419 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b6af390b-af69-4d35-b3a5-931a6d88bdf4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:56.107197 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b6af390b-af69-4d35-b3a5-931a6d88bdf4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:56.107628 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b6af390b-af69-4d35-b3a5-931a6d88bdf4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:56.139625 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b6af390b-af69-4d35-b3a5-931a6d88bdf4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047430 Jul 26 07:34:56.140201 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 522/1093] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:56 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:56.180891 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b3c3dee8-8ef9-49b0-85d5-a1905e029068 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:56.183074 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b3c3dee8-8ef9-49b0-85d5-a1905e029068 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:56.190120 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b3c3dee8-8ef9-49b0-85d5-a1905e029068 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:56.190595 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b3c3dee8-8ef9-49b0-85d5-a1905e029068 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:56.191341 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b3c3dee8-8ef9-49b0-85d5-a1905e029068 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:56.191768 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b3c3dee8-8ef9-49b0-85d5-a1905e029068 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:56.223405 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b3c3dee8-8ef9-49b0-85d5-a1905e029068 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046840 Jul 26 07:34:56.224251 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 572/1094] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:56 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:57.154736 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8a5176c2-6dcf-4845-ad90-a99539158bfb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:57.156843 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8a5176c2-6dcf-4845-ad90-a99539158bfb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:57.164435 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8a5176c2-6dcf-4845-ad90-a99539158bfb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:57.164880 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8a5176c2-6dcf-4845-ad90-a99539158bfb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:57.165660 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8a5176c2-6dcf-4845-ad90-a99539158bfb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:57.166099 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8a5176c2-6dcf-4845-ad90-a99539158bfb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:57.198720 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8a5176c2-6dcf-4845-ad90-a99539158bfb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050001 Jul 26 07:34:57.199299 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 523/1095] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:57 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:57.237390 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-bc854c71-5005-491e-860f-c5e398cf725b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:57.240495 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-bc854c71-5005-491e-860f-c5e398cf725b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:57.247503 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bc854c71-5005-491e-860f-c5e398cf725b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:57.248048 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bc854c71-5005-491e-860f-c5e398cf725b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:57.248718 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bc854c71-5005-491e-860f-c5e398cf725b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:57.249172 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bc854c71-5005-491e-860f-c5e398cf725b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:57.279888 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-bc854c71-5005-491e-860f-c5e398cf725b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047443 Jul 26 07:34:57.280463 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 573/1096] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:57 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:58.212100 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-4644a701-222a-495b-abe6-f6a4cf179e68 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:58.214338 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-4644a701-222a-495b-abe6-f6a4cf179e68 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:58.222239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4644a701-222a-495b-abe6-f6a4cf179e68 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:58.222825 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4644a701-222a-495b-abe6-f6a4cf179e68 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:58.223831 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4644a701-222a-495b-abe6-f6a4cf179e68 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:58.224324 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4644a701-222a-495b-abe6-f6a4cf179e68 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:58.260907 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-4644a701-222a-495b-abe6-f6a4cf179e68 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053139 Jul 26 07:34:58.261541 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 524/1097] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:58 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:58.292822 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f959aff0-fe36-40a3-8086-8889dcfbfc00 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:58.295019 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f959aff0-fe36-40a3-8086-8889dcfbfc00 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:58.301963 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f959aff0-fe36-40a3-8086-8889dcfbfc00 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:58.302414 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f959aff0-fe36-40a3-8086-8889dcfbfc00 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:58.303172 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f959aff0-fe36-40a3-8086-8889dcfbfc00 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:58.303615 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f959aff0-fe36-40a3-8086-8889dcfbfc00 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:58.333847 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f959aff0-fe36-40a3-8086-8889dcfbfc00 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045005 Jul 26 07:34:58.334393 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 574/1098] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:58 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:34:59.274078 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-59545ca9-c7f2-4774-a81c-365722fc4a93 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:59.276444 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-59545ca9-c7f2-4774-a81c-365722fc4a93 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:59.283678 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-59545ca9-c7f2-4774-a81c-365722fc4a93 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:59.284113 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-59545ca9-c7f2-4774-a81c-365722fc4a93 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:59.284894 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-59545ca9-c7f2-4774-a81c-365722fc4a93 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:59.285308 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-59545ca9-c7f2-4774-a81c-365722fc4a93 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:59.319661 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-59545ca9-c7f2-4774-a81c-365722fc4a93 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049796 Jul 26 07:34:59.320266 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 525/1099] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:34:59 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:34:59.347941 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-927cab3f-ce81-4212-91fd-f049c25229fc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:34:59.350196 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-927cab3f-ce81-4212-91fd-f049c25229fc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:34:59.357365 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-927cab3f-ce81-4212-91fd-f049c25229fc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:59.357942 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-927cab3f-ce81-4212-91fd-f049c25229fc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:59.358720 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-927cab3f-ce81-4212-91fd-f049c25229fc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:34:59.359449 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-927cab3f-ce81-4212-91fd-f049c25229fc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:34:59.362329 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:59.392614 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-927cab3f-ce81-4212-91fd-f049c25229fc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049338 Jul 26 07:34:59.393174 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 575/1100] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:34:59 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:35:00.332600 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-29d28018-13c7-49d0-87e9-03e8a66fd72d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:00.334779 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-29d28018-13c7-49d0-87e9-03e8a66fd72d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:00.342940 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-29d28018-13c7-49d0-87e9-03e8a66fd72d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:00.343368 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-29d28018-13c7-49d0-87e9-03e8a66fd72d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:00.344131 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-29d28018-13c7-49d0-87e9-03e8a66fd72d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:00.344562 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-29d28018-13c7-49d0-87e9-03e8a66fd72d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:00.374825 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-29d28018-13c7-49d0-87e9-03e8a66fd72d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046204 Jul 26 07:35:00.375382 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 526/1101] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:00 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:00.406272 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-5233d5c4-a3b3-4aaa-87fa-aeb4169e6bb2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:00.408479 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-5233d5c4-a3b3-4aaa-87fa-aeb4169e6bb2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:00.415071 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5233d5c4-a3b3-4aaa-87fa-aeb4169e6bb2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:00.415520 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5233d5c4-a3b3-4aaa-87fa-aeb4169e6bb2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:00.416296 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5233d5c4-a3b3-4aaa-87fa-aeb4169e6bb2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:00.416721 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5233d5c4-a3b3-4aaa-87fa-aeb4169e6bb2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:00.448557 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-5233d5c4-a3b3-4aaa-87fa-aeb4169e6bb2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046666 Jul 26 07:35:00.449162 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 576/1102] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:35:00 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:35:01.387207 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ceb23022-4320-4755-977d-ce5f1159cee9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:01.389308 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ceb23022-4320-4755-977d-ce5f1159cee9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:01.396265 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ceb23022-4320-4755-977d-ce5f1159cee9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:01.396704 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ceb23022-4320-4755-977d-ce5f1159cee9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:01.397468 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ceb23022-4320-4755-977d-ce5f1159cee9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:01.397933 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ceb23022-4320-4755-977d-ce5f1159cee9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:01.430715 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ceb23022-4320-4755-977d-ce5f1159cee9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047589 Jul 26 07:35:01.431311 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 527/1103] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:01 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:01.461073 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a0b74f08-aa54-43b3-9ed7-ef5915e85348 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:01.463354 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a0b74f08-aa54-43b3-9ed7-ef5915e85348 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:01.470799 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a0b74f08-aa54-43b3-9ed7-ef5915e85348 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:01.471242 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a0b74f08-aa54-43b3-9ed7-ef5915e85348 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:01.472003 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a0b74f08-aa54-43b3-9ed7-ef5915e85348 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:01.472425 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a0b74f08-aa54-43b3-9ed7-ef5915e85348 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:01.505139 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a0b74f08-aa54-43b3-9ed7-ef5915e85348 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048179 Jul 26 07:35:01.505724 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 577/1104] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:35:01 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:35:02.448223 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f7aaa69f-e624-4681-b82d-f6d1c0ab02d9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:02.450492 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-f7aaa69f-e624-4681-b82d-f6d1c0ab02d9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:02.457946 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f7aaa69f-e624-4681-b82d-f6d1c0ab02d9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:02.458401 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f7aaa69f-e624-4681-b82d-f6d1c0ab02d9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:02.459196 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f7aaa69f-e624-4681-b82d-f6d1c0ab02d9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:02.459633 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f7aaa69f-e624-4681-b82d-f6d1c0ab02d9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:02.491275 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f7aaa69f-e624-4681-b82d-f6d1c0ab02d9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051412 Jul 26 07:35:02.491846 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 528/1105] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:02 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:02.519352 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b53f1b72-5dd0-4357-9fd4-151c591e6bad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:02.521531 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b53f1b72-5dd0-4357-9fd4-151c591e6bad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:02.528216 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b53f1b72-5dd0-4357-9fd4-151c591e6bad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:02.528655 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b53f1b72-5dd0-4357-9fd4-151c591e6bad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:02.529407 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b53f1b72-5dd0-4357-9fd4-151c591e6bad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:02.529893 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b53f1b72-5dd0-4357-9fd4-151c591e6bad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:02.561282 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b53f1b72-5dd0-4357-9fd4-151c591e6bad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046053 Jul 26 07:35:02.562544 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 578/1106] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:35:02 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:35:03.503594 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-83387e5d-b780-4a38-9cdd-26017682480a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:03.505885 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-83387e5d-b780-4a38-9cdd-26017682480a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:03.512809 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-83387e5d-b780-4a38-9cdd-26017682480a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:03.513343 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-83387e5d-b780-4a38-9cdd-26017682480a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:03.514066 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-83387e5d-b780-4a38-9cdd-26017682480a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:03.514681 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-83387e5d-b780-4a38-9cdd-26017682480a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:03.538830 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:03.545420 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-83387e5d-b780-4a38-9cdd-26017682480a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045836 Jul 26 07:35:03.546007 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 529/1107] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:03 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:03.576891 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-861ba7a3-cea4-4947-b733-3fa5b7170a3c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:03.579995 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-861ba7a3-cea4-4947-b733-3fa5b7170a3c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:03.588263 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-861ba7a3-cea4-4947-b733-3fa5b7170a3c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:03.588710 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-861ba7a3-cea4-4947-b733-3fa5b7170a3c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:03.589486 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-861ba7a3-cea4-4947-b733-3fa5b7170a3c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:03.589959 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-861ba7a3-cea4-4947-b733-3fa5b7170a3c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:03.621077 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-861ba7a3-cea4-4947-b733-3fa5b7170a3c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050270 Jul 26 07:35:03.621638 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 579/1108] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:35:03 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:35:04.561714 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-78fc97c0-1223-4423-9981-4150a59a4d05 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:04.564475 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-78fc97c0-1223-4423-9981-4150a59a4d05 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:04.574629 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-78fc97c0-1223-4423-9981-4150a59a4d05 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:04.575003 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-78fc97c0-1223-4423-9981-4150a59a4d05 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:04.575777 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-78fc97c0-1223-4423-9981-4150a59a4d05 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:04.576187 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-78fc97c0-1223-4423-9981-4150a59a4d05 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:04.607900 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-78fc97c0-1223-4423-9981-4150a59a4d05 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052330 Jul 26 07:35:04.608445 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 530/1109] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:04 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 07:35:04.637506 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-706f8418-baa3-4c54-a56e-d441678f7780 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:04.639785 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-706f8418-baa3-4c54-a56e-d441678f7780 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:04.647578 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-706f8418-baa3-4c54-a56e-d441678f7780 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:04.648025 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-706f8418-baa3-4c54-a56e-d441678f7780 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:04.648789 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-706f8418-baa3-4c54-a56e-d441678f7780 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:04.649213 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-706f8418-baa3-4c54-a56e-d441678f7780 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:04.686453 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-706f8418-baa3-4c54-a56e-d441678f7780 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055346 Jul 26 07:35:04.687077 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 580/1110] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:35:04 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:35:05.620555 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7b8eacc2-cebb-4049-9562-1505e4a162e7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:05.622681 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7b8eacc2-cebb-4049-9562-1505e4a162e7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:05.629549 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7b8eacc2-cebb-4049-9562-1505e4a162e7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:05.630028 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7b8eacc2-cebb-4049-9562-1505e4a162e7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:05.630800 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7b8eacc2-cebb-4049-9562-1505e4a162e7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:05.631235 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7b8eacc2-cebb-4049-9562-1505e4a162e7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:05.664301 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7b8eacc2-cebb-4049-9562-1505e4a162e7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047979 Jul 26 07:35:05.664877 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 531/1111] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:05 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:05.699612 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-326781fa-6bd3-400a-9429-6c1361aa5c88 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:05.701772 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-326781fa-6bd3-400a-9429-6c1361aa5c88 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:05.708927 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-326781fa-6bd3-400a-9429-6c1361aa5c88 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:05.709371 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-326781fa-6bd3-400a-9429-6c1361aa5c88 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:05.710200 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-326781fa-6bd3-400a-9429-6c1361aa5c88 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:05.710632 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-326781fa-6bd3-400a-9429-6c1361aa5c88 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:05.742603 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-326781fa-6bd3-400a-9429-6c1361aa5c88 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046977 Jul 26 07:35:05.743153 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 581/1112] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:35:05 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:35:06.678519 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-62065690-68c8-46df-8842-ad4b7597246f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:06.680796 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-62065690-68c8-46df-8842-ad4b7597246f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:06.687952 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-62065690-68c8-46df-8842-ad4b7597246f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:06.688425 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-62065690-68c8-46df-8842-ad4b7597246f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:06.689233 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-62065690-68c8-46df-8842-ad4b7597246f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:06.689658 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-62065690-68c8-46df-8842-ad4b7597246f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:06.729770 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-62065690-68c8-46df-8842-ad4b7597246f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055799 Jul 26 07:35:06.730453 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 532/1113] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:06 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:06.755724 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b07b3dd1-3cf3-4c5c-9a6d-0694fa372502 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:06.757906 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b07b3dd1-3cf3-4c5c-9a6d-0694fa372502 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:06.764756 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b07b3dd1-3cf3-4c5c-9a6d-0694fa372502 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:06.765200 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b07b3dd1-3cf3-4c5c-9a6d-0694fa372502 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:06.766050 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b07b3dd1-3cf3-4c5c-9a6d-0694fa372502 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:06.766477 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b07b3dd1-3cf3-4c5c-9a6d-0694fa372502 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:06.796918 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b07b3dd1-3cf3-4c5c-9a6d-0694fa372502 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045187 Jul 26 07:35:06.797595 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 582/1114] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:35:06 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:35:07.746094 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b8f4b3ce-2c47-43bd-a355-91091dd01e53 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:07.748602 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-b8f4b3ce-2c47-43bd-a355-91091dd01e53 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:07.756664 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b8f4b3ce-2c47-43bd-a355-91091dd01e53 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:07.757105 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b8f4b3ce-2c47-43bd-a355-91091dd01e53 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:07.757908 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b8f4b3ce-2c47-43bd-a355-91091dd01e53 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:07.758335 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b8f4b3ce-2c47-43bd-a355-91091dd01e53 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:07.787988 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b8f4b3ce-2c47-43bd-a355-91091dd01e53 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048115 Jul 26 07:35:07.788584 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 533/1115] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:07 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:07.812692 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e3c8936f-e3ea-47aa-8653-d005ff5ecb17 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:07.815787 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e3c8936f-e3ea-47aa-8653-d005ff5ecb17 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:07.822770 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e3c8936f-e3ea-47aa-8653-d005ff5ecb17 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:07.823225 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e3c8936f-e3ea-47aa-8653-d005ff5ecb17 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:07.824008 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e3c8936f-e3ea-47aa-8653-d005ff5ecb17 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:07.824450 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e3c8936f-e3ea-47aa-8653-d005ff5ecb17 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:07.855162 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e3c8936f-e3ea-47aa-8653-d005ff5ecb17 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049237 Jul 26 07:35:07.855718 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 583/1116] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:35:07 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:35:08.802151 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-fc7e0108-2af8-4b4d-b3bd-0d706518918c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:08.804362 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-fc7e0108-2af8-4b4d-b3bd-0d706518918c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:08.811250 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fc7e0108-2af8-4b4d-b3bd-0d706518918c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:08.811692 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fc7e0108-2af8-4b4d-b3bd-0d706518918c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:08.812449 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fc7e0108-2af8-4b4d-b3bd-0d706518918c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:08.812874 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fc7e0108-2af8-4b4d-b3bd-0d706518918c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:08.845484 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-fc7e0108-2af8-4b4d-b3bd-0d706518918c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048819 Jul 26 07:35:08.846149 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 534/1117] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:08 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:08.868155 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ea9b7ef5-2f6c-470b-b84d-70bf7de53b7e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:08.870368 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ea9b7ef5-2f6c-470b-b84d-70bf7de53b7e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:08.877453 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ea9b7ef5-2f6c-470b-b84d-70bf7de53b7e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:08.877931 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ea9b7ef5-2f6c-470b-b84d-70bf7de53b7e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:08.878692 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ea9b7ef5-2f6c-470b-b84d-70bf7de53b7e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:08.879128 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ea9b7ef5-2f6c-470b-b84d-70bf7de53b7e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:08.909660 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ea9b7ef5-2f6c-470b-b84d-70bf7de53b7e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045510 Jul 26 07:35:08.910299 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 584/1118] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:35:08 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:35:09.858435 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2e92889e-3db3-43dd-a2b5-30d47a6f2bf0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:09.860616 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2e92889e-3db3-43dd-a2b5-30d47a6f2bf0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:09.863051 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=58 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:09.868109 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2e92889e-3db3-43dd-a2b5-30d47a6f2bf0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:09.868542 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2e92889e-3db3-43dd-a2b5-30d47a6f2bf0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:09.869305 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2e92889e-3db3-43dd-a2b5-30d47a6f2bf0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:09.869729 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2e92889e-3db3-43dd-a2b5-30d47a6f2bf0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:09.904872 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2e92889e-3db3-43dd-a2b5-30d47a6f2bf0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050374 Jul 26 07:35:09.905442 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 535/1119] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:09 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:09.922540 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-1cb73a48-93fe-45d1-8f7d-3ee79617dd38 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:09.925244 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-1cb73a48-93fe-45d1-8f7d-3ee79617dd38 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:09.934561 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1cb73a48-93fe-45d1-8f7d-3ee79617dd38 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:09.935277 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1cb73a48-93fe-45d1-8f7d-3ee79617dd38 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:09.936462 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1cb73a48-93fe-45d1-8f7d-3ee79617dd38 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:09.937139 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1cb73a48-93fe-45d1-8f7d-3ee79617dd38 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:09.970173 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-1cb73a48-93fe-45d1-8f7d-3ee79617dd38 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051732 Jul 26 07:35:09.970778 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 585/1120] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:35:09 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:35:10.917888 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ac58c0e4-7dee-4ec6-b61f-d509eb12f9cb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:10.920045 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ac58c0e4-7dee-4ec6-b61f-d509eb12f9cb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:10.927054 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ac58c0e4-7dee-4ec6-b61f-d509eb12f9cb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:10.927498 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ac58c0e4-7dee-4ec6-b61f-d509eb12f9cb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:10.928259 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ac58c0e4-7dee-4ec6-b61f-d509eb12f9cb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:10.928683 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ac58c0e4-7dee-4ec6-b61f-d509eb12f9cb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:10.960430 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ac58c0e4-7dee-4ec6-b61f-d509eb12f9cb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046818 Jul 26 07:35:10.960986 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 536/1121] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:10 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:10.985847 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e932abbb-e495-444d-b742-b2c340ba9fda tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:10.988468 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e932abbb-e495-444d-b742-b2c340ba9fda tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:10.990932 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=58 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:10.996860 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e932abbb-e495-444d-b742-b2c340ba9fda tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:10.997305 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e932abbb-e495-444d-b742-b2c340ba9fda tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:10.998139 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e932abbb-e495-444d-b742-b2c340ba9fda tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:10.998569 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e932abbb-e495-444d-b742-b2c340ba9fda tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:11.031448 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e932abbb-e495-444d-b742-b2c340ba9fda tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049791 Jul 26 07:35:11.031988 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 586/1122] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:35:10 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:35:11.973046 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7fe5c6e7-9e85-461f-85e7-680b0a0e89f9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:11.975226 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7fe5c6e7-9e85-461f-85e7-680b0a0e89f9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:11.982342 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7fe5c6e7-9e85-461f-85e7-680b0a0e89f9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:11.982785 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7fe5c6e7-9e85-461f-85e7-680b0a0e89f9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:11.983533 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7fe5c6e7-9e85-461f-85e7-680b0a0e89f9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:11.983965 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7fe5c6e7-9e85-461f-85e7-680b0a0e89f9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:12.016854 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7fe5c6e7-9e85-461f-85e7-680b0a0e89f9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047912 Jul 26 07:35:12.017367 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 537/1123] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:11 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:12.046544 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9c474c45-82d7-4552-be6b-19d95e834b9a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:12.049445 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-9c474c45-82d7-4552-be6b-19d95e834b9a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:12.059803 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9c474c45-82d7-4552-be6b-19d95e834b9a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:12.060489 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9c474c45-82d7-4552-be6b-19d95e834b9a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:12.061623 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9c474c45-82d7-4552-be6b-19d95e834b9a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:12.062266 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9c474c45-82d7-4552-be6b-19d95e834b9a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:12.095876 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-9c474c45-82d7-4552-be6b-19d95e834b9a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055474 Jul 26 07:35:12.096427 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 587/1124] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:35:12 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:35:13.031354 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c9c67905-4696-4ed5-8fc0-ead6f97ce22f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:13.033552 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c9c67905-4696-4ed5-8fc0-ead6f97ce22f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:13.040565 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c9c67905-4696-4ed5-8fc0-ead6f97ce22f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:13.041014 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c9c67905-4696-4ed5-8fc0-ead6f97ce22f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:13.041800 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c9c67905-4696-4ed5-8fc0-ead6f97ce22f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:13.042285 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c9c67905-4696-4ed5-8fc0-ead6f97ce22f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:13.072664 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c9c67905-4696-4ed5-8fc0-ead6f97ce22f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045375 Jul 26 07:35:13.073205 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 538/1125] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:13 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:13.108862 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-83869dad-fdc1-46ec-986b-5cca42c48d17 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:13.111160 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-83869dad-fdc1-46ec-986b-5cca42c48d17 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:13.118626 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-83869dad-fdc1-46ec-986b-5cca42c48d17 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:13.119068 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-83869dad-fdc1-46ec-986b-5cca42c48d17 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:13.119830 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-83869dad-fdc1-46ec-986b-5cca42c48d17 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:13.120259 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-83869dad-fdc1-46ec-986b-5cca42c48d17 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:13.151601 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-83869dad-fdc1-46ec-986b-5cca42c48d17 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047014 Jul 26 07:35:13.152177 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 588/1126] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:35:13 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:35:14.089444 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-32205425-e035-4939-a28c-8037908898bf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:14.092579 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-32205425-e035-4939-a28c-8037908898bf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:14.099952 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-32205425-e035-4939-a28c-8037908898bf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:14.100394 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-32205425-e035-4939-a28c-8037908898bf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:14.101160 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-32205425-e035-4939-a28c-8037908898bf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:14.101596 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-32205425-e035-4939-a28c-8037908898bf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:14.131402 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-32205425-e035-4939-a28c-8037908898bf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047944 Jul 26 07:35:14.131950 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 539/1127] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:14 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:14.165967 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-edddc098-cabe-45b5-ad94-887be410c8a8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:14.168853 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-edddc098-cabe-45b5-ad94-887be410c8a8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:14.177291 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-edddc098-cabe-45b5-ad94-887be410c8a8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:14.177752 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-edddc098-cabe-45b5-ad94-887be410c8a8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:14.178645 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-edddc098-cabe-45b5-ad94-887be410c8a8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:14.179160 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-edddc098-cabe-45b5-ad94-887be410c8a8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:14.214046 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-edddc098-cabe-45b5-ad94-887be410c8a8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053877 Jul 26 07:35:14.214613 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 589/1128] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:35:14 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:35:15.145143 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-77db1b8c-d4a2-4bbf-814d-fd6cbde4f52b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:15.147217 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-77db1b8c-d4a2-4bbf-814d-fd6cbde4f52b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:15.153824 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-77db1b8c-d4a2-4bbf-814d-fd6cbde4f52b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:15.154279 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-77db1b8c-d4a2-4bbf-814d-fd6cbde4f52b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:15.155060 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-77db1b8c-d4a2-4bbf-814d-fd6cbde4f52b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:15.155480 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-77db1b8c-d4a2-4bbf-814d-fd6cbde4f52b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:15.186512 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-77db1b8c-d4a2-4bbf-814d-fd6cbde4f52b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045557 Jul 26 07:35:15.187328 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 540/1129] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:15 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:15.229959 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-1a8fc39f-bd12-4f50-8323-5a3ef4647a35 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:15.232500 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-1a8fc39f-bd12-4f50-8323-5a3ef4647a35 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:15.239296 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1a8fc39f-bd12-4f50-8323-5a3ef4647a35 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:15.239749 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1a8fc39f-bd12-4f50-8323-5a3ef4647a35 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:15.240499 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1a8fc39f-bd12-4f50-8323-5a3ef4647a35 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:15.240913 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1a8fc39f-bd12-4f50-8323-5a3ef4647a35 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:15.271544 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-1a8fc39f-bd12-4f50-8323-5a3ef4647a35 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047765 Jul 26 07:35:15.272118 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 590/1130] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:35:15 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:35:16.202154 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-bda5830e-9fa1-4971-9d09-44d34344b558 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:16.204928 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-bda5830e-9fa1-4971-9d09-44d34344b558 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:16.215027 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bda5830e-9fa1-4971-9d09-44d34344b558 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:16.215775 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bda5830e-9fa1-4971-9d09-44d34344b558 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:16.217106 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bda5830e-9fa1-4971-9d09-44d34344b558 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:16.217588 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bda5830e-9fa1-4971-9d09-44d34344b558 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:16.247678 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-bda5830e-9fa1-4971-9d09-44d34344b558 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052153 Jul 26 07:35:16.248226 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 541/1131] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:16 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:16.285711 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-300e7295-45b7-4d25-9046-170f4f07250a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:16.287905 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-300e7295-45b7-4d25-9046-170f4f07250a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:16.295220 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-300e7295-45b7-4d25-9046-170f4f07250a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:16.295696 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-300e7295-45b7-4d25-9046-170f4f07250a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:16.296507 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-300e7295-45b7-4d25-9046-170f4f07250a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:16.296957 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-300e7295-45b7-4d25-9046-170f4f07250a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:16.320861 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:16.327620 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-300e7295-45b7-4d25-9046-170f4f07250a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046579 Jul 26 07:35:16.328215 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 591/1132] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:35:16 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:35:17.261071 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8ae2c32e-ae1e-4c8e-814a-504785156991 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:17.263226 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8ae2c32e-ae1e-4c8e-814a-504785156991 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:17.270398 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8ae2c32e-ae1e-4c8e-814a-504785156991 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:17.270842 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8ae2c32e-ae1e-4c8e-814a-504785156991 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:17.271595 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8ae2c32e-ae1e-4c8e-814a-504785156991 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:17.272023 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8ae2c32e-ae1e-4c8e-814a-504785156991 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:17.302967 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8ae2c32e-ae1e-4c8e-814a-504785156991 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045892 Jul 26 07:35:17.303506 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 542/1133] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:17 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:17.344127 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-2448cca2-b2df-4332-907d-1b765cf11689 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:17.346736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2448cca2-b2df-4332-907d-1b765cf11689 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:17.356521 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2448cca2-b2df-4332-907d-1b765cf11689 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:17.356960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2448cca2-b2df-4332-907d-1b765cf11689 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:17.357790 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2448cca2-b2df-4332-907d-1b765cf11689 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:17.358243 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2448cca2-b2df-4332-907d-1b765cf11689 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:17.389499 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-2448cca2-b2df-4332-907d-1b765cf11689 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052091 Jul 26 07:35:17.390071 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 592/1134] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:35:17 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:35:18.316333 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9a3c7d3a-e477-4f18-a3f0-635f6acf8945 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:18.318475 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-9a3c7d3a-e477-4f18-a3f0-635f6acf8945 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:18.326763 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9a3c7d3a-e477-4f18-a3f0-635f6acf8945 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:18.327211 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9a3c7d3a-e477-4f18-a3f0-635f6acf8945 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:18.328024 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9a3c7d3a-e477-4f18-a3f0-635f6acf8945 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:18.328448 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9a3c7d3a-e477-4f18-a3f0-635f6acf8945 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:18.359587 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-9a3c7d3a-e477-4f18-a3f0-635f6acf8945 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047531 Jul 26 07:35:18.360206 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 543/1135] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:18 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:18.402577 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e03ca2e8-5de5-493d-89b0-dc25cb12130b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:18.404772 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e03ca2e8-5de5-493d-89b0-dc25cb12130b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:18.411709 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e03ca2e8-5de5-493d-89b0-dc25cb12130b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:18.412149 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e03ca2e8-5de5-493d-89b0-dc25cb12130b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:18.412908 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e03ca2e8-5de5-493d-89b0-dc25cb12130b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:18.413336 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e03ca2e8-5de5-493d-89b0-dc25cb12130b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:18.445016 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e03ca2e8-5de5-493d-89b0-dc25cb12130b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046425 Jul 26 07:35:18.445846 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 593/1136] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:35:18 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:35:19.372466 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-689a60f8-85cf-4e49-9778-223cbd1b7d14 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:19.374679 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-689a60f8-85cf-4e49-9778-223cbd1b7d14 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:19.381672 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-689a60f8-85cf-4e49-9778-223cbd1b7d14 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:19.382163 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-689a60f8-85cf-4e49-9778-223cbd1b7d14 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:19.382955 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-689a60f8-85cf-4e49-9778-223cbd1b7d14 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:19.383417 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-689a60f8-85cf-4e49-9778-223cbd1b7d14 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:19.413889 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-689a60f8-85cf-4e49-9778-223cbd1b7d14 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045376 Jul 26 07:35:19.414454 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 544/1137] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:19 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:19.457082 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6ed427da-cad2-442d-95f7-dbf6312bccf0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:19.459300 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-6ed427da-cad2-442d-95f7-dbf6312bccf0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:19.466793 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6ed427da-cad2-442d-95f7-dbf6312bccf0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:19.467241 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6ed427da-cad2-442d-95f7-dbf6312bccf0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:19.468016 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6ed427da-cad2-442d-95f7-dbf6312bccf0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:19.468449 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6ed427da-cad2-442d-95f7-dbf6312bccf0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:19.499961 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6ed427da-cad2-442d-95f7-dbf6312bccf0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046921 Jul 26 07:35:19.500531 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 594/1138] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:35:19 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:35:20.429018 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a3cedf3c-4541-4520-b848-2b215c7f799c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:20.431757 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a3cedf3c-4541-4520-b848-2b215c7f799c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:20.441573 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a3cedf3c-4541-4520-b848-2b215c7f799c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:20.442150 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a3cedf3c-4541-4520-b848-2b215c7f799c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:20.443243 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a3cedf3c-4541-4520-b848-2b215c7f799c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:20.444482 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a3cedf3c-4541-4520-b848-2b215c7f799c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:20.477871 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a3cedf3c-4541-4520-b848-2b215c7f799c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053728 Jul 26 07:35:20.478480 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 545/1139] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:20 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:20.512864 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-07cd306e-fefc-4d56-976d-e8293f85d138 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:20.515055 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-07cd306e-fefc-4d56-976d-e8293f85d138 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:20.521880 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-07cd306e-fefc-4d56-976d-e8293f85d138 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:20.522329 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-07cd306e-fefc-4d56-976d-e8293f85d138 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:20.523086 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-07cd306e-fefc-4d56-976d-e8293f85d138 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:20.523519 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-07cd306e-fefc-4d56-976d-e8293f85d138 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:20.554200 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-07cd306e-fefc-4d56-976d-e8293f85d138 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045256 Jul 26 07:35:20.554784 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 595/1140] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:35:20 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:35:21.491409 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-15d2a2ba-7b93-42bb-9cd6-0ba6fc08fbf3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:21.494994 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-15d2a2ba-7b93-42bb-9cd6-0ba6fc08fbf3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:21.504848 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-15d2a2ba-7b93-42bb-9cd6-0ba6fc08fbf3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:21.505288 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-15d2a2ba-7b93-42bb-9cd6-0ba6fc08fbf3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:21.506126 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-15d2a2ba-7b93-42bb-9cd6-0ba6fc08fbf3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:21.506570 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-15d2a2ba-7b93-42bb-9cd6-0ba6fc08fbf3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:21.522186 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:21.541026 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-15d2a2ba-7b93-42bb-9cd6-0ba6fc08fbf3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054262 Jul 26 07:35:21.541610 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 546/1141] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:21 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:21.567190 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8dec3f19-635b-450b-949b-05939660c0fc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:21.569723 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8dec3f19-635b-450b-949b-05939660c0fc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:21.577223 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8dec3f19-635b-450b-949b-05939660c0fc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:21.577807 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8dec3f19-635b-450b-949b-05939660c0fc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:21.578700 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8dec3f19-635b-450b-949b-05939660c0fc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:21.579207 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8dec3f19-635b-450b-949b-05939660c0fc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:21.613714 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8dec3f19-635b-450b-949b-05939660c0fc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050603 Jul 26 07:35:21.614570 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 596/1142] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:35:21 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:35:21.775115 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d1610e76-743c-42a2-b1c5-14f6399b4fdc tempest-TestShelveInstance-706623057 tempest-TestShelveInstance-706623057-project] Calling method '.version_select at 0x7f7f02615790>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:21.780192 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d1610e76-743c-42a2-b1c5-14f6399b4fdc tempest-TestShelveInstance-706623057 tempest-TestShelveInstance-706623057-project] [5a5df08d-9df2-4277-a14f-7d0240ce02e0] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 07:35:22.305905 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-cf43100b-ede6-4d94-a1fd-5dec39f7882b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:22.306394 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-cf43100b-ede6-4d94-a1fd-5dec39f7882b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:22.313005 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cf43100b-ede6-4d94-a1fd-5dec39f7882b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:22.313449 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cf43100b-ede6-4d94-a1fd-5dec39f7882b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:22.314237 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cf43100b-ede6-4d94-a1fd-5dec39f7882b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:22.314711 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cf43100b-ede6-4d94-a1fd-5dec39f7882b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:22.398915 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.objects.instance [None req-cf43100b-ede6-4d94-a1fd-5dec39f7882b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lazy-loading 'services' on Instance uuid 8c87e5af-1321-4b95-86a4-6e094fa1d61f {{(pid=117715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 07:35:22.487842 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-cf43100b-ede6-4d94-a1fd-5dec39f7882b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f/os-volume_attachments/77653b38-e5d7-4e98-9024-aff6ece2c671" status: 202 len: 0 microversion: 2.1 time: 0.185710 Jul 26 07:35:22.488440 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 597/1143] 10.222.0.39 () {58 vars in 1416 bytes} [Tue Jul 26 07:35:22 2022] DELETE /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f/os-volume_attachments/77653b38-e5d7-4e98-9024-aff6ece2c671 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 07:35:22.555354 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-98d2e62e-59ee-442d-a211-5145531acf4d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:22.558855 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-98d2e62e-59ee-442d-a211-5145531acf4d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:22.568996 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-98d2e62e-59ee-442d-a211-5145531acf4d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:22.569647 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-98d2e62e-59ee-442d-a211-5145531acf4d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:22.570459 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-98d2e62e-59ee-442d-a211-5145531acf4d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:22.571612 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-98d2e62e-59ee-442d-a211-5145531acf4d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:22.603554 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-98d2e62e-59ee-442d-a211-5145531acf4d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053164 Jul 26 07:35:22.604131 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 598/1144] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:22 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 07:35:22.627207 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e4214264-84f6-4434-a96a-355ada3b29cf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:22.629477 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e4214264-84f6-4434-a96a-355ada3b29cf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:22.635835 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e4214264-84f6-4434-a96a-355ada3b29cf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:22.636287 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e4214264-84f6-4434-a96a-355ada3b29cf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:22.637061 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e4214264-84f6-4434-a96a-355ada3b29cf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:22.637495 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e4214264-84f6-4434-a96a-355ada3b29cf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:22.669752 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e4214264-84f6-4434-a96a-355ada3b29cf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046684 Jul 26 07:35:22.670350 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 599/1145] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:35:22 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:35:22.788649 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO oslo.messaging._drivers.impl_rabbit [None req-d1610e76-743c-42a2-b1c5-14f6399b4fdc tempest-TestShelveInstance-706623057 tempest-TestShelveInstance-706623057-project] [5a5df08d-9df2-4277-a14f-7d0240ce02e0] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 51346. Jul 26 07:35:22.812253 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d1610e76-743c-42a2-b1c5-14f6399b4fdc tempest-TestShelveInstance-706623057 tempest-TestShelveInstance-706623057-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-664511373" status: 202 len: 0 microversion: 2.1 time: 1.041172 Jul 26 07:35:22.812843 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 547/1146] 10.222.0.39 () {58 vars in 1251 bytes} [Tue Jul 26 07:35:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-664511373 => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 07:35:23.616574 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-89f705d5-0d47-48ae-a436-3e6356fe5c00 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:23.618754 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-89f705d5-0d47-48ae-a436-3e6356fe5c00 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:23.625465 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-89f705d5-0d47-48ae-a436-3e6356fe5c00 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:23.625956 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-89f705d5-0d47-48ae-a436-3e6356fe5c00 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:23.626732 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-89f705d5-0d47-48ae-a436-3e6356fe5c00 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:23.627313 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-89f705d5-0d47-48ae-a436-3e6356fe5c00 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:23.660284 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-89f705d5-0d47-48ae-a436-3e6356fe5c00 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047161 Jul 26 07:35:23.660284 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 600/1147] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:23 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:23.682825 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-fb55dea2-6091-49af-b5dd-fd367d2b6a70 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:23.685016 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-fb55dea2-6091-49af-b5dd-fd367d2b6a70 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:23.693014 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fb55dea2-6091-49af-b5dd-fd367d2b6a70 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:23.693459 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fb55dea2-6091-49af-b5dd-fd367d2b6a70 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:23.694283 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fb55dea2-6091-49af-b5dd-fd367d2b6a70 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:23.694809 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fb55dea2-6091-49af-b5dd-fd367d2b6a70 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:23.727154 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-fb55dea2-6091-49af-b5dd-fd367d2b6a70 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048433 Jul 26 07:35:23.727739 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 548/1148] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:35:23 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:35:24.679059 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7304db2b-9862-4669-8412-1c934efa4cec tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:24.685716 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7304db2b-9862-4669-8412-1c934efa4cec tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:24.700501 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7304db2b-9862-4669-8412-1c934efa4cec tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:24.702150 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7304db2b-9862-4669-8412-1c934efa4cec tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:24.704032 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7304db2b-9862-4669-8412-1c934efa4cec tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:24.705438 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7304db2b-9862-4669-8412-1c934efa4cec tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:24.741488 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9c6aecfd-b588-4f14-b8fa-24a4c7e6b93f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:24.743479 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-9c6aecfd-b588-4f14-b8fa-24a4c7e6b93f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:24.761525 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9c6aecfd-b588-4f14-b8fa-24a4c7e6b93f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:24.766218 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9c6aecfd-b588-4f14-b8fa-24a4c7e6b93f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:24.768365 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9c6aecfd-b588-4f14-b8fa-24a4c7e6b93f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:24.769527 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9c6aecfd-b588-4f14-b8fa-24a4c7e6b93f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:24.781123 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7304db2b-9862-4669-8412-1c934efa4cec tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111439 Jul 26 07:35:24.782750 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 601/1149] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:24 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:24.834293 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-9c6aecfd-b588-4f14-b8fa-24a4c7e6b93f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.089939 Jul 26 07:35:24.834293 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 549/1150] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:35:24 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:35:25.797439 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8ff9698d-15c3-468e-96ed-c87f14c37c71 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:25.801427 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8ff9698d-15c3-468e-96ed-c87f14c37c71 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:25.809873 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ff9698d-15c3-468e-96ed-c87f14c37c71 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:25.810718 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ff9698d-15c3-468e-96ed-c87f14c37c71 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:25.811923 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ff9698d-15c3-468e-96ed-c87f14c37c71 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:25.812417 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ff9698d-15c3-468e-96ed-c87f14c37c71 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:25.844829 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-07ebd553-1a76-4fce-ae68-4deaa936b17d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:25.848151 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-07ebd553-1a76-4fce-ae68-4deaa936b17d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:25.856893 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-07ebd553-1a76-4fce-ae68-4deaa936b17d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:25.857377 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-07ebd553-1a76-4fce-ae68-4deaa936b17d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:25.858194 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-07ebd553-1a76-4fce-ae68-4deaa936b17d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:25.858734 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-07ebd553-1a76-4fce-ae68-4deaa936b17d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:25.865020 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8ff9698d-15c3-468e-96ed-c87f14c37c71 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071457 Jul 26 07:35:25.866832 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 602/1151] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:25 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:25.895325 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-07ebd553-1a76-4fce-ae68-4deaa936b17d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056943 Jul 26 07:35:25.900871 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 550/1152] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:35:25 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:35:26.884438 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e411ec5b-9d2f-43e8-8f79-fd837e142f90 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:26.888162 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e411ec5b-9d2f-43e8-8f79-fd837e142f90 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:26.911876 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9b0a2c68-db98-4616-87b8-b70c9ea4d0ce tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:26.917807 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e411ec5b-9d2f-43e8-8f79-fd837e142f90 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:26.920066 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e411ec5b-9d2f-43e8-8f79-fd837e142f90 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:26.920066 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e411ec5b-9d2f-43e8-8f79-fd837e142f90 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:26.920720 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e411ec5b-9d2f-43e8-8f79-fd837e142f90 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:26.921771 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-9b0a2c68-db98-4616-87b8-b70c9ea4d0ce tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:26.929995 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9b0a2c68-db98-4616-87b8-b70c9ea4d0ce tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:26.930491 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9b0a2c68-db98-4616-87b8-b70c9ea4d0ce tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:26.931302 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9b0a2c68-db98-4616-87b8-b70c9ea4d0ce tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:26.931731 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9b0a2c68-db98-4616-87b8-b70c9ea4d0ce tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:26.962458 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e411ec5b-9d2f-43e8-8f79-fd837e142f90 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085253 Jul 26 07:35:26.962694 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-9b0a2c68-db98-4616-87b8-b70c9ea4d0ce tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058324 Jul 26 07:35:26.963036 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 603/1153] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:26 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:26.967615 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 551/1154] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:35:26 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:35:27.976098 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b9c2c074-057f-4f54-ab80-c0f404375ab0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:27.978647 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b9c2c074-057f-4f54-ab80-c0f404375ab0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:27.983116 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8b6e8d6b-c1b0-4afd-9ac4-a760a642cc26 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:27.986464 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b9c2c074-057f-4f54-ab80-c0f404375ab0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:27.986775 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8b6e8d6b-c1b0-4afd-9ac4-a760a642cc26 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:27.987254 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b9c2c074-057f-4f54-ab80-c0f404375ab0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:27.988167 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b9c2c074-057f-4f54-ab80-c0f404375ab0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:27.988731 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b9c2c074-057f-4f54-ab80-c0f404375ab0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:27.994165 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8b6e8d6b-c1b0-4afd-9ac4-a760a642cc26 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:27.994477 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8b6e8d6b-c1b0-4afd-9ac4-a760a642cc26 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:27.995247 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8b6e8d6b-c1b0-4afd-9ac4-a760a642cc26 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:27.995694 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8b6e8d6b-c1b0-4afd-9ac4-a760a642cc26 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:28.024225 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b9c2c074-057f-4f54-ab80-c0f404375ab0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052375 Jul 26 07:35:28.029151 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8b6e8d6b-c1b0-4afd-9ac4-a760a642cc26 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053614 Jul 26 07:35:28.029775 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 552/1156] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:35:27 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:35:28.029952 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 604/1156] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:27 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:29.040880 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-fa708bac-ac3c-4327-89d4-164eadcb02d5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:29.044408 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-fa708bac-ac3c-4327-89d4-164eadcb02d5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:29.062441 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-0dcc6c28-bc2e-4670-82a5-a2fd1d515055 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:29.068335 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-0dcc6c28-bc2e-4670-82a5-a2fd1d515055 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:29.073668 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fa708bac-ac3c-4327-89d4-164eadcb02d5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:29.074412 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fa708bac-ac3c-4327-89d4-164eadcb02d5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:29.075702 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fa708bac-ac3c-4327-89d4-164eadcb02d5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:29.076412 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fa708bac-ac3c-4327-89d4-164eadcb02d5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:29.085370 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0dcc6c28-bc2e-4670-82a5-a2fd1d515055 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:29.086482 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0dcc6c28-bc2e-4670-82a5-a2fd1d515055 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:29.088096 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0dcc6c28-bc2e-4670-82a5-a2fd1d515055 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:29.089276 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0dcc6c28-bc2e-4670-82a5-a2fd1d515055 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:29.127076 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-fa708bac-ac3c-4327-89d4-164eadcb02d5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092440 Jul 26 07:35:29.128158 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 553/1157] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:29 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:29.150172 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-0dcc6c28-bc2e-4670-82a5-a2fd1d515055 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.110898 Jul 26 07:35:29.150750 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 605/1158] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:35:29 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 07:35:30.150649 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-096021e8-9d23-4fb4-9ebd-26487d9c2c54 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:30.154334 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-096021e8-9d23-4fb4-9ebd-26487d9c2c54 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:30.163811 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-096021e8-9d23-4fb4-9ebd-26487d9c2c54 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:30.164264 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-096021e8-9d23-4fb4-9ebd-26487d9c2c54 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:30.164931 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-1c50a5f1-675c-4cfc-8c05-4656f78864cd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:30.165542 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-096021e8-9d23-4fb4-9ebd-26487d9c2c54 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:30.165542 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-096021e8-9d23-4fb4-9ebd-26487d9c2c54 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:30.168102 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-1c50a5f1-675c-4cfc-8c05-4656f78864cd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:30.192374 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1c50a5f1-675c-4cfc-8c05-4656f78864cd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:30.193175 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1c50a5f1-675c-4cfc-8c05-4656f78864cd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:30.195334 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1c50a5f1-675c-4cfc-8c05-4656f78864cd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:30.195908 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1c50a5f1-675c-4cfc-8c05-4656f78864cd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:30.248455 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-096021e8-9d23-4fb4-9ebd-26487d9c2c54 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106273 Jul 26 07:35:30.249027 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 554/1159] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:30 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:30.260309 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-1c50a5f1-675c-4cfc-8c05-4656f78864cd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.101259 Jul 26 07:35:30.261216 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 606/1160] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:35:30 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:35:30.279326 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 07:35:30.279626 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Tue Jul 26 07:35:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 07:35:31.262281 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b4699a9f-884c-464d-b122-b6e5ada8104a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:31.265207 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-b4699a9f-884c-464d-b122-b6e5ada8104a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:31.274594 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8d1337bf-d91f-4acf-a7a1-a72ca9c927a1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:31.275490 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b4699a9f-884c-464d-b122-b6e5ada8104a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:31.275490 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b4699a9f-884c-464d-b122-b6e5ada8104a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:31.275784 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8d1337bf-d91f-4acf-a7a1-a72ca9c927a1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:31.275953 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b4699a9f-884c-464d-b122-b6e5ada8104a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:31.275953 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b4699a9f-884c-464d-b122-b6e5ada8104a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:31.289252 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8d1337bf-d91f-4acf-a7a1-a72ca9c927a1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:31.289804 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8d1337bf-d91f-4acf-a7a1-a72ca9c927a1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:31.292850 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8d1337bf-d91f-4acf-a7a1-a72ca9c927a1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:31.294751 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8d1337bf-d91f-4acf-a7a1-a72ca9c927a1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:31.311046 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b4699a9f-884c-464d-b122-b6e5ada8104a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052890 Jul 26 07:35:31.318640 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 555/1161] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:31 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:31.339021 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:31.345798 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8d1337bf-d91f-4acf-a7a1-a72ca9c927a1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076966 Jul 26 07:35:31.346635 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 607/1162] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:35:31 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 07:35:32.327455 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-dbfb3829-10e9-49d3-b221-2f7b315beb1f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:32.329508 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-dbfb3829-10e9-49d3-b221-2f7b315beb1f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:32.336394 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dbfb3829-10e9-49d3-b221-2f7b315beb1f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:32.336836 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dbfb3829-10e9-49d3-b221-2f7b315beb1f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:32.337608 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dbfb3829-10e9-49d3-b221-2f7b315beb1f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:32.338080 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dbfb3829-10e9-49d3-b221-2f7b315beb1f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:32.360781 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c27315e1-e778-447b-af4c-f9290376b898 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:32.362531 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c27315e1-e778-447b-af4c-f9290376b898 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:32.370388 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c27315e1-e778-447b-af4c-f9290376b898 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:32.370842 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c27315e1-e778-447b-af4c-f9290376b898 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:32.371855 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c27315e1-e778-447b-af4c-f9290376b898 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:32.372878 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c27315e1-e778-447b-af4c-f9290376b898 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:32.379318 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-dbfb3829-10e9-49d3-b221-2f7b315beb1f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055704 Jul 26 07:35:32.380258 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 556/1163] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:32 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:32.404407 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c27315e1-e778-447b-af4c-f9290376b898 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049474 Jul 26 07:35:32.404969 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 608/1164] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:35:32 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:35:33.392699 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b39d52c1-180c-4191-8150-9fe897ffdffe tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:33.394893 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-b39d52c1-180c-4191-8150-9fe897ffdffe tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:33.401767 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b39d52c1-180c-4191-8150-9fe897ffdffe tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:33.402276 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b39d52c1-180c-4191-8150-9fe897ffdffe tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:33.403155 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b39d52c1-180c-4191-8150-9fe897ffdffe tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:33.403667 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b39d52c1-180c-4191-8150-9fe897ffdffe tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:33.418070 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-21b847a6-3ef9-496e-af5f-d24d83d5ecee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:33.421986 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-21b847a6-3ef9-496e-af5f-d24d83d5ecee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:33.434702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-21b847a6-3ef9-496e-af5f-d24d83d5ecee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:33.435131 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-21b847a6-3ef9-496e-af5f-d24d83d5ecee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:33.436137 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-21b847a6-3ef9-496e-af5f-d24d83d5ecee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:33.436579 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-21b847a6-3ef9-496e-af5f-d24d83d5ecee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:33.456863 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b39d52c1-180c-4191-8150-9fe897ffdffe tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067856 Jul 26 07:35:33.458677 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 557/1165] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:33 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:33.479340 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-21b847a6-3ef9-496e-af5f-d24d83d5ecee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066386 Jul 26 07:35:33.480267 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 609/1166] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:35:33 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:35:34.472202 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d3f53bb4-12a5-4c2d-a4c5-af55608ee9f9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:34.475407 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d3f53bb4-12a5-4c2d-a4c5-af55608ee9f9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:34.483483 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d3f53bb4-12a5-4c2d-a4c5-af55608ee9f9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:34.483956 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d3f53bb4-12a5-4c2d-a4c5-af55608ee9f9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:34.484890 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d3f53bb4-12a5-4c2d-a4c5-af55608ee9f9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:34.485330 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d3f53bb4-12a5-4c2d-a4c5-af55608ee9f9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:34.493891 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-216c35c8-4928-4867-bb53-2290c79486b0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:34.496158 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-216c35c8-4928-4867-bb53-2290c79486b0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:34.504024 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-216c35c8-4928-4867-bb53-2290c79486b0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:34.504726 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-216c35c8-4928-4867-bb53-2290c79486b0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:34.505661 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-216c35c8-4928-4867-bb53-2290c79486b0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:34.506213 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-216c35c8-4928-4867-bb53-2290c79486b0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:34.558471 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-216c35c8-4928-4867-bb53-2290c79486b0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068695 Jul 26 07:35:34.559796 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 610/1167] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:35:34 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 07:35:34.673042 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d3f53bb4-12a5-4c2d-a4c5-af55608ee9f9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.206123 Jul 26 07:35:34.673683 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 558/1168] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:34 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:35.572213 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9b9215e7-8af4-4375-830e-dd53a15e2c11 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:35.574383 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-9b9215e7-8af4-4375-830e-dd53a15e2c11 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:35.581101 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9b9215e7-8af4-4375-830e-dd53a15e2c11 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:35.581560 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9b9215e7-8af4-4375-830e-dd53a15e2c11 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:35.582342 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9b9215e7-8af4-4375-830e-dd53a15e2c11 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:35.582763 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9b9215e7-8af4-4375-830e-dd53a15e2c11 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:35.614316 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-9b9215e7-8af4-4375-830e-dd53a15e2c11 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046340 Jul 26 07:35:35.614823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 611/1169] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:35:35 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:35:35.686314 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-de357e50-afdc-4319-bea5-5e3e19827182 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:35.688365 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-de357e50-afdc-4319-bea5-5e3e19827182 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:35.700390 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-de357e50-afdc-4319-bea5-5e3e19827182 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:35.700822 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-de357e50-afdc-4319-bea5-5e3e19827182 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:35.701618 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-de357e50-afdc-4319-bea5-5e3e19827182 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:35.702082 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-de357e50-afdc-4319-bea5-5e3e19827182 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:35.737251 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-de357e50-afdc-4319-bea5-5e3e19827182 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055722 Jul 26 07:35:35.737867 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 559/1170] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:35 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:36.751421 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d029a1b7-7b04-4442-af78-2a2c953adb8a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:36.754564 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d029a1b7-7b04-4442-af78-2a2c953adb8a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:36.762093 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d029a1b7-7b04-4442-af78-2a2c953adb8a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:36.762541 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d029a1b7-7b04-4442-af78-2a2c953adb8a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:36.763340 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d029a1b7-7b04-4442-af78-2a2c953adb8a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:36.763793 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d029a1b7-7b04-4442-af78-2a2c953adb8a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:36.799331 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d029a1b7-7b04-4442-af78-2a2c953adb8a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053451 Jul 26 07:35:36.799914 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 560/1171] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:36 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:36.972551 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e11d79de-472e-4243-b23f-737b14deb049 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:36.975189 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e11d79de-472e-4243-b23f-737b14deb049 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:36.982134 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e11d79de-472e-4243-b23f-737b14deb049 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:36.982575 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e11d79de-472e-4243-b23f-737b14deb049 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:36.983387 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e11d79de-472e-4243-b23f-737b14deb049 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:36.983829 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e11d79de-472e-4243-b23f-737b14deb049 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:37.016168 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e11d79de-472e-4243-b23f-737b14deb049 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.393069 Jul 26 07:35:37.016766 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 612/1172] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:35:36 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:35:37.812595 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ff325dc1-700f-4274-b481-6c72a6dfff42 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:37.814939 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ff325dc1-700f-4274-b481-6c72a6dfff42 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:37.821612 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ff325dc1-700f-4274-b481-6c72a6dfff42 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:37.822086 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ff325dc1-700f-4274-b481-6c72a6dfff42 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:37.822854 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ff325dc1-700f-4274-b481-6c72a6dfff42 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:37.823278 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ff325dc1-700f-4274-b481-6c72a6dfff42 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:37.855097 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ff325dc1-700f-4274-b481-6c72a6dfff42 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046422 Jul 26 07:35:37.855706 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 561/1173] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:37 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:38.029770 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ce40aa71-86ec-45b9-8641-381ad721ff32 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:38.031972 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ce40aa71-86ec-45b9-8641-381ad721ff32 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:38.038846 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ce40aa71-86ec-45b9-8641-381ad721ff32 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:38.039292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ce40aa71-86ec-45b9-8641-381ad721ff32 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:38.040058 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ce40aa71-86ec-45b9-8641-381ad721ff32 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:38.040493 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ce40aa71-86ec-45b9-8641-381ad721ff32 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:38.073078 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ce40aa71-86ec-45b9-8641-381ad721ff32 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047967 Jul 26 07:35:38.073618 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 613/1174] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:35:38 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:35:38.871036 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b662552d-427f-44c2-accf-a4ded692e670 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:38.874605 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-b662552d-427f-44c2-accf-a4ded692e670 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:38.886449 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b662552d-427f-44c2-accf-a4ded692e670 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:38.887244 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b662552d-427f-44c2-accf-a4ded692e670 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:38.888567 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b662552d-427f-44c2-accf-a4ded692e670 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:38.889349 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b662552d-427f-44c2-accf-a4ded692e670 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:38.924907 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b662552d-427f-44c2-accf-a4ded692e670 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059658 Jul 26 07:35:38.925515 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 562/1175] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:38 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:39.086550 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-968e1b8a-94e0-4a5a-b4ac-70770c70bf73 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:39.088960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-968e1b8a-94e0-4a5a-b4ac-70770c70bf73 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:39.097118 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-968e1b8a-94e0-4a5a-b4ac-70770c70bf73 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:39.097657 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-968e1b8a-94e0-4a5a-b4ac-70770c70bf73 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:39.098457 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-968e1b8a-94e0-4a5a-b4ac-70770c70bf73 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:39.098884 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-968e1b8a-94e0-4a5a-b4ac-70770c70bf73 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:39.131148 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-968e1b8a-94e0-4a5a-b4ac-70770c70bf73 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049149 Jul 26 07:35:39.131699 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 614/1176] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Jul 26 07:35:39 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:35:39.942082 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9af5480a-ae24-4884-91e8-26d551d60606 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:39.944806 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-9af5480a-ae24-4884-91e8-26d551d60606 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:39.947144 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:39.952253 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9af5480a-ae24-4884-91e8-26d551d60606 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:39.952705 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9af5480a-ae24-4884-91e8-26d551d60606 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:39.953456 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9af5480a-ae24-4884-91e8-26d551d60606 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:39.953923 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9af5480a-ae24-4884-91e8-26d551d60606 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:39.986318 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-9af5480a-ae24-4884-91e8-26d551d60606 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050767 Jul 26 07:35:39.986861 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 563/1177] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:39 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:40.144839 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-99c4de99-b12c-4dd6-8345-9017bdcb4305 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:35:40.147613 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-99c4de99-b12c-4dd6-8345-9017bdcb4305 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:40.156259 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-99c4de99-b12c-4dd6-8345-9017bdcb4305 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:40.156813 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-99c4de99-b12c-4dd6-8345-9017bdcb4305 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:40.157799 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-99c4de99-b12c-4dd6-8345-9017bdcb4305 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:40.158384 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-99c4de99-b12c-4dd6-8345-9017bdcb4305 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:40.243536 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-99c4de99-b12c-4dd6-8345-9017bdcb4305 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "POST /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/action" status: 200 len: 38025 microversion: 2.20 time: 0.103380 Jul 26 07:35:40.244175 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 615/1178] 10.222.0.39 () {62 vars in 1319 bytes} [Tue Jul 26 07:35:40 2022] POST /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0/action => generated 38025 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 26 07:35:41.000235 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-13857a7f-416f-4110-9712-5a3ddd21674f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:41.002428 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-13857a7f-416f-4110-9712-5a3ddd21674f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:41.009089 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-13857a7f-416f-4110-9712-5a3ddd21674f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:41.009534 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-13857a7f-416f-4110-9712-5a3ddd21674f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:41.010349 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-13857a7f-416f-4110-9712-5a3ddd21674f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:41.010774 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-13857a7f-416f-4110-9712-5a3ddd21674f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:41.013205 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:41.043068 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-13857a7f-416f-4110-9712-5a3ddd21674f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046790 Jul 26 07:35:41.043621 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 564/1179] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:40 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:42.056296 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ae182eb9-3f1d-43eb-8f79-35790e1fbb29 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:42.058558 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ae182eb9-3f1d-43eb-8f79-35790e1fbb29 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:42.061086 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=60 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:42.066928 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ae182eb9-3f1d-43eb-8f79-35790e1fbb29 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:42.067396 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ae182eb9-3f1d-43eb-8f79-35790e1fbb29 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:42.068163 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ae182eb9-3f1d-43eb-8f79-35790e1fbb29 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:42.068588 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ae182eb9-3f1d-43eb-8f79-35790e1fbb29 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:42.104548 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ae182eb9-3f1d-43eb-8f79-35790e1fbb29 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052832 Jul 26 07:35:42.105105 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 616/1180] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:42 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:43.116790 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-fc7c701f-a443-4dc1-9dba-e877ed29cc07 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:43.119121 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-fc7c701f-a443-4dc1-9dba-e877ed29cc07 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:43.125759 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fc7c701f-a443-4dc1-9dba-e877ed29cc07 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:43.126248 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fc7c701f-a443-4dc1-9dba-e877ed29cc07 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:43.127012 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fc7c701f-a443-4dc1-9dba-e877ed29cc07 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:43.127481 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fc7c701f-a443-4dc1-9dba-e877ed29cc07 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:43.161287 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-fc7c701f-a443-4dc1-9dba-e877ed29cc07 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048370 Jul 26 07:35:43.161877 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 565/1181] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:43 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:44.173068 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-180a5690-1134-42d6-8181-4462a182356b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:44.175326 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-180a5690-1134-42d6-8181-4462a182356b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:44.182844 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-180a5690-1134-42d6-8181-4462a182356b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:44.183287 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-180a5690-1134-42d6-8181-4462a182356b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:44.184067 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-180a5690-1134-42d6-8181-4462a182356b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:44.184499 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-180a5690-1134-42d6-8181-4462a182356b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:44.214647 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-180a5690-1134-42d6-8181-4462a182356b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045594 Jul 26 07:35:44.215550 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 617/1182] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:44 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:45.227823 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-42ce8221-943a-4a3d-9cb1-ffe9e0cb19ac tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:45.230145 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-42ce8221-943a-4a3d-9cb1-ffe9e0cb19ac tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:45.236382 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-42ce8221-943a-4a3d-9cb1-ffe9e0cb19ac tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:45.236828 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-42ce8221-943a-4a3d-9cb1-ffe9e0cb19ac tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:45.237660 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-42ce8221-943a-4a3d-9cb1-ffe9e0cb19ac tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:45.238126 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-42ce8221-943a-4a3d-9cb1-ffe9e0cb19ac tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:45.267318 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-42ce8221-943a-4a3d-9cb1-ffe9e0cb19ac tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043789 Jul 26 07:35:45.267870 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 566/1183] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:45 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:46.280133 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-df5b6098-a1ab-4064-b611-d787d44bd43e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:46.282633 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-df5b6098-a1ab-4064-b611-d787d44bd43e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:46.289482 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-df5b6098-a1ab-4064-b611-d787d44bd43e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:46.290077 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-df5b6098-a1ab-4064-b611-d787d44bd43e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:46.290844 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-df5b6098-a1ab-4064-b611-d787d44bd43e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:46.291429 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-df5b6098-a1ab-4064-b611-d787d44bd43e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:46.323889 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-df5b6098-a1ab-4064-b611-d787d44bd43e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047756 Jul 26 07:35:46.324465 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 618/1184] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:46 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:47.199015 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 07:35:47.199569 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Tue Jul 26 07:35:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 07:35:47.336952 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d73cf3f5-1107-4e34-b757-46e82ef504c5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:47.339638 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d73cf3f5-1107-4e34-b757-46e82ef504c5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:47.346905 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d73cf3f5-1107-4e34-b757-46e82ef504c5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:47.347345 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d73cf3f5-1107-4e34-b757-46e82ef504c5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:47.348097 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d73cf3f5-1107-4e34-b757-46e82ef504c5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:47.348508 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d73cf3f5-1107-4e34-b757-46e82ef504c5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:47.380790 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d73cf3f5-1107-4e34-b757-46e82ef504c5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047837 Jul 26 07:35:47.381794 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 567/1185] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:47 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:48.394151 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-2bd21c8b-56b5-40ff-998a-47c95409b7e2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:48.396332 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2bd21c8b-56b5-40ff-998a-47c95409b7e2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:48.403165 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2bd21c8b-56b5-40ff-998a-47c95409b7e2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:48.403608 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2bd21c8b-56b5-40ff-998a-47c95409b7e2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:48.404403 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2bd21c8b-56b5-40ff-998a-47c95409b7e2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:48.404827 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2bd21c8b-56b5-40ff-998a-47c95409b7e2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:48.436521 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-2bd21c8b-56b5-40ff-998a-47c95409b7e2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046778 Jul 26 07:35:48.441148 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 619/1186] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:48 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:49.449884 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-db57eba7-1899-48be-a933-65250ec8c65b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:49.452864 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-db57eba7-1899-48be-a933-65250ec8c65b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:49.462441 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-db57eba7-1899-48be-a933-65250ec8c65b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:49.462971 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-db57eba7-1899-48be-a933-65250ec8c65b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:49.463873 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-db57eba7-1899-48be-a933-65250ec8c65b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:49.464169 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-db57eba7-1899-48be-a933-65250ec8c65b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:49.495887 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-db57eba7-1899-48be-a933-65250ec8c65b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050131 Jul 26 07:35:49.496473 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 568/1187] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:49 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:50.513069 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-5165c0f6-a478-4221-8de0-b75382411483 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:50.515245 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-5165c0f6-a478-4221-8de0-b75382411483 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:50.522472 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5165c0f6-a478-4221-8de0-b75382411483 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:50.522923 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5165c0f6-a478-4221-8de0-b75382411483 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:50.523696 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5165c0f6-a478-4221-8de0-b75382411483 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:50.524132 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5165c0f6-a478-4221-8de0-b75382411483 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:50.556139 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-5165c0f6-a478-4221-8de0-b75382411483 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048313 Jul 26 07:35:50.556703 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 620/1188] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:50 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:51.568886 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6a552844-53e0-4501-8c3b-0d14ccc73294 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:51.571081 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6a552844-53e0-4501-8c3b-0d14ccc73294 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:51.578187 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6a552844-53e0-4501-8c3b-0d14ccc73294 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:51.578634 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6a552844-53e0-4501-8c3b-0d14ccc73294 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:51.579396 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6a552844-53e0-4501-8c3b-0d14ccc73294 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:51.579824 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6a552844-53e0-4501-8c3b-0d14ccc73294 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:51.610917 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6a552844-53e0-4501-8c3b-0d14ccc73294 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046056 Jul 26 07:35:51.611508 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 569/1189] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:51 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:52.623371 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a04ae306-47f0-48fd-bfe3-cff1b87c9ab0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:52.625548 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a04ae306-47f0-48fd-bfe3-cff1b87c9ab0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:52.633205 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a04ae306-47f0-48fd-bfe3-cff1b87c9ab0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:52.633643 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a04ae306-47f0-48fd-bfe3-cff1b87c9ab0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:52.634542 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a04ae306-47f0-48fd-bfe3-cff1b87c9ab0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:52.634971 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a04ae306-47f0-48fd-bfe3-cff1b87c9ab0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:52.668298 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a04ae306-47f0-48fd-bfe3-cff1b87c9ab0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048897 Jul 26 07:35:52.668874 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 621/1190] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:52 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:53.682284 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9635331b-d092-44f3-9433-a833d1b404f3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:53.684476 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-9635331b-d092-44f3-9433-a833d1b404f3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:53.691457 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9635331b-d092-44f3-9433-a833d1b404f3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:53.691977 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9635331b-d092-44f3-9433-a833d1b404f3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:53.692670 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9635331b-d092-44f3-9433-a833d1b404f3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:53.693103 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9635331b-d092-44f3-9433-a833d1b404f3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:53.724912 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-9635331b-d092-44f3-9433-a833d1b404f3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046828 Jul 26 07:35:53.725493 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 570/1191] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:53 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:54.737443 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-2609d63c-c50a-4531-8867-45c9d66e10d1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:54.739624 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2609d63c-c50a-4531-8867-45c9d66e10d1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:54.746741 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2609d63c-c50a-4531-8867-45c9d66e10d1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:54.747186 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2609d63c-c50a-4531-8867-45c9d66e10d1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:54.747987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2609d63c-c50a-4531-8867-45c9d66e10d1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:54.748387 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2609d63c-c50a-4531-8867-45c9d66e10d1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:54.779984 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-2609d63c-c50a-4531-8867-45c9d66e10d1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046833 Jul 26 07:35:54.780568 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 622/1192] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:54 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:55.794235 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-59c7b564-4cef-45eb-ad63-acd4226ef01b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:55.796366 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-59c7b564-4cef-45eb-ad63-acd4226ef01b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:55.803485 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-59c7b564-4cef-45eb-ad63-acd4226ef01b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:55.803926 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-59c7b564-4cef-45eb-ad63-acd4226ef01b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:55.804677 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-59c7b564-4cef-45eb-ad63-acd4226ef01b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:55.805096 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-59c7b564-4cef-45eb-ad63-acd4226ef01b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:55.835440 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-59c7b564-4cef-45eb-ad63-acd4226ef01b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045879 Jul 26 07:35:55.840180 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 571/1193] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:55 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:56.848481 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-5800403e-a5c1-44f0-95b2-2191f77cfc9b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:56.850702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-5800403e-a5c1-44f0-95b2-2191f77cfc9b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:56.857884 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5800403e-a5c1-44f0-95b2-2191f77cfc9b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:56.858303 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5800403e-a5c1-44f0-95b2-2191f77cfc9b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:56.859057 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5800403e-a5c1-44f0-95b2-2191f77cfc9b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:56.859482 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5800403e-a5c1-44f0-95b2-2191f77cfc9b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:56.888929 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-5800403e-a5c1-44f0-95b2-2191f77cfc9b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044504 Jul 26 07:35:56.889477 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 623/1194] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:56 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:57.904680 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b23b3a62-46fc-4f06-9f0f-e3fdac38eeab tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:57.907342 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-b23b3a62-46fc-4f06-9f0f-e3fdac38eeab tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:57.916790 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b23b3a62-46fc-4f06-9f0f-e3fdac38eeab tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:57.917239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b23b3a62-46fc-4f06-9f0f-e3fdac38eeab tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:57.918019 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b23b3a62-46fc-4f06-9f0f-e3fdac38eeab tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:57.918444 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b23b3a62-46fc-4f06-9f0f-e3fdac38eeab tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:57.947746 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b23b3a62-46fc-4f06-9f0f-e3fdac38eeab tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049274 Jul 26 07:35:57.948282 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 572/1195] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:57 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:35:58.961970 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-39cdb7db-f8b1-4830-aa5e-375cb99108bd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:35:58.964080 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-39cdb7db-f8b1-4830-aa5e-375cb99108bd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:35:58.971259 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-39cdb7db-f8b1-4830-aa5e-375cb99108bd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:58.971699 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-39cdb7db-f8b1-4830-aa5e-375cb99108bd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:58.972456 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-39cdb7db-f8b1-4830-aa5e-375cb99108bd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:35:58.973053 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-39cdb7db-f8b1-4830-aa5e-375cb99108bd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:35:58.999847 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:59.006964 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-39cdb7db-f8b1-4830-aa5e-375cb99108bd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050297 Jul 26 07:35:59.007542 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 624/1196] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:35:58 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:00.019931 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-80a7d15b-355d-4cf5-91dc-0d63b4b37473 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:00.022165 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-80a7d15b-355d-4cf5-91dc-0d63b4b37473 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:00.029177 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-80a7d15b-355d-4cf5-91dc-0d63b4b37473 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:00.029693 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-80a7d15b-355d-4cf5-91dc-0d63b4b37473 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:00.030668 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-80a7d15b-355d-4cf5-91dc-0d63b4b37473 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:00.031102 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-80a7d15b-355d-4cf5-91dc-0d63b4b37473 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:00.062337 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-80a7d15b-355d-4cf5-91dc-0d63b4b37473 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046429 Jul 26 07:36:00.063112 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 573/1197] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:00 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:01.076442 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-06dced0b-64a7-452e-ba77-3686ec77d16d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:01.078638 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-06dced0b-64a7-452e-ba77-3686ec77d16d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:01.086089 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-06dced0b-64a7-452e-ba77-3686ec77d16d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:01.086530 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-06dced0b-64a7-452e-ba77-3686ec77d16d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:01.087288 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-06dced0b-64a7-452e-ba77-3686ec77d16d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:01.087715 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-06dced0b-64a7-452e-ba77-3686ec77d16d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:01.118042 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-06dced0b-64a7-452e-ba77-3686ec77d16d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045547 Jul 26 07:36:01.118637 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 625/1198] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:01 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:02.134271 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0b3e6037-91eb-4619-9ae2-eef9812bea7a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:02.137273 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0b3e6037-91eb-4619-9ae2-eef9812bea7a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:02.146766 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0b3e6037-91eb-4619-9ae2-eef9812bea7a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:02.147402 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0b3e6037-91eb-4619-9ae2-eef9812bea7a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:02.148485 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0b3e6037-91eb-4619-9ae2-eef9812bea7a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:02.149115 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0b3e6037-91eb-4619-9ae2-eef9812bea7a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:02.179587 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0b3e6037-91eb-4619-9ae2-eef9812bea7a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051145 Jul 26 07:36:02.180149 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 574/1199] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:02 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:03.193421 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a5860b6a-4514-4629-9c18-31524767cd5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:03.196147 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a5860b6a-4514-4629-9c18-31524767cd5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:03.203599 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a5860b6a-4514-4629-9c18-31524767cd5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:03.204045 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a5860b6a-4514-4629-9c18-31524767cd5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:03.204819 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a5860b6a-4514-4629-9c18-31524767cd5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:03.205249 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a5860b6a-4514-4629-9c18-31524767cd5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:03.238892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a5860b6a-4514-4629-9c18-31524767cd5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050465 Jul 26 07:36:03.239427 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 626/1200] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:03 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:04.252361 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-521ff257-fcf5-4faf-baea-878b0beae30a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:04.254577 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-521ff257-fcf5-4faf-baea-878b0beae30a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:04.261432 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-521ff257-fcf5-4faf-baea-878b0beae30a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:04.261916 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-521ff257-fcf5-4faf-baea-878b0beae30a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:04.262700 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-521ff257-fcf5-4faf-baea-878b0beae30a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:04.263129 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-521ff257-fcf5-4faf-baea-878b0beae30a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:04.295153 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-521ff257-fcf5-4faf-baea-878b0beae30a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046801 Jul 26 07:36:04.295703 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 575/1201] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:04 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:05.313630 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-60e46e5d-6649-4406-b997-02c9dccc925c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:05.316159 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-60e46e5d-6649-4406-b997-02c9dccc925c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:05.325160 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-60e46e5d-6649-4406-b997-02c9dccc925c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:05.325600 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-60e46e5d-6649-4406-b997-02c9dccc925c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:05.326406 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-60e46e5d-6649-4406-b997-02c9dccc925c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:05.326849 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-60e46e5d-6649-4406-b997-02c9dccc925c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:05.362014 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-60e46e5d-6649-4406-b997-02c9dccc925c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054420 Jul 26 07:36:05.362589 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 627/1202] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:05 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:06.143667 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 07:36:06.144277 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Tue Jul 26 07:36:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 07:36:06.378533 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-372c712d-4936-4a3e-84a2-2f9b6c0c7d6a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:06.381001 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-372c712d-4936-4a3e-84a2-2f9b6c0c7d6a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:06.389149 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-372c712d-4936-4a3e-84a2-2f9b6c0c7d6a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:06.389640 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-372c712d-4936-4a3e-84a2-2f9b6c0c7d6a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:06.390530 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-372c712d-4936-4a3e-84a2-2f9b6c0c7d6a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:06.391014 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-372c712d-4936-4a3e-84a2-2f9b6c0c7d6a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:06.423127 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-372c712d-4936-4a3e-84a2-2f9b6c0c7d6a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049209 Jul 26 07:36:06.423602 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 576/1203] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:06 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:07.437147 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a2df1dbd-7f47-4361-81b2-fd000f6a5988 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:07.439344 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a2df1dbd-7f47-4361-81b2-fd000f6a5988 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:07.446396 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a2df1dbd-7f47-4361-81b2-fd000f6a5988 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:07.446834 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a2df1dbd-7f47-4361-81b2-fd000f6a5988 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:07.447606 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a2df1dbd-7f47-4361-81b2-fd000f6a5988 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:07.448036 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a2df1dbd-7f47-4361-81b2-fd000f6a5988 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:07.477493 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a2df1dbd-7f47-4361-81b2-fd000f6a5988 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044788 Jul 26 07:36:07.478085 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 628/1204] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:07 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:08.490934 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a25729f3-c10d-4830-b3ea-bbe274b02e21 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:08.493368 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a25729f3-c10d-4830-b3ea-bbe274b02e21 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:08.502142 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a25729f3-c10d-4830-b3ea-bbe274b02e21 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:08.502774 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a25729f3-c10d-4830-b3ea-bbe274b02e21 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:08.503766 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a25729f3-c10d-4830-b3ea-bbe274b02e21 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:08.504360 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a25729f3-c10d-4830-b3ea-bbe274b02e21 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:08.536145 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a25729f3-c10d-4830-b3ea-bbe274b02e21 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049844 Jul 26 07:36:08.536665 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 577/1205] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:08 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:09.548803 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8ccf12bc-8f8a-4e2e-81e3-29b07d73d100 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:09.551011 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8ccf12bc-8f8a-4e2e-81e3-29b07d73d100 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:09.558313 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ccf12bc-8f8a-4e2e-81e3-29b07d73d100 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:09.558756 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ccf12bc-8f8a-4e2e-81e3-29b07d73d100 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:09.559529 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ccf12bc-8f8a-4e2e-81e3-29b07d73d100 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:09.560066 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ccf12bc-8f8a-4e2e-81e3-29b07d73d100 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:09.589904 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8ccf12bc-8f8a-4e2e-81e3-29b07d73d100 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044722 Jul 26 07:36:09.590463 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 629/1206] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:09 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:10.605427 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d8692c85-c7a5-4d76-adab-1033d0a8f7fb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:10.607723 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d8692c85-c7a5-4d76-adab-1033d0a8f7fb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:10.610180 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=30 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:36:10.615821 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d8692c85-c7a5-4d76-adab-1033d0a8f7fb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:10.616257 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d8692c85-c7a5-4d76-adab-1033d0a8f7fb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:10.617011 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d8692c85-c7a5-4d76-adab-1033d0a8f7fb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:10.617436 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d8692c85-c7a5-4d76-adab-1033d0a8f7fb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:10.647386 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d8692c85-c7a5-4d76-adab-1033d0a8f7fb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047745 Jul 26 07:36:10.647959 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 578/1207] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:10 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:11.661001 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6708f3b3-ff48-4212-9764-67c013ae920c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:11.663201 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-6708f3b3-ff48-4212-9764-67c013ae920c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:11.670256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6708f3b3-ff48-4212-9764-67c013ae920c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:11.670706 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6708f3b3-ff48-4212-9764-67c013ae920c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:11.671474 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6708f3b3-ff48-4212-9764-67c013ae920c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:11.671905 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6708f3b3-ff48-4212-9764-67c013ae920c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:11.703284 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6708f3b3-ff48-4212-9764-67c013ae920c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046128 Jul 26 07:36:11.703764 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 630/1208] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:11 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:12.716204 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-66fc696a-6868-44ad-b565-fb7f42a8d718 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:12.718602 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-66fc696a-6868-44ad-b565-fb7f42a8d718 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:12.726026 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-66fc696a-6868-44ad-b565-fb7f42a8d718 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:12.726627 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-66fc696a-6868-44ad-b565-fb7f42a8d718 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:12.727443 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-66fc696a-6868-44ad-b565-fb7f42a8d718 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:12.727882 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-66fc696a-6868-44ad-b565-fb7f42a8d718 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:12.730538 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=90 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:36:12.758906 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-66fc696a-6868-44ad-b565-fb7f42a8d718 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047064 Jul 26 07:36:12.759480 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 579/1209] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:12 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:13.931666 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c4a9dc0a-9702-4fd2-bdc2-004924a1ddb1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:13.933833 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c4a9dc0a-9702-4fd2-bdc2-004924a1ddb1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:13.935782 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=30 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:36:13.941378 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c4a9dc0a-9702-4fd2-bdc2-004924a1ddb1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:13.941844 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c4a9dc0a-9702-4fd2-bdc2-004924a1ddb1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:13.942606 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c4a9dc0a-9702-4fd2-bdc2-004924a1ddb1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:13.943039 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c4a9dc0a-9702-4fd2-bdc2-004924a1ddb1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:13.973238 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c4a9dc0a-9702-4fd2-bdc2-004924a1ddb1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.205479 Jul 26 07:36:13.973795 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 631/1210] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:13 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:14.987335 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6a45d0a3-65e2-4158-ba61-95e683db1adc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:14.989433 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6a45d0a3-65e2-4158-ba61-95e683db1adc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:14.996169 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6a45d0a3-65e2-4158-ba61-95e683db1adc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:14.996612 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6a45d0a3-65e2-4158-ba61-95e683db1adc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:14.997387 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6a45d0a3-65e2-4158-ba61-95e683db1adc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:14.997861 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6a45d0a3-65e2-4158-ba61-95e683db1adc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:15.029147 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6a45d0a3-65e2-4158-ba61-95e683db1adc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046244 Jul 26 07:36:15.029704 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 580/1211] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:14 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:16.042404 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-29664def-123f-41eb-92f8-54fdc6cf3736 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:16.044549 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-29664def-123f-41eb-92f8-54fdc6cf3736 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:16.051772 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-29664def-123f-41eb-92f8-54fdc6cf3736 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:16.052215 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-29664def-123f-41eb-92f8-54fdc6cf3736 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:16.052981 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-29664def-123f-41eb-92f8-54fdc6cf3736 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:16.053408 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-29664def-123f-41eb-92f8-54fdc6cf3736 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:16.091348 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-29664def-123f-41eb-92f8-54fdc6cf3736 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052841 Jul 26 07:36:16.092027 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 632/1212] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:16 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:17.109076 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-14225ed5-1274-4a71-a2d0-64bf4b2e5fb5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:17.111307 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-14225ed5-1274-4a71-a2d0-64bf4b2e5fb5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:17.118100 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-14225ed5-1274-4a71-a2d0-64bf4b2e5fb5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:17.118552 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-14225ed5-1274-4a71-a2d0-64bf4b2e5fb5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:17.119314 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-14225ed5-1274-4a71-a2d0-64bf4b2e5fb5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:17.119750 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-14225ed5-1274-4a71-a2d0-64bf4b2e5fb5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:17.150242 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-14225ed5-1274-4a71-a2d0-64bf4b2e5fb5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048162 Jul 26 07:36:17.150953 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 581/1213] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:17 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:18.166536 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d43f94d2-626b-4aac-ae1c-5d61f6fa56a9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:18.169707 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d43f94d2-626b-4aac-ae1c-5d61f6fa56a9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:18.177631 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d43f94d2-626b-4aac-ae1c-5d61f6fa56a9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:18.178110 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d43f94d2-626b-4aac-ae1c-5d61f6fa56a9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:18.178865 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d43f94d2-626b-4aac-ae1c-5d61f6fa56a9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:18.179325 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d43f94d2-626b-4aac-ae1c-5d61f6fa56a9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:18.210892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d43f94d2-626b-4aac-ae1c-5d61f6fa56a9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050823 Jul 26 07:36:18.211457 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 633/1214] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:18 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:19.224463 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-eddc234b-3503-484d-a2b7-04756bd8a506 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:19.226578 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-eddc234b-3503-484d-a2b7-04756bd8a506 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:19.234317 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-eddc234b-3503-484d-a2b7-04756bd8a506 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:19.234931 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-eddc234b-3503-484d-a2b7-04756bd8a506 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:19.235805 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-eddc234b-3503-484d-a2b7-04756bd8a506 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:19.236236 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-eddc234b-3503-484d-a2b7-04756bd8a506 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:19.270992 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-eddc234b-3503-484d-a2b7-04756bd8a506 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050433 Jul 26 07:36:19.271383 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 582/1215] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:19 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:20.283887 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9c645b7c-1ef8-4958-a288-a2a410538fda tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:20.286113 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-9c645b7c-1ef8-4958-a288-a2a410538fda tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:20.293070 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9c645b7c-1ef8-4958-a288-a2a410538fda tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:20.293521 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9c645b7c-1ef8-4958-a288-a2a410538fda tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:20.294332 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9c645b7c-1ef8-4958-a288-a2a410538fda tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:20.294768 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9c645b7c-1ef8-4958-a288-a2a410538fda tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:20.324653 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-9c645b7c-1ef8-4958-a288-a2a410538fda tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044866 Jul 26 07:36:20.325205 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 634/1216] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:20 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:21.337878 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-079cddc8-62df-44a2-9cb2-7bcad92440b3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:21.340405 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-079cddc8-62df-44a2-9cb2-7bcad92440b3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:21.347717 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-079cddc8-62df-44a2-9cb2-7bcad92440b3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:21.348168 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-079cddc8-62df-44a2-9cb2-7bcad92440b3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:21.348930 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-079cddc8-62df-44a2-9cb2-7bcad92440b3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:21.349357 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-079cddc8-62df-44a2-9cb2-7bcad92440b3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:21.380615 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-079cddc8-62df-44a2-9cb2-7bcad92440b3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046864 Jul 26 07:36:21.381170 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 583/1217] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:21 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:22.395604 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-dd1dbc76-e402-44b8-8670-78f1e3054ebd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:22.397908 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-dd1dbc76-e402-44b8-8670-78f1e3054ebd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:22.405654 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dd1dbc76-e402-44b8-8670-78f1e3054ebd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:22.406185 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dd1dbc76-e402-44b8-8670-78f1e3054ebd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:22.407025 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dd1dbc76-e402-44b8-8670-78f1e3054ebd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:22.407504 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dd1dbc76-e402-44b8-8670-78f1e3054ebd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:22.438619 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-dd1dbc76-e402-44b8-8670-78f1e3054ebd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047871 Jul 26 07:36:22.439148 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 635/1218] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:22 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:23.454893 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-930246bc-db93-4908-99ae-27f9ae1db296 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:23.458220 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-930246bc-db93-4908-99ae-27f9ae1db296 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:23.469212 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-930246bc-db93-4908-99ae-27f9ae1db296 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:23.469660 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-930246bc-db93-4908-99ae-27f9ae1db296 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:23.470442 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-930246bc-db93-4908-99ae-27f9ae1db296 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:23.470870 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-930246bc-db93-4908-99ae-27f9ae1db296 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:23.501445 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-930246bc-db93-4908-99ae-27f9ae1db296 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052984 Jul 26 07:36:23.502033 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 584/1219] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:23 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:24.520010 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-bdaf4a3c-cdef-4451-ba41-7c9d9ed5ccbb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:24.523448 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-bdaf4a3c-cdef-4451-ba41-7c9d9ed5ccbb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:24.533310 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bdaf4a3c-cdef-4451-ba41-7c9d9ed5ccbb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:24.533784 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bdaf4a3c-cdef-4451-ba41-7c9d9ed5ccbb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:24.534554 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bdaf4a3c-cdef-4451-ba41-7c9d9ed5ccbb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:24.534980 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bdaf4a3c-cdef-4451-ba41-7c9d9ed5ccbb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:24.566160 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-bdaf4a3c-cdef-4451-ba41-7c9d9ed5ccbb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052868 Jul 26 07:36:24.566719 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 636/1220] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:24 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:25.581003 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-292f63f5-9c95-46c9-84ca-e36aff880f92 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:25.583250 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-292f63f5-9c95-46c9-84ca-e36aff880f92 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:25.590532 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-292f63f5-9c95-46c9-84ca-e36aff880f92 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:25.590956 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-292f63f5-9c95-46c9-84ca-e36aff880f92 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:25.591750 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-292f63f5-9c95-46c9-84ca-e36aff880f92 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:25.592184 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-292f63f5-9c95-46c9-84ca-e36aff880f92 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:25.622410 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-292f63f5-9c95-46c9-84ca-e36aff880f92 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046673 Jul 26 07:36:25.622955 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 585/1221] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:25 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:26.635370 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e589e27e-e6f5-42d2-81c4-5ff30a65eb90 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:26.637431 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e589e27e-e6f5-42d2-81c4-5ff30a65eb90 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:26.644429 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e589e27e-e6f5-42d2-81c4-5ff30a65eb90 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:26.644897 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e589e27e-e6f5-42d2-81c4-5ff30a65eb90 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:26.645650 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e589e27e-e6f5-42d2-81c4-5ff30a65eb90 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:26.646104 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e589e27e-e6f5-42d2-81c4-5ff30a65eb90 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:26.676847 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e589e27e-e6f5-42d2-81c4-5ff30a65eb90 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045515 Jul 26 07:36:26.677433 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 637/1222] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:26 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:27.691388 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-adcb94ec-5152-4f02-8545-9b7479b8ed82 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:27.693443 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-adcb94ec-5152-4f02-8545-9b7479b8ed82 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:27.702244 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-adcb94ec-5152-4f02-8545-9b7479b8ed82 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:27.703013 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-adcb94ec-5152-4f02-8545-9b7479b8ed82 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:27.704379 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-adcb94ec-5152-4f02-8545-9b7479b8ed82 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:27.705139 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-adcb94ec-5152-4f02-8545-9b7479b8ed82 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:27.757320 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-adcb94ec-5152-4f02-8545-9b7479b8ed82 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069871 Jul 26 07:36:27.758338 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 586/1223] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:27 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:28.775785 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-cf764fc0-b2d2-4e1a-8369-32aabd1a1888 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:28.779027 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-cf764fc0-b2d2-4e1a-8369-32aabd1a1888 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:28.787042 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cf764fc0-b2d2-4e1a-8369-32aabd1a1888 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:28.787484 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cf764fc0-b2d2-4e1a-8369-32aabd1a1888 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:28.788236 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cf764fc0-b2d2-4e1a-8369-32aabd1a1888 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:28.788659 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cf764fc0-b2d2-4e1a-8369-32aabd1a1888 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:28.819325 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-cf764fc0-b2d2-4e1a-8369-32aabd1a1888 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049540 Jul 26 07:36:28.819920 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 638/1224] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:28 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:29.832262 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-03e98a00-ae8d-46db-af51-6675f65b2484 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:29.834454 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-03e98a00-ae8d-46db-af51-6675f65b2484 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:29.841774 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-03e98a00-ae8d-46db-af51-6675f65b2484 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:29.842229 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-03e98a00-ae8d-46db-af51-6675f65b2484 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:29.843000 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-03e98a00-ae8d-46db-af51-6675f65b2484 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:29.843429 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-03e98a00-ae8d-46db-af51-6675f65b2484 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:29.874786 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-03e98a00-ae8d-46db-af51-6675f65b2484 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046601 Jul 26 07:36:29.875508 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 587/1225] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:29 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:30.887236 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7e5867bb-b3ad-4971-8f08-8e99f57a8ece tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:30.889375 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7e5867bb-b3ad-4971-8f08-8e99f57a8ece tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:30.896400 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7e5867bb-b3ad-4971-8f08-8e99f57a8ece tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:30.896846 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7e5867bb-b3ad-4971-8f08-8e99f57a8ece tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:30.897613 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7e5867bb-b3ad-4971-8f08-8e99f57a8ece tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:30.898057 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7e5867bb-b3ad-4971-8f08-8e99f57a8ece tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:30.927751 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7e5867bb-b3ad-4971-8f08-8e99f57a8ece tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044559 Jul 26 07:36:30.928326 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 639/1226] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:30 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:31.941557 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2466089d-4c14-4348-9cd3-cc08bf1dae73 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:31.943904 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2466089d-4c14-4348-9cd3-cc08bf1dae73 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:31.950910 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2466089d-4c14-4348-9cd3-cc08bf1dae73 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:31.951360 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2466089d-4c14-4348-9cd3-cc08bf1dae73 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:31.952112 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2466089d-4c14-4348-9cd3-cc08bf1dae73 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:31.952511 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2466089d-4c14-4348-9cd3-cc08bf1dae73 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:31.982579 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2466089d-4c14-4348-9cd3-cc08bf1dae73 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045899 Jul 26 07:36:31.983124 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 588/1227] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:31 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:32.995056 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9e55fd79-3b56-41e7-92f4-aecd71d84f7a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:32.997231 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-9e55fd79-3b56-41e7-92f4-aecd71d84f7a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:33.004254 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9e55fd79-3b56-41e7-92f4-aecd71d84f7a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:33.004730 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9e55fd79-3b56-41e7-92f4-aecd71d84f7a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:33.005497 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9e55fd79-3b56-41e7-92f4-aecd71d84f7a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:33.005968 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9e55fd79-3b56-41e7-92f4-aecd71d84f7a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:33.008346 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=92 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:36:33.035946 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-9e55fd79-3b56-41e7-92f4-aecd71d84f7a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044951 Jul 26 07:36:33.036500 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 640/1228] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:32 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:34.048855 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8d6daf3e-088f-4fb4-ab7b-4a56d2fa5ea2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:34.050945 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8d6daf3e-088f-4fb4-ab7b-4a56d2fa5ea2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:34.058113 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8d6daf3e-088f-4fb4-ab7b-4a56d2fa5ea2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:34.058557 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8d6daf3e-088f-4fb4-ab7b-4a56d2fa5ea2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:34.059309 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8d6daf3e-088f-4fb4-ab7b-4a56d2fa5ea2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:34.059735 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8d6daf3e-088f-4fb4-ab7b-4a56d2fa5ea2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:34.100467 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8d6daf3e-088f-4fb4-ab7b-4a56d2fa5ea2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055243 Jul 26 07:36:34.101039 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 589/1229] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:34 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:35.114798 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-893e3ee8-9c76-472e-9c7d-5b5ac5c90c05 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:35.117253 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-893e3ee8-9c76-472e-9c7d-5b5ac5c90c05 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:35.124315 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-893e3ee8-9c76-472e-9c7d-5b5ac5c90c05 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:35.124766 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-893e3ee8-9c76-472e-9c7d-5b5ac5c90c05 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:35.125527 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-893e3ee8-9c76-472e-9c7d-5b5ac5c90c05 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:35.125978 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-893e3ee8-9c76-472e-9c7d-5b5ac5c90c05 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:35.157844 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-893e3ee8-9c76-472e-9c7d-5b5ac5c90c05 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048303 Jul 26 07:36:35.158415 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 641/1230] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:35 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:36.170958 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d42e1432-78c5-4a6a-9955-7e31c91ba90f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:36.173374 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d42e1432-78c5-4a6a-9955-7e31c91ba90f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:36.182916 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d42e1432-78c5-4a6a-9955-7e31c91ba90f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:36.183355 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d42e1432-78c5-4a6a-9955-7e31c91ba90f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:36.184679 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d42e1432-78c5-4a6a-9955-7e31c91ba90f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:36.185787 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d42e1432-78c5-4a6a-9955-7e31c91ba90f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:36.218324 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d42e1432-78c5-4a6a-9955-7e31c91ba90f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051404 Jul 26 07:36:36.218870 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 590/1231] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:36 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:37.231152 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-583acb32-53b1-4845-accf-c7481ca257d7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:37.233362 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-583acb32-53b1-4845-accf-c7481ca257d7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:37.241063 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-583acb32-53b1-4845-accf-c7481ca257d7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:37.241644 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-583acb32-53b1-4845-accf-c7481ca257d7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:37.242557 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-583acb32-53b1-4845-accf-c7481ca257d7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:37.243006 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-583acb32-53b1-4845-accf-c7481ca257d7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:37.273682 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-583acb32-53b1-4845-accf-c7481ca257d7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046575 Jul 26 07:36:37.274285 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 642/1232] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:37 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:38.288610 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-15531e16-4161-41be-9c3e-07bbd801fd0a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:38.290830 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-15531e16-4161-41be-9c3e-07bbd801fd0a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:38.297490 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-15531e16-4161-41be-9c3e-07bbd801fd0a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:38.298026 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-15531e16-4161-41be-9c3e-07bbd801fd0a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:38.298811 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-15531e16-4161-41be-9c3e-07bbd801fd0a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:38.299244 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-15531e16-4161-41be-9c3e-07bbd801fd0a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:38.329079 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-15531e16-4161-41be-9c3e-07bbd801fd0a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046447 Jul 26 07:36:38.329638 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 591/1233] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:38 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:39.343741 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d0691828-d527-4332-a166-711308c05ef1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:39.345862 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d0691828-d527-4332-a166-711308c05ef1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:39.353061 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d0691828-d527-4332-a166-711308c05ef1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:39.353514 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d0691828-d527-4332-a166-711308c05ef1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:39.354315 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d0691828-d527-4332-a166-711308c05ef1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:39.354748 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d0691828-d527-4332-a166-711308c05ef1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:39.385089 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d0691828-d527-4332-a166-711308c05ef1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046043 Jul 26 07:36:39.385646 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 643/1234] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:39 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:40.397209 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-171dae6e-dd3f-438c-bd50-7142b3ec9531 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:40.399319 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-171dae6e-dd3f-438c-bd50-7142b3ec9531 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:40.406611 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-171dae6e-dd3f-438c-bd50-7142b3ec9531 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:40.407060 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-171dae6e-dd3f-438c-bd50-7142b3ec9531 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:40.407819 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-171dae6e-dd3f-438c-bd50-7142b3ec9531 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:40.408245 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-171dae6e-dd3f-438c-bd50-7142b3ec9531 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:40.439867 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-171dae6e-dd3f-438c-bd50-7142b3ec9531 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046650 Jul 26 07:36:40.440371 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 592/1235] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:40 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:41.454088 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-cd704862-6162-4d70-b8a4-7f9989deab24 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:41.457184 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-cd704862-6162-4d70-b8a4-7f9989deab24 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:41.466505 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cd704862-6162-4d70-b8a4-7f9989deab24 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:41.466949 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cd704862-6162-4d70-b8a4-7f9989deab24 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:41.467710 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cd704862-6162-4d70-b8a4-7f9989deab24 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:41.468144 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cd704862-6162-4d70-b8a4-7f9989deab24 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:41.497420 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-cd704862-6162-4d70-b8a4-7f9989deab24 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049056 Jul 26 07:36:41.498013 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 644/1236] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:41 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:42.513390 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8c26db1d-a00b-4d0a-8867-f4c1d389b2e9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:42.515768 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8c26db1d-a00b-4d0a-8867-f4c1d389b2e9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:42.518519 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=30 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:36:42.524258 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8c26db1d-a00b-4d0a-8867-f4c1d389b2e9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:42.524717 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8c26db1d-a00b-4d0a-8867-f4c1d389b2e9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:42.525479 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8c26db1d-a00b-4d0a-8867-f4c1d389b2e9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:42.525945 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8c26db1d-a00b-4d0a-8867-f4c1d389b2e9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:42.555197 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8c26db1d-a00b-4d0a-8867-f4c1d389b2e9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047562 Jul 26 07:36:42.555774 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 593/1237] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:42 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:43.574270 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-5f877431-c21f-408c-98b6-8fc669599c1f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:43.577494 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-5f877431-c21f-408c-98b6-8fc669599c1f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:43.586314 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5f877431-c21f-408c-98b6-8fc669599c1f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:43.586830 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5f877431-c21f-408c-98b6-8fc669599c1f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:43.587946 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5f877431-c21f-408c-98b6-8fc669599c1f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:43.588802 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5f877431-c21f-408c-98b6-8fc669599c1f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:43.620060 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-5f877431-c21f-408c-98b6-8fc669599c1f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053010 Jul 26 07:36:43.620701 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 645/1238] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:43 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:44.635991 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-714b7a50-b126-43b2-a8ea-f9ca54091983 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:44.638069 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-714b7a50-b126-43b2-a8ea-f9ca54091983 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:44.645413 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-714b7a50-b126-43b2-a8ea-f9ca54091983 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:44.645883 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-714b7a50-b126-43b2-a8ea-f9ca54091983 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:44.646641 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-714b7a50-b126-43b2-a8ea-f9ca54091983 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:44.647068 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-714b7a50-b126-43b2-a8ea-f9ca54091983 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:44.649488 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=90 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:36:44.683094 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-714b7a50-b126-43b2-a8ea-f9ca54091983 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052505 Jul 26 07:36:44.683655 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 594/1239] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:44 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:45.696479 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-abd50322-31c2-4429-9e16-56a5376e80f2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:45.698558 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-abd50322-31c2-4429-9e16-56a5376e80f2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:45.700421 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=30 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:36:45.706033 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-abd50322-31c2-4429-9e16-56a5376e80f2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:45.706474 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-abd50322-31c2-4429-9e16-56a5376e80f2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:45.707227 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-abd50322-31c2-4429-9e16-56a5376e80f2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:45.707666 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-abd50322-31c2-4429-9e16-56a5376e80f2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:45.737659 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-abd50322-31c2-4429-9e16-56a5376e80f2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045497 Jul 26 07:36:45.738256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 646/1240] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:45 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:46.750577 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2b46099f-67fc-4e11-b028-562b9e11aa06 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:46.752805 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2b46099f-67fc-4e11-b028-562b9e11aa06 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:46.759346 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2b46099f-67fc-4e11-b028-562b9e11aa06 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:46.759798 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2b46099f-67fc-4e11-b028-562b9e11aa06 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:46.760558 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2b46099f-67fc-4e11-b028-562b9e11aa06 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:46.760998 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2b46099f-67fc-4e11-b028-562b9e11aa06 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:46.790915 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2b46099f-67fc-4e11-b028-562b9e11aa06 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044502 Jul 26 07:36:46.791473 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 595/1241] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:46 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:47.803840 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f873f661-fd48-4687-abc9-ad68a125c342 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:47.806357 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f873f661-fd48-4687-abc9-ad68a125c342 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:47.815334 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f873f661-fd48-4687-abc9-ad68a125c342 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:47.815775 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f873f661-fd48-4687-abc9-ad68a125c342 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:47.816536 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f873f661-fd48-4687-abc9-ad68a125c342 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:47.816944 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f873f661-fd48-4687-abc9-ad68a125c342 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:47.848766 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f873f661-fd48-4687-abc9-ad68a125c342 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048822 Jul 26 07:36:47.849339 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 647/1242] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:47 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:48.860952 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-e4d1e83f-1751-40f5-aa85-f775f3eb7f91 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:48.863119 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-e4d1e83f-1751-40f5-aa85-f775f3eb7f91 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:48.870281 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e4d1e83f-1751-40f5-aa85-f775f3eb7f91 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:48.870721 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e4d1e83f-1751-40f5-aa85-f775f3eb7f91 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:48.871494 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e4d1e83f-1751-40f5-aa85-f775f3eb7f91 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:48.871908 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e4d1e83f-1751-40f5-aa85-f775f3eb7f91 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:48.902815 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-e4d1e83f-1751-40f5-aa85-f775f3eb7f91 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045815 Jul 26 07:36:48.903361 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 596/1243] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:48 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:49.915730 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a92f1243-b3d6-449f-a239-d25d78e097cf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:49.917782 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a92f1243-b3d6-449f-a239-d25d78e097cf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:49.924824 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a92f1243-b3d6-449f-a239-d25d78e097cf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:49.925262 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a92f1243-b3d6-449f-a239-d25d78e097cf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:49.926068 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a92f1243-b3d6-449f-a239-d25d78e097cf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:49.926499 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a92f1243-b3d6-449f-a239-d25d78e097cf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:49.957813 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a92f1243-b3d6-449f-a239-d25d78e097cf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046102 Jul 26 07:36:49.958409 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 648/1244] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:49 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:50.971183 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-00adf770-107f-4ef2-9b81-2828bc64e376 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:50.973271 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-00adf770-107f-4ef2-9b81-2828bc64e376 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:50.980585 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-00adf770-107f-4ef2-9b81-2828bc64e376 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:50.981027 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-00adf770-107f-4ef2-9b81-2828bc64e376 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:50.981839 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-00adf770-107f-4ef2-9b81-2828bc64e376 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:50.982303 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-00adf770-107f-4ef2-9b81-2828bc64e376 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:51.015091 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-00adf770-107f-4ef2-9b81-2828bc64e376 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048165 Jul 26 07:36:51.015655 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 597/1245] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:50 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:52.027702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f695cc70-2b68-4577-948e-644614da753f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:52.030151 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f695cc70-2b68-4577-948e-644614da753f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:52.037365 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f695cc70-2b68-4577-948e-644614da753f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:52.037927 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f695cc70-2b68-4577-948e-644614da753f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:52.038836 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f695cc70-2b68-4577-948e-644614da753f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:52.039306 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f695cc70-2b68-4577-948e-644614da753f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:52.072227 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f695cc70-2b68-4577-948e-644614da753f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048512 Jul 26 07:36:52.072827 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 649/1246] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:52 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:53.085248 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-75d50da7-cb95-47bf-94f9-aa00738ce612 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:53.087562 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-75d50da7-cb95-47bf-94f9-aa00738ce612 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:53.095606 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-75d50da7-cb95-47bf-94f9-aa00738ce612 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:53.096059 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-75d50da7-cb95-47bf-94f9-aa00738ce612 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:53.096859 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-75d50da7-cb95-47bf-94f9-aa00738ce612 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:53.097297 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-75d50da7-cb95-47bf-94f9-aa00738ce612 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:53.131599 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-75d50da7-cb95-47bf-94f9-aa00738ce612 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050460 Jul 26 07:36:53.132240 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 598/1247] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:53 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:54.144863 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3ecf5969-77c6-45ff-b269-c85a41d82835 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:54.147020 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3ecf5969-77c6-45ff-b269-c85a41d82835 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:54.154555 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3ecf5969-77c6-45ff-b269-c85a41d82835 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:54.155155 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3ecf5969-77c6-45ff-b269-c85a41d82835 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:54.156068 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3ecf5969-77c6-45ff-b269-c85a41d82835 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:54.156670 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3ecf5969-77c6-45ff-b269-c85a41d82835 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:54.192328 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3ecf5969-77c6-45ff-b269-c85a41d82835 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051473 Jul 26 07:36:54.192973 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 650/1248] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:54 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:55.206155 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-781ef55f-03f5-483e-ac68-8c2de810c4bb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:55.208478 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-781ef55f-03f5-483e-ac68-8c2de810c4bb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:55.217558 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-781ef55f-03f5-483e-ac68-8c2de810c4bb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:55.218317 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-781ef55f-03f5-483e-ac68-8c2de810c4bb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:55.219242 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-781ef55f-03f5-483e-ac68-8c2de810c4bb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:55.219888 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-781ef55f-03f5-483e-ac68-8c2de810c4bb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:55.256750 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-781ef55f-03f5-483e-ac68-8c2de810c4bb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055429 Jul 26 07:36:55.257338 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 599/1249] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:55 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:56.271627 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-51ff6a4d-20ff-4179-9c98-c88e1ac252e1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:56.274237 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-51ff6a4d-20ff-4179-9c98-c88e1ac252e1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:56.281785 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-51ff6a4d-20ff-4179-9c98-c88e1ac252e1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:56.282398 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-51ff6a4d-20ff-4179-9c98-c88e1ac252e1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:56.283460 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-51ff6a4d-20ff-4179-9c98-c88e1ac252e1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:56.283986 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-51ff6a4d-20ff-4179-9c98-c88e1ac252e1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:56.318782 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-51ff6a4d-20ff-4179-9c98-c88e1ac252e1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051262 Jul 26 07:36:56.319365 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 651/1250] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:56 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:57.331879 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-dd73f4cd-7827-40ec-ba4e-ffd6ff20f27e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:57.334343 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-dd73f4cd-7827-40ec-ba4e-ffd6ff20f27e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:57.342625 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dd73f4cd-7827-40ec-ba4e-ffd6ff20f27e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:57.343082 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dd73f4cd-7827-40ec-ba4e-ffd6ff20f27e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:57.343884 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dd73f4cd-7827-40ec-ba4e-ffd6ff20f27e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:57.344321 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dd73f4cd-7827-40ec-ba4e-ffd6ff20f27e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:57.378632 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-dd73f4cd-7827-40ec-ba4e-ffd6ff20f27e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050906 Jul 26 07:36:57.379353 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 600/1251] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:57 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:58.392057 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d3844c92-a0f7-4869-a625-d33c41d2c5e0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:58.394324 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d3844c92-a0f7-4869-a625-d33c41d2c5e0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:58.401894 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d3844c92-a0f7-4869-a625-d33c41d2c5e0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:58.402357 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d3844c92-a0f7-4869-a625-d33c41d2c5e0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:58.403140 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d3844c92-a0f7-4869-a625-d33c41d2c5e0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:58.403572 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d3844c92-a0f7-4869-a625-d33c41d2c5e0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:58.437033 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d3844c92-a0f7-4869-a625-d33c41d2c5e0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049124 Jul 26 07:36:58.437615 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 652/1252] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:58 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:36:59.451847 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-66e248e5-b86d-40b5-84f4-08a242df097b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:36:59.453960 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-66e248e5-b86d-40b5-84f4-08a242df097b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:36:59.460957 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-66e248e5-b86d-40b5-84f4-08a242df097b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:59.461402 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-66e248e5-b86d-40b5-84f4-08a242df097b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:59.462208 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-66e248e5-b86d-40b5-84f4-08a242df097b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:36:59.462639 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-66e248e5-b86d-40b5-84f4-08a242df097b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:36:59.496419 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-66e248e5-b86d-40b5-84f4-08a242df097b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048594 Jul 26 07:36:59.497032 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 601/1253] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:36:59 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:37:00.510224 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-efa7dbc1-e602-4f08-9504-d4570afd0a1b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:37:00.512425 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-efa7dbc1-e602-4f08-9504-d4570afd0a1b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:37:00.519987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-efa7dbc1-e602-4f08-9504-d4570afd0a1b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:00.520428 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-efa7dbc1-e602-4f08-9504-d4570afd0a1b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:00.521238 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-efa7dbc1-e602-4f08-9504-d4570afd0a1b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:00.521657 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-efa7dbc1-e602-4f08-9504-d4570afd0a1b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:00.554238 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-efa7dbc1-e602-4f08-9504-d4570afd0a1b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048042 Jul 26 07:37:00.554812 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 653/1254] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:37:00 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:37:01.567512 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a74e7221-4151-4138-a541-29a40766ed7e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:37:01.569598 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a74e7221-4151-4138-a541-29a40766ed7e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:37:01.576749 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a74e7221-4151-4138-a541-29a40766ed7e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:01.577200 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a74e7221-4151-4138-a541-29a40766ed7e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:01.578011 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a74e7221-4151-4138-a541-29a40766ed7e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:01.578442 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a74e7221-4151-4138-a541-29a40766ed7e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:01.610514 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a74e7221-4151-4138-a541-29a40766ed7e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047091 Jul 26 07:37:01.611110 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 602/1255] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:37:01 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:37:02.622917 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-4c40428f-386e-40de-ab09-0b9a03de2d25 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:37:02.625208 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-4c40428f-386e-40de-ab09-0b9a03de2d25 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:37:02.632318 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4c40428f-386e-40de-ab09-0b9a03de2d25 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:02.632764 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4c40428f-386e-40de-ab09-0b9a03de2d25 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:02.633510 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4c40428f-386e-40de-ab09-0b9a03de2d25 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:02.633976 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4c40428f-386e-40de-ab09-0b9a03de2d25 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:02.663260 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-4c40428f-386e-40de-ab09-0b9a03de2d25 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044362 Jul 26 07:37:02.663806 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 654/1256] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:37:02 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:37:03.676244 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b9000fe7-b52b-451e-a2ce-42ff74e8d1bd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:37:03.678916 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-b9000fe7-b52b-451e-a2ce-42ff74e8d1bd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:37:03.686447 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b9000fe7-b52b-451e-a2ce-42ff74e8d1bd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:03.686988 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b9000fe7-b52b-451e-a2ce-42ff74e8d1bd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:03.688044 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b9000fe7-b52b-451e-a2ce-42ff74e8d1bd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:03.688552 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b9000fe7-b52b-451e-a2ce-42ff74e8d1bd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:03.723994 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b9000fe7-b52b-451e-a2ce-42ff74e8d1bd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051755 Jul 26 07:37:03.724481 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 603/1257] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:37:03 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:37:04.736801 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-91d07375-d7aa-44a0-8dd0-e6850b5aa049 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:37:04.738987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-91d07375-d7aa-44a0-8dd0-e6850b5aa049 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:37:04.746871 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-91d07375-d7aa-44a0-8dd0-e6850b5aa049 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:04.747305 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-91d07375-d7aa-44a0-8dd0-e6850b5aa049 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:04.748053 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-91d07375-d7aa-44a0-8dd0-e6850b5aa049 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:04.748482 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-91d07375-d7aa-44a0-8dd0-e6850b5aa049 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:04.750881 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=90 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:37:04.780182 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-91d07375-d7aa-44a0-8dd0-e6850b5aa049 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047176 Jul 26 07:37:04.780672 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 655/1258] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:37:04 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:37:05.794973 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ed75fb11-a745-4072-a63c-0ec7b5ab5b98 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:37:05.797151 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ed75fb11-a745-4072-a63c-0ec7b5ab5b98 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:37:05.804421 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ed75fb11-a745-4072-a63c-0ec7b5ab5b98 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:05.804872 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ed75fb11-a745-4072-a63c-0ec7b5ab5b98 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:05.805627 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ed75fb11-a745-4072-a63c-0ec7b5ab5b98 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:05.806099 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ed75fb11-a745-4072-a63c-0ec7b5ab5b98 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:05.839011 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ed75fb11-a745-4072-a63c-0ec7b5ab5b98 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047986 Jul 26 07:37:05.839585 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 604/1259] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:37:05 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:37:06.852613 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3a6e71fc-d832-4470-8766-84cf21657ec9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:37:06.854798 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3a6e71fc-d832-4470-8766-84cf21657ec9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:37:06.861901 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3a6e71fc-d832-4470-8766-84cf21657ec9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:06.862347 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3a6e71fc-d832-4470-8766-84cf21657ec9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:06.863110 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3a6e71fc-d832-4470-8766-84cf21657ec9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:06.863539 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3a6e71fc-d832-4470-8766-84cf21657ec9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:06.894293 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3a6e71fc-d832-4470-8766-84cf21657ec9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045684 Jul 26 07:37:06.894858 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 656/1260] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:37:06 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:37:07.907284 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2ada615c-fe03-45a8-a4db-b80a2cdde4a2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:37:07.909488 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2ada615c-fe03-45a8-a4db-b80a2cdde4a2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:37:07.917408 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2ada615c-fe03-45a8-a4db-b80a2cdde4a2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:07.917898 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2ada615c-fe03-45a8-a4db-b80a2cdde4a2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:07.918703 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2ada615c-fe03-45a8-a4db-b80a2cdde4a2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:07.919163 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2ada615c-fe03-45a8-a4db-b80a2cdde4a2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:07.951359 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2ada615c-fe03-45a8-a4db-b80a2cdde4a2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047961 Jul 26 07:37:07.951841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 605/1261] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:37:07 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:37:08.964059 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-91d019d0-5ec6-4aeb-aaf4-f758de2a824e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:37:08.966231 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-91d019d0-5ec6-4aeb-aaf4-f758de2a824e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:37:08.973349 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-91d019d0-5ec6-4aeb-aaf4-f758de2a824e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:08.973778 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-91d019d0-5ec6-4aeb-aaf4-f758de2a824e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:08.974570 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-91d019d0-5ec6-4aeb-aaf4-f758de2a824e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:08.974997 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-91d019d0-5ec6-4aeb-aaf4-f758de2a824e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:09.004801 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-91d019d0-5ec6-4aeb-aaf4-f758de2a824e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045417 Jul 26 07:37:09.005361 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 657/1262] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:37:08 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:37:10.017406 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0cd26c97-1957-4617-9b46-67e9ee92eff0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:37:10.019680 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0cd26c97-1957-4617-9b46-67e9ee92eff0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:37:10.026627 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0cd26c97-1957-4617-9b46-67e9ee92eff0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:10.027128 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0cd26c97-1957-4617-9b46-67e9ee92eff0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:10.027902 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0cd26c97-1957-4617-9b46-67e9ee92eff0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:10.028332 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0cd26c97-1957-4617-9b46-67e9ee92eff0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:10.059437 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0cd26c97-1957-4617-9b46-67e9ee92eff0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046074 Jul 26 07:37:10.059982 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 606/1263] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:37:10 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:37:10.888795 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-718c2323-e2dc-4bb2-92e0-e3714afb69ad tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:37:10.889361 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-718c2323-e2dc-4bb2-92e0-e3714afb69ad tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:37:10.896329 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-718c2323-e2dc-4bb2-92e0-e3714afb69ad tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:10.896778 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-718c2323-e2dc-4bb2-92e0-e3714afb69ad tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:10.897547 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-718c2323-e2dc-4bb2-92e0-e3714afb69ad tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:10.898018 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-718c2323-e2dc-4bb2-92e0-e3714afb69ad tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:10.923725 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-718c2323-e2dc-4bb2-92e0-e3714afb69ad tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Going to try to terminate instance {{(pid=117715) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 07:37:11.014311 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-718c2323-e2dc-4bb2-92e0-e3714afb69ad tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "DELETE /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 204 len: 0 microversion: 2.1 time: 0.129546 Jul 26 07:37:11.014870 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 658/1264] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Jul 26 07:37:10 2022] DELETE /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 07:37:11.024603 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-cfc865fe-8523-414d-b6e2-c7bbd1cc4f97 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:37:11.025201 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-cfc865fe-8523-414d-b6e2-c7bbd1cc4f97 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:37:11.031773 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cfc865fe-8523-414d-b6e2-c7bbd1cc4f97 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:11.032208 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cfc865fe-8523-414d-b6e2-c7bbd1cc4f97 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:11.032961 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cfc865fe-8523-414d-b6e2-c7bbd1cc4f97 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:11.033389 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cfc865fe-8523-414d-b6e2-c7bbd1cc4f97 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:11.071840 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-fce98191-b8c7-4a7c-b37c-166d2374fecf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:37:11.074256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-fce98191-b8c7-4a7c-b37c-166d2374fecf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:37:11.080631 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fce98191-b8c7-4a7c-b37c-166d2374fecf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:11.081081 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fce98191-b8c7-4a7c-b37c-166d2374fecf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:11.082027 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fce98191-b8c7-4a7c-b37c-166d2374fecf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:11.082317 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fce98191-b8c7-4a7c-b37c-166d2374fecf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:11.113650 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-fce98191-b8c7-4a7c-b37c-166d2374fecf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046140 Jul 26 07:37:11.114260 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 659/1265] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:37:11 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:37:11.229181 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-cfc865fe-8523-414d-b6e2-c7bbd1cc4f97 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:37:11.237045 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-cfc865fe-8523-414d-b6e2-c7bbd1cc4f97 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1680 microversion: 2.1 time: 0.217622 Jul 26 07:37:11.237623 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 607/1266] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:37:11 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1680 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:37:12.126472 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e443847a-9c9c-492e-9cdc-f13836076227 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:37:12.128706 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e443847a-9c9c-492e-9cdc-f13836076227 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:37:12.137633 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e443847a-9c9c-492e-9cdc-f13836076227 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:12.138311 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e443847a-9c9c-492e-9cdc-f13836076227 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:12.139253 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e443847a-9c9c-492e-9cdc-f13836076227 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:12.139692 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e443847a-9c9c-492e-9cdc-f13836076227 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:12.170492 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e443847a-9c9c-492e-9cdc-f13836076227 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047992 Jul 26 07:37:12.174948 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 660/1267] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:37:12 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:37:12.260140 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-60b8be4f-ca29-423a-9426-84abe0ed62e5 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:37:12.261436 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-60b8be4f-ca29-423a-9426-84abe0ed62e5 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:37:12.268292 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-60b8be4f-ca29-423a-9426-84abe0ed62e5 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:12.268702 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-60b8be4f-ca29-423a-9426-84abe0ed62e5 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:12.269627 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-60b8be4f-ca29-423a-9426-84abe0ed62e5 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:12.270279 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-60b8be4f-ca29-423a-9426-84abe0ed62e5 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:12.374397 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-60b8be4f-ca29-423a-9426-84abe0ed62e5 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:37:12.386059 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-60b8be4f-ca29-423a-9426-84abe0ed62e5 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 200 len: 1612 microversion: 2.1 time: 0.128881 Jul 26 07:37:12.387115 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 608/1268] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:37:12 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 1612 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:37:12.437388 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-86352807-c6c1-491c-8914-f5b0278e35e3 req-52e337cc-13c9-4c6c-9605-e7e8396189be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88ea2e0b-57a1-4a83-9324-6f6f6f000641", "name": "network-vif-deleted", "tag": "809ec1cc-1c2d-4cc5-99de-57dfa200139f"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:37:12.451269 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-86352807-c6c1-491c-8914-f5b0278e35e3 req-52e337cc-13c9-4c6c-9605-e7e8396189be service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:12.451794 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-86352807-c6c1-491c-8914-f5b0278e35e3 req-52e337cc-13c9-4c6c-9605-e7e8396189be service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:12.464924 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-86352807-c6c1-491c-8914-f5b0278e35e3 req-52e337cc-13c9-4c6c-9605-e7e8396189be service nova] Creating event network-vif-deleted:809ec1cc-1c2d-4cc5-99de-57dfa200139f for instance 88ea2e0b-57a1-4a83-9324-6f6f6f000641 on hv-cinder-85083 Jul 26 07:37:12.470184 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-86352807-c6c1-491c-8914-f5b0278e35e3 req-52e337cc-13c9-4c6c-9605-e7e8396189be service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122501 Jul 26 07:37:12.471219 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 661/1269] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:37:13.182183 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-bc53a4d1-ff0f-4fe4-acb9-e64befbd7f4b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:37:13.184746 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-bc53a4d1-ff0f-4fe4-acb9-e64befbd7f4b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:37:13.187037 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=32 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:37:13.194335 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bc53a4d1-ff0f-4fe4-acb9-e64befbd7f4b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:13.194958 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bc53a4d1-ff0f-4fe4-acb9-e64befbd7f4b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:13.196128 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bc53a4d1-ff0f-4fe4-acb9-e64befbd7f4b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:13.196716 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bc53a4d1-ff0f-4fe4-acb9-e64befbd7f4b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:13.228407 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-bc53a4d1-ff0f-4fe4-acb9-e64befbd7f4b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050312 Jul 26 07:37:13.228966 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 609/1270] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 07:37:13 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:37:13.412175 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-0f059658-558e-4113-b32a-3019e94d371e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:37:13.412747 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-0f059658-558e-4113-b32a-3019e94d371e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:37:13.419120 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0f059658-558e-4113-b32a-3019e94d371e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:13.419631 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0f059658-558e-4113-b32a-3019e94d371e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:13.420397 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0f059658-558e-4113-b32a-3019e94d371e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:13.420814 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0f059658-558e-4113-b32a-3019e94d371e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:13.434535 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.wsgi [None req-0f059658-558e-4113-b32a-3019e94d371e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] HTTP exception thrown: Instance 88ea2e0b-57a1-4a83-9324-6f6f6f000641 could not be found. Jul 26 07:37:13.436778 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-0f059658-558e-4113-b32a-3019e94d371e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Request method failure captured: Jul 26 07:37:13.436778 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: request: GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 HTTP/1.1 Jul 26 07:37:13.436778 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept: application/json Jul 26 07:37:13.436778 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept-Encoding: identity Jul 26 07:37:13.436778 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Connection: close Jul 26 07:37:13.436778 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Length: 0 Jul 26 07:37:13.436778 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Type: application/json Jul 26 07:37:13.436778 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Host: 10.222.0.39 Jul 26 07:37:13.436778 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Openstack-System-Scope: None Jul 26 07:37:13.436778 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: User-Agent: python-urllib3/1.26.10 Jul 26 07:37:13.436778 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Auth-Token: gAAAAABi35bp-6MDlHFX6PqBP1JfjI-kDaErGZ8tS4CYMVgobtb4Gv-rSD0l-rBJa-iOQtbMEcv7gnFG6FuqSpAXwRcnDvooOo8YQBTuYFKMeWkJlsSVbvRshSqswhfLq3PM2Jh4Afd8RHIhCtF_ajjZyUKtQPL35KmYg8DZArwcVpy_HW9N5Qc Jul 26 07:37:13.436778 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Id: None Jul 26 07:37:13.436778 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Name: None Jul 26 07:37:13.436778 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Identity-Status: Confirmed Jul 26 07:37:13.436778 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Is-Admin-Project: True Jul 26 07:37:13.436778 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Id: default Jul 26 07:37:13.436778 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Name: Default Jul 26 07:37:13.436778 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Id: 4fa0c5574ef9497ebe29658f8164764c Jul 26 07:37:13.436778 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Name: tempest-AttachVolumeNegativeTest-1485570437 Jul 26 07:37:13.436778 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Role: member,reader Jul 26 07:37:13.436778 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Roles: member,reader Jul 26 07:37:13.438494 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:37:13.438494 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant: tempest-AttachVolumeNegativeTest-1485570437 Jul 26 07:37:13.438494 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Id: 4fa0c5574ef9497ebe29658f8164764c Jul 26 07:37:13.438494 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1485570437 Jul 26 07:37:13.438494 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User: tempest-AttachVolumeNegativeTest-1485570437-project Jul 26 07:37:13.438494 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Id: default Jul 26 07:37:13.438494 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Name: Default Jul 26 07:37:13.438494 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Id: 57029844165f4d83892176fe82594685 Jul 26 07:37:13.438494 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Name: tempest-AttachVolumeNegativeTest-1485570437-project Jul 26 07:37:13.438494 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: method: > Jul 26 07:37:13.438494 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: exception: Instance 88ea2e0b-57a1-4a83-9324-6f6f6f000641 could not be found. Jul 26 07:37:13.438494 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: action_args: {'id': '88ea2e0b-57a1-4a83-9324-6f6f6f000641'} Jul 26 07:37:13.439436 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:37:13.439436 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:37:13.439436 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 07:37:13.439436 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 07:37:13.439436 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 07:37:13.439436 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 07:37:13.439436 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 07:37:13.439436 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 07:37:13.439436 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 07:37:13.439436 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 07:37:13.439436 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88ea2e0b-57a1-4a83-9324-6f6f6f000641 could not be found. Jul 26 07:37:13.439436 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:37:13.439436 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:37:13.439436 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:37:13.439436 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:37:13.439436 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:37:13.439436 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:37:13.439436 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:37:13.439436 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:37:13.439436 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:37:13.441077 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:37:13.441077 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 07:37:13.441077 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 07:37:13.441077 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 07:37:13.441077 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 07:37:13.441077 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 07:37:13.441077 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:37:13.441077 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88ea2e0b-57a1-4a83-9324-6f6f6f000641 could not be found. Jul 26 07:37:13.441077 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:37:13.441077 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:37:13.441077 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:37:13.441077 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:37:13.441077 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:37:13.441077 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:37:13.441077 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:37:13.441077 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:37:13.441077 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88ea2e0b-57a1-4a83-9324-6f6f6f000641 could not be found. Jul 26 07:37:13.441077 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:37:13.442690 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-0f059658-558e-4113-b32a-3019e94d371e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Returning 404 to user: Instance 88ea2e0b-57a1-4a83-9324-6f6f6f000641 could not be found. {{(pid=117715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:37:13.442690 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-0f059658-558e-4113-b32a-3019e94d371e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 404 len: 111 microversion: 2.1 time: 0.030773 Jul 26 07:37:13.442690 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 662/1271] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:37:13 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 07:37:13.447619 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-07b25054-64ba-4fe4-979f-e52fae0e30d9 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '.version_select at 0x7f7f02792430>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:37:13.468101 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-07b25054-64ba-4fe4-979f-e52fae0e30d9 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-77659213" status: 202 len: 0 microversion: 2.1 time: 0.024509 Jul 26 07:37:13.468682 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 610/1272] 10.222.0.39 () {58 vars in 1215 bytes} [Tue Jul 26 07:37:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-77659213 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 07:37:14.242372 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7a2de21b-7b49-423d-b06c-52a8d9402597 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:37:14.244763 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7a2de21b-7b49-423d-b06c-52a8d9402597 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:37:14.251004 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7a2de21b-7b49-423d-b06c-52a8d9402597 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:14.251450 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7a2de21b-7b49-423d-b06c-52a8d9402597 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:14.252212 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7a2de21b-7b49-423d-b06c-52a8d9402597 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:14.252637 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7a2de21b-7b49-423d-b06c-52a8d9402597 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:14.330602 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7a2de21b-7b49-423d-b06c-52a8d9402597 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "POST /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/action" status: 200 len: 76609 microversion: 2.1 time: 0.093085 Jul 26 07:37:14.331253 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 663/1273] 10.222.0.39 () {60 vars in 1278 bytes} [Tue Jul 26 07:37:14 2022] POST /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1/action => generated 76609 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:37:14.439940 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-256e39ce-0a62-4765-b74c-8d46b9b6f0b5 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Action: 'create', calling method: .version_select at 0x7f7f02980d30>, body: {"keypair": {"name": "tempest-keypair-419877874", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcIVU+i14w2FQsSaS0YKxczxb+WW17lgnWWGp4nAXlduMkIh3p8SmoDcMnoywYGB0ZeIyW7BVAMC8j4Vc4KTgEC+MB8n6Z/uBGl5OlSIaTYZnc+9mdjcGKQh3kh380igw=="}} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:37:14.457204 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.quota [None req-256e39ce-0a62-4765-b74c-8d46b9b6f0b5 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Getting quotas for project 4fa0c5574ef9497ebe29658f8164764c. Resources: {'key_pairs'} {{(pid=117716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 07:37:14.461162 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.quota [None req-256e39ce-0a62-4765-b74c-8d46b9b6f0b5 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Getting quotas for user 57029844165f4d83892176fe82594685 and project 4fa0c5574ef9497ebe29658f8164764c. Resources: {'key_pairs'} {{(pid=117716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 07:37:14.491598 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-256e39ce-0a62-4765-b74c-8d46b9b6f0b5 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055781 Jul 26 07:37:14.492268 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 611/1274] 10.222.0.39 () {60 vars in 1159 bytes} [Tue Jul 26 07:37:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 07:37:16.157657 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c6148a29-9bbc-449d-9889-b73a3323e800 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-70668077", "imageRef": "b9589773-813f-42af-846a-43bcf9d4d002", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4aa6648c-5052-41c3-a55b-aea07445bb59"}], "security_groups": [{"name": "tempest-securitygroup--809486384"}], "key_name": "tempest-keypair-419877874", "user_data": "}} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:37:16.166258 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:37:16.391037 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.network.neutron [None req-c6148a29-9bbc-449d-9889-b73a3323e800 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] validate_networks() for [('4aa6648c-5052-41c3-a55b-aea07445bb59', None, None, None, None, None)] {{(pid=117715) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 07:37:16.852219 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-c6148a29-9bbc-449d-9889-b73a3323e800 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Flavor limits 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 07:37:16.852631 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-c6148a29-9bbc-449d-9889-b73a3323e800 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Image limits 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 07:37:16.853098 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-c6148a29-9bbc-449d-9889-b73a3323e800 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Flavor pref 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 07:37:16.853494 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-c6148a29-9bbc-449d-9889-b73a3323e800 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Image pref 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 07:37:16.853912 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-c6148a29-9bbc-449d-9889-b73a3323e800 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 07:37:16.863667 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c6148a29-9bbc-449d-9889-b73a3323e800 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:16.864140 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c6148a29-9bbc-449d-9889-b73a3323e800 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:16.864925 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c6148a29-9bbc-449d-9889-b73a3323e800 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:16.865353 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c6148a29-9bbc-449d-9889-b73a3323e800 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:16.882572 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.quota [None req-c6148a29-9bbc-449d-9889-b73a3323e800 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Getting quotas for project 4fa0c5574ef9497ebe29658f8164764c. Resources: {'instances', 'cores', 'ram'} {{(pid=117715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 07:37:16.886937 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.quota [None req-c6148a29-9bbc-449d-9889-b73a3323e800 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Getting quotas for user 57029844165f4d83892176fe82594685 and project 4fa0c5574ef9497ebe29658f8164764c. Resources: {'instances', 'cores', 'ram'} {{(pid=117715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 07:37:16.898339 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c6148a29-9bbc-449d-9889-b73a3323e800 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Going to run 1 instances... {{(pid=117715) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 07:37:16.900728 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c6148a29-9bbc-449d-9889-b73a3323e800 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: f7e43c4a-c38a-4da6-9687-d675f7c28f9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9589773-813f-42af-846a-43bcf9d4d002',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 07:37:16.949013 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c6148a29-9bbc-449d-9889-b73a3323e800 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [63249e30-305a-4285-90cb-cc1098865669] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 07:37:17.959585 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO oslo.messaging._drivers.impl_rabbit [None req-c6148a29-9bbc-449d-9889-b73a3323e800 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [63249e30-305a-4285-90cb-cc1098865669] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 52336. Jul 26 07:37:17.965137 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c6148a29-9bbc-449d-9889-b73a3323e800 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.812068 Jul 26 07:37:17.966525 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 664/1275] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Jul 26 07:37:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 1814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 07:37:17.982282 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-210bbbdf-6a36-4e7c-ad2e-2304930eaa29 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:37:17.983242 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-210bbbdf-6a36-4e7c-ad2e-2304930eaa29 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: f7e43c4a-c38a-4da6-9687-d675f7c28f9a] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:37:18.044203 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-210bbbdf-6a36-4e7c-ad2e-2304930eaa29 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:37:18.050898 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-210bbbdf-6a36-4e7c-ad2e-2304930eaa29 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/f7e43c4a-c38a-4da6-9687-d675f7c28f9a" status: 200 len: 1239 microversion: 2.1 time: 0.074518 Jul 26 07:37:18.051450 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 612/1276] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:37:17 2022] GET /compute/v2.1/servers/f7e43c4a-c38a-4da6-9687-d675f7c28f9a => generated 1239 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:37:19.074500 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b088b286-40f0-4df5-85fc-b488b6e639f1 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:37:19.075332 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b088b286-40f0-4df5-85fc-b488b6e639f1 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: f7e43c4a-c38a-4da6-9687-d675f7c28f9a] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:37:19.084014 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b088b286-40f0-4df5-85fc-b488b6e639f1 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:19.084459 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b088b286-40f0-4df5-85fc-b488b6e639f1 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:19.085265 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b088b286-40f0-4df5-85fc-b488b6e639f1 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:19.085718 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b088b286-40f0-4df5-85fc-b488b6e639f1 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:19.166112 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-b088b286-40f0-4df5-85fc-b488b6e639f1 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:37:19.174320 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b088b286-40f0-4df5-85fc-b488b6e639f1 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/f7e43c4a-c38a-4da6-9687-d675f7c28f9a" status: 200 len: 1299 microversion: 2.1 time: 0.105057 Jul 26 07:37:19.188823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 665/1277] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:37:19 2022] GET /compute/v2.1/servers/f7e43c4a-c38a-4da6-9687-d675f7c28f9a => generated 1299 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:37:20.196754 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d2f750f8-935c-493e-93f9-4277fac0fd7b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:37:20.197408 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d2f750f8-935c-493e-93f9-4277fac0fd7b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: f7e43c4a-c38a-4da6-9687-d675f7c28f9a] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:37:20.204716 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d2f750f8-935c-493e-93f9-4277fac0fd7b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:20.205233 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d2f750f8-935c-493e-93f9-4277fac0fd7b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:20.205987 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d2f750f8-935c-493e-93f9-4277fac0fd7b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:20.206409 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d2f750f8-935c-493e-93f9-4277fac0fd7b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:20.211958 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=96 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:37:20.426743 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d2f750f8-935c-493e-93f9-4277fac0fd7b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:37:20.438442 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d2f750f8-935c-493e-93f9-4277fac0fd7b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/f7e43c4a-c38a-4da6-9687-d675f7c28f9a" status: 200 len: 1364 microversion: 2.1 time: 0.245886 Jul 26 07:37:20.439444 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 613/1278] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:37:20 2022] GET /compute/v2.1/servers/f7e43c4a-c38a-4da6-9687-d675f7c28f9a => generated 1364 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:37:20.630351 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-6ba457ce-a35e-41fd-a269-2bff8e69fb0d req-85e282b6-aeef-46ec-ba41-1971729d2332 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7e43c4a-c38a-4da6-9687-d675f7c28f9a", "tag": "042cbb20-2361-409a-8c16-d2f29d1938f1"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:37:20.644779 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-6ba457ce-a35e-41fd-a269-2bff8e69fb0d req-85e282b6-aeef-46ec-ba41-1971729d2332 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:20.646099 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-6ba457ce-a35e-41fd-a269-2bff8e69fb0d req-85e282b6-aeef-46ec-ba41-1971729d2332 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:20.664337 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-6ba457ce-a35e-41fd-a269-2bff8e69fb0d req-85e282b6-aeef-46ec-ba41-1971729d2332 service nova] Creating event network-changed:042cbb20-2361-409a-8c16-d2f29d1938f1 for instance f7e43c4a-c38a-4da6-9687-d675f7c28f9a on hv-cinder-85083 Jul 26 07:37:20.670524 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-6ba457ce-a35e-41fd-a269-2bff8e69fb0d req-85e282b6-aeef-46ec-ba41-1971729d2332 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043660 Jul 26 07:37:20.671512 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 666/1279] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:37:21.461722 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d5c2598e-9ea2-438d-87e3-1c258e73bded tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:37:21.462773 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d5c2598e-9ea2-438d-87e3-1c258e73bded tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: f7e43c4a-c38a-4da6-9687-d675f7c28f9a] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:37:21.469687 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d5c2598e-9ea2-438d-87e3-1c258e73bded tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:21.470153 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d5c2598e-9ea2-438d-87e3-1c258e73bded tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:21.470919 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d5c2598e-9ea2-438d-87e3-1c258e73bded tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:21.471339 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d5c2598e-9ea2-438d-87e3-1c258e73bded tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:21.618333 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d5c2598e-9ea2-438d-87e3-1c258e73bded tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:37:21.629977 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d5c2598e-9ea2-438d-87e3-1c258e73bded tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/f7e43c4a-c38a-4da6-9687-d675f7c28f9a" status: 200 len: 1364 microversion: 2.1 time: 0.172040 Jul 26 07:37:21.630585 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 614/1280] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:37:21 2022] GET /compute/v2.1/servers/f7e43c4a-c38a-4da6-9687-d675f7c28f9a => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:37:22.659666 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-36bfe2b3-cf82-4c35-b51c-e0f14737a54b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:37:22.662200 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-36bfe2b3-cf82-4c35-b51c-e0f14737a54b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: f7e43c4a-c38a-4da6-9687-d675f7c28f9a] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:37:22.672564 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-36bfe2b3-cf82-4c35-b51c-e0f14737a54b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:22.673019 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-36bfe2b3-cf82-4c35-b51c-e0f14737a54b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:22.673859 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-36bfe2b3-cf82-4c35-b51c-e0f14737a54b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:22.674284 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-36bfe2b3-cf82-4c35-b51c-e0f14737a54b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:22.816026 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-36bfe2b3-cf82-4c35-b51c-e0f14737a54b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:37:22.824234 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-36bfe2b3-cf82-4c35-b51c-e0f14737a54b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/f7e43c4a-c38a-4da6-9687-d675f7c28f9a" status: 200 len: 1364 microversion: 2.1 time: 0.174587 Jul 26 07:37:22.824823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 667/1281] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:37:22 2022] GET /compute/v2.1/servers/f7e43c4a-c38a-4da6-9687-d675f7c28f9a => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:37:23.847777 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-69813b71-1397-4b94-98be-5d722c6af524 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:37:23.848448 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-69813b71-1397-4b94-98be-5d722c6af524 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: f7e43c4a-c38a-4da6-9687-d675f7c28f9a] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:37:23.856375 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-69813b71-1397-4b94-98be-5d722c6af524 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:23.856815 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-69813b71-1397-4b94-98be-5d722c6af524 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:23.857566 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-69813b71-1397-4b94-98be-5d722c6af524 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:23.858031 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-69813b71-1397-4b94-98be-5d722c6af524 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:23.990118 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-69813b71-1397-4b94-98be-5d722c6af524 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:37:23.997770 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-69813b71-1397-4b94-98be-5d722c6af524 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/f7e43c4a-c38a-4da6-9687-d675f7c28f9a" status: 200 len: 1364 microversion: 2.1 time: 0.154428 Jul 26 07:37:23.998338 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 615/1282] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:37:23 2022] GET /compute/v2.1/servers/f7e43c4a-c38a-4da6-9687-d675f7c28f9a => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:37:25.025314 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9950394c-4908-432b-9c94-f0ced134f0fd tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:37:25.025932 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-9950394c-4908-432b-9c94-f0ced134f0fd tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: f7e43c4a-c38a-4da6-9687-d675f7c28f9a] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:37:25.033048 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9950394c-4908-432b-9c94-f0ced134f0fd tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:25.033492 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9950394c-4908-432b-9c94-f0ced134f0fd tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:25.034282 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9950394c-4908-432b-9c94-f0ced134f0fd tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:25.034707 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9950394c-4908-432b-9c94-f0ced134f0fd tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:25.169249 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-9950394c-4908-432b-9c94-f0ced134f0fd tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:37:25.177323 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-9950394c-4908-432b-9c94-f0ced134f0fd tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/f7e43c4a-c38a-4da6-9687-d675f7c28f9a" status: 200 len: 1364 microversion: 2.1 time: 0.155936 Jul 26 07:37:25.177919 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 668/1283] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:37:25 2022] GET /compute/v2.1/servers/f7e43c4a-c38a-4da6-9687-d675f7c28f9a => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:37:26.199396 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0705c904-d037-4550-9890-74af816f4a41 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:37:26.200023 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0705c904-d037-4550-9890-74af816f4a41 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: f7e43c4a-c38a-4da6-9687-d675f7c28f9a] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:37:26.208554 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0705c904-d037-4550-9890-74af816f4a41 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:26.209001 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0705c904-d037-4550-9890-74af816f4a41 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:26.209777 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0705c904-d037-4550-9890-74af816f4a41 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:26.210225 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0705c904-d037-4550-9890-74af816f4a41 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:26.356157 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0705c904-d037-4550-9890-74af816f4a41 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:37:26.364047 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0705c904-d037-4550-9890-74af816f4a41 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/f7e43c4a-c38a-4da6-9687-d675f7c28f9a" status: 200 len: 1364 microversion: 2.1 time: 0.168901 Jul 26 07:37:26.364608 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 616/1284] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:37:26 2022] GET /compute/v2.1/servers/f7e43c4a-c38a-4da6-9687-d675f7c28f9a => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:37:26.856953 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-6edff869-64fa-49ef-93be-743975034c3e req-f52b602c-5ecd-4d81-9215-c373d88ef644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7e43c4a-c38a-4da6-9687-d675f7c28f9a", "name": "network-vif-plugged", "status": "completed", "tag": "042cbb20-2361-409a-8c16-d2f29d1938f1"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:37:26.866952 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-6edff869-64fa-49ef-93be-743975034c3e req-f52b602c-5ecd-4d81-9215-c373d88ef644 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:26.867427 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-6edff869-64fa-49ef-93be-743975034c3e req-f52b602c-5ecd-4d81-9215-c373d88ef644 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:26.871663 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell0:SELECT=2 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:37:26.879360 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-6edff869-64fa-49ef-93be-743975034c3e req-f52b602c-5ecd-4d81-9215-c373d88ef644 service nova] Creating event network-vif-plugged:042cbb20-2361-409a-8c16-d2f29d1938f1 for instance f7e43c4a-c38a-4da6-9687-d675f7c28f9a on hv-cinder-85083 Jul 26 07:37:26.884347 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-6edff869-64fa-49ef-93be-743975034c3e req-f52b602c-5ecd-4d81-9215-c373d88ef644 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111179 Jul 26 07:37:26.884934 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 669/1285] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:37:27.387384 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a1842215-24b2-4757-8645-80c20061efbc tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:37:27.387982 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a1842215-24b2-4757-8645-80c20061efbc tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: f7e43c4a-c38a-4da6-9687-d675f7c28f9a] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:37:27.394818 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a1842215-24b2-4757-8645-80c20061efbc tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:27.395229 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a1842215-24b2-4757-8645-80c20061efbc tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:27.395979 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a1842215-24b2-4757-8645-80c20061efbc tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:27.396409 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a1842215-24b2-4757-8645-80c20061efbc tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:27.534604 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a1842215-24b2-4757-8645-80c20061efbc tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:37:27.542985 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a1842215-24b2-4757-8645-80c20061efbc tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/f7e43c4a-c38a-4da6-9687-d675f7c28f9a" status: 200 len: 1364 microversion: 2.1 time: 0.161337 Jul 26 07:37:27.543548 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 617/1286] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:37:27 2022] GET /compute/v2.1/servers/f7e43c4a-c38a-4da6-9687-d675f7c28f9a => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:37:28.561981 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell0:SELECT=6 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:37:28.567299 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a15e2b86-8ffc-490d-b5d3-4ab79740fd13 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:37:28.568103 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a15e2b86-8ffc-490d-b5d3-4ab79740fd13 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: f7e43c4a-c38a-4da6-9687-d675f7c28f9a] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:37:28.575067 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a15e2b86-8ffc-490d-b5d3-4ab79740fd13 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:28.575505 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a15e2b86-8ffc-490d-b5d3-4ab79740fd13 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:28.576275 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a15e2b86-8ffc-490d-b5d3-4ab79740fd13 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:28.576708 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a15e2b86-8ffc-490d-b5d3-4ab79740fd13 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:28.721998 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-a15e2b86-8ffc-490d-b5d3-4ab79740fd13 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:37:28.734424 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a15e2b86-8ffc-490d-b5d3-4ab79740fd13 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/f7e43c4a-c38a-4da6-9687-d675f7c28f9a" status: 200 len: 1554 microversion: 2.1 time: 0.173365 Jul 26 07:37:28.735170 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 670/1287] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:37:28 2022] GET /compute/v2.1/servers/f7e43c4a-c38a-4da6-9687-d675f7c28f9a => generated 1554 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:37:28.755245 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-1221aeb2-30f7-450c-ba04-136234b783b6 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:37:28.755730 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-1221aeb2-30f7-450c-ba04-136234b783b6 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: f7e43c4a-c38a-4da6-9687-d675f7c28f9a] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:37:28.757606 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell0:SELECT=6 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:37:28.763509 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1221aeb2-30f7-450c-ba04-136234b783b6 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:28.763957 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1221aeb2-30f7-450c-ba04-136234b783b6 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:28.764709 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1221aeb2-30f7-450c-ba04-136234b783b6 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:28.765136 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1221aeb2-30f7-450c-ba04-136234b783b6 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:28.852083 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-1221aeb2-30f7-450c-ba04-136234b783b6 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/f7e43c4a-c38a-4da6-9687-d675f7c28f9a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100692 Jul 26 07:37:28.852671 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 618/1288] 10.222.0.39 () {58 vars in 1275 bytes} [Tue Jul 26 07:37:28 2022] GET /compute/v2.1/servers/f7e43c4a-c38a-4da6-9687-d675f7c28f9a/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:37:29.810749 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-48d03af7-2732-4447-82e9-dc78251200e3 req-0132157a-105f-45e5-b39f-7ab6beec478c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7e43c4a-c38a-4da6-9687-d675f7c28f9a", "tag": "042cbb20-2361-409a-8c16-d2f29d1938f1"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:37:29.820725 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-48d03af7-2732-4447-82e9-dc78251200e3 req-0132157a-105f-45e5-b39f-7ab6beec478c service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:37:29.821174 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-48d03af7-2732-4447-82e9-dc78251200e3 req-0132157a-105f-45e5-b39f-7ab6beec478c service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:37:29.832718 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-48d03af7-2732-4447-82e9-dc78251200e3 req-0132157a-105f-45e5-b39f-7ab6beec478c service nova] Creating event network-changed:042cbb20-2361-409a-8c16-d2f29d1938f1 for instance f7e43c4a-c38a-4da6-9687-d675f7c28f9a on hv-cinder-85083 Jul 26 07:37:29.838180 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-48d03af7-2732-4447-82e9-dc78251200e3 req-0132157a-105f-45e5-b39f-7ab6beec478c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031094 Jul 26 07:37:29.838749 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 671/1289] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:38:05.754705 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:05.755557 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=33 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:05.761374 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-46f1e6e0-1aa0-494c-8187-b1c2f107d70b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:38:05.762091 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-46f1e6e0-1aa0-494c-8187-b1c2f107d70b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: f7e43c4a-c38a-4da6-9687-d675f7c28f9a] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:38:05.772957 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-46f1e6e0-1aa0-494c-8187-b1c2f107d70b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:38:05.773409 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-46f1e6e0-1aa0-494c-8187-b1c2f107d70b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:38:05.774208 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-46f1e6e0-1aa0-494c-8187-b1c2f107d70b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:38:05.774641 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-46f1e6e0-1aa0-494c-8187-b1c2f107d70b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:38:05.798816 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-46f1e6e0-1aa0-494c-8187-b1c2f107d70b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/f7e43c4a-c38a-4da6-9687-d675f7c28f9a/ips" status: 200 len: 150 microversion: 2.1 time: 0.046390 Jul 26 07:38:05.799379 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 619/1290] 10.222.0.39 () {58 vars in 1248 bytes} [Tue Jul 26 07:38:05 2022] GET /compute/v2.1/servers/f7e43c4a-c38a-4da6-9687-d675f7c28f9a/ips => generated 150 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:38:50.296629 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 07:38:50.297291 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Tue Jul 26 07:38:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 07:39:07.208915 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 07:39:07.209648 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Tue Jul 26 07:39:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 07:39:26.154229 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 07:39:26.155228 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Tue Jul 26 07:39:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 07:41:22.881860 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cdf51fd0-56a6-4942-afed-0aacdf04f143] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 07:41:22.883095 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:41:22.883820 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:41:22.888292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3c3793bf-7e86-4da3-806d-ba8813f78e7f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:22.889119 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3c3793bf-7e86-4da3-806d-ba8813f78e7f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:22.901001 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3c3793bf-7e86-4da3-806d-ba8813f78e7f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:22.901673 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3c3793bf-7e86-4da3-806d-ba8813f78e7f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:22.902706 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3c3793bf-7e86-4da3-806d-ba8813f78e7f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:22.903107 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3c3793bf-7e86-4da3-806d-ba8813f78e7f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:22.932009 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3c3793bf-7e86-4da3-806d-ba8813f78e7f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Going to try to terminate instance {{(pid=117715) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 07:41:23.031282 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3c3793bf-7e86-4da3-806d-ba8813f78e7f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 204 len: 0 microversion: 2.1 time: 0.151031 Jul 26 07:41:23.032555 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 672/1291] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Jul 26 07:41:22 2022] DELETE /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 07:41:23.038461 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9dc8bbe6-3d82-4f6a-b753-d62839cd5a52] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 07:41:23.039264 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=2 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:41:23.040102 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=4 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:41:23.044446 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-090b8971-7316-45e5-af11-d0ccc603be80 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:23.045055 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-090b8971-7316-45e5-af11-d0ccc603be80 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:23.051915 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-090b8971-7316-45e5-af11-d0ccc603be80 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:23.052348 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-090b8971-7316-45e5-af11-d0ccc603be80 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:23.053082 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-090b8971-7316-45e5-af11-d0ccc603be80 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:23.053508 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-090b8971-7316-45e5-af11-d0ccc603be80 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:23.192819 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-090b8971-7316-45e5-af11-d0ccc603be80 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:23.201408 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-090b8971-7316-45e5-af11-d0ccc603be80 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.164956 Jul 26 07:41:23.202029 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 620/1292] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:41:23 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:41:24.225759 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-882d922f-9884-49a2-9d54-4ca5149cb01e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:24.226515 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-882d922f-9884-49a2-9d54-4ca5149cb01e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:24.236104 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-882d922f-9884-49a2-9d54-4ca5149cb01e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:24.236474 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-882d922f-9884-49a2-9d54-4ca5149cb01e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:24.237227 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-882d922f-9884-49a2-9d54-4ca5149cb01e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:24.237649 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-882d922f-9884-49a2-9d54-4ca5149cb01e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:24.245953 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO oslo.messaging._drivers.impl_rabbit [-] [cdf51fd0-56a6-4942-afed-0aacdf04f143] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 54216. Jul 26 07:41:24.384923 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-882d922f-9884-49a2-9d54-4ca5149cb01e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:24.393558 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-882d922f-9884-49a2-9d54-4ca5149cb01e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.172017 Jul 26 07:41:24.394182 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 673/1293] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:41:24 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:41:25.415712 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-bfe9753c-d1d9-410b-873f-873fcc93e985 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:25.416346 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-bfe9753c-d1d9-410b-873f-873fcc93e985 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:25.425174 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bfe9753c-d1d9-410b-873f-873fcc93e985 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:25.425624 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bfe9753c-d1d9-410b-873f-873fcc93e985 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:25.427741 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bfe9753c-d1d9-410b-873f-873fcc93e985 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:25.428165 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bfe9753c-d1d9-410b-873f-873fcc93e985 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:25.445145 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO oslo.messaging._drivers.impl_rabbit [-] [9dc8bbe6-3d82-4f6a-b753-d62839cd5a52] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 54228. Jul 26 07:41:25.563023 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-bfe9753c-d1d9-410b-873f-873fcc93e985 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:25.571398 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-bfe9753c-d1d9-410b-873f-873fcc93e985 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.159870 Jul 26 07:41:25.571968 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 621/1294] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:41:25 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:41:26.595790 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e4968c22-2aee-4587-b970-188fd8f35f8d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:26.596488 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e4968c22-2aee-4587-b970-188fd8f35f8d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:26.603366 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e4968c22-2aee-4587-b970-188fd8f35f8d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:26.603805 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e4968c22-2aee-4587-b970-188fd8f35f8d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:26.604556 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e4968c22-2aee-4587-b970-188fd8f35f8d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:26.605004 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e4968c22-2aee-4587-b970-188fd8f35f8d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:26.751553 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-e4968c22-2aee-4587-b970-188fd8f35f8d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:26.759770 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e4968c22-2aee-4587-b970-188fd8f35f8d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.170228 Jul 26 07:41:26.760359 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 674/1295] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:41:26 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:41:27.780907 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-78cc13a5-d5f5-4e8c-83d6-586e8a700361 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:27.781524 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-78cc13a5-d5f5-4e8c-83d6-586e8a700361 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:27.788464 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-78cc13a5-d5f5-4e8c-83d6-586e8a700361 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:27.788906 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-78cc13a5-d5f5-4e8c-83d6-586e8a700361 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:27.789659 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-78cc13a5-d5f5-4e8c-83d6-586e8a700361 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:27.790116 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-78cc13a5-d5f5-4e8c-83d6-586e8a700361 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:27.925286 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-78cc13a5-d5f5-4e8c-83d6-586e8a700361 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:27.937049 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-78cc13a5-d5f5-4e8c-83d6-586e8a700361 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.159824 Jul 26 07:41:27.937801 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 622/1296] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:41:27 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:41:28.962569 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8ed16c30-7eee-450a-adc1-1e9de116e9f9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:28.963107 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8ed16c30-7eee-450a-adc1-1e9de116e9f9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:28.972792 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ed16c30-7eee-450a-adc1-1e9de116e9f9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:28.973240 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ed16c30-7eee-450a-adc1-1e9de116e9f9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:28.974036 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ed16c30-7eee-450a-adc1-1e9de116e9f9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:28.974468 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8ed16c30-7eee-450a-adc1-1e9de116e9f9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:29.107763 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8ed16c30-7eee-450a-adc1-1e9de116e9f9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:29.116251 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8ed16c30-7eee-450a-adc1-1e9de116e9f9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.159650 Jul 26 07:41:29.116799 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 675/1297] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:41:28 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:41:30.136882 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-eb5019e3-a5a4-4eec-83ef-8bbb9db52e8e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:30.137480 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-eb5019e3-a5a4-4eec-83ef-8bbb9db52e8e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:30.144751 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-eb5019e3-a5a4-4eec-83ef-8bbb9db52e8e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:30.145217 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-eb5019e3-a5a4-4eec-83ef-8bbb9db52e8e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:30.146035 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-eb5019e3-a5a4-4eec-83ef-8bbb9db52e8e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:30.146432 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-eb5019e3-a5a4-4eec-83ef-8bbb9db52e8e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:30.285071 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-eb5019e3-a5a4-4eec-83ef-8bbb9db52e8e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:30.293544 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-eb5019e3-a5a4-4eec-83ef-8bbb9db52e8e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.160614 Jul 26 07:41:30.294110 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 623/1298] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:41:30 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:41:31.315627 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-5654fa3a-e335-4dd6-aa0b-80d3967cfb3c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:31.316256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-5654fa3a-e335-4dd6-aa0b-80d3967cfb3c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:31.323343 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5654fa3a-e335-4dd6-aa0b-80d3967cfb3c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:31.323800 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5654fa3a-e335-4dd6-aa0b-80d3967cfb3c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:31.324557 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5654fa3a-e335-4dd6-aa0b-80d3967cfb3c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:31.324987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5654fa3a-e335-4dd6-aa0b-80d3967cfb3c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:31.461060 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-5654fa3a-e335-4dd6-aa0b-80d3967cfb3c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:31.469512 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-5654fa3a-e335-4dd6-aa0b-80d3967cfb3c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.157846 Jul 26 07:41:31.470111 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 676/1299] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:41:31 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:41:32.491564 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9bcdd66b-7ea4-47ef-956a-0d5207c2c069 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:32.492168 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-9bcdd66b-7ea4-47ef-956a-0d5207c2c069 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:32.499116 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9bcdd66b-7ea4-47ef-956a-0d5207c2c069 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:32.499589 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9bcdd66b-7ea4-47ef-956a-0d5207c2c069 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:32.500310 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9bcdd66b-7ea4-47ef-956a-0d5207c2c069 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:32.500737 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9bcdd66b-7ea4-47ef-956a-0d5207c2c069 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:32.640777 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-9bcdd66b-7ea4-47ef-956a-0d5207c2c069 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:32.657043 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-9bcdd66b-7ea4-47ef-956a-0d5207c2c069 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.169180 Jul 26 07:41:32.657693 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 624/1300] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:41:32 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:41:33.680754 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ce4a9c3e-ac3a-48cd-848e-5dcbbf369dd3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:33.681517 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ce4a9c3e-ac3a-48cd-848e-5dcbbf369dd3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:33.688436 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ce4a9c3e-ac3a-48cd-848e-5dcbbf369dd3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:33.688883 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ce4a9c3e-ac3a-48cd-848e-5dcbbf369dd3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:33.689638 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ce4a9c3e-ac3a-48cd-848e-5dcbbf369dd3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:33.690099 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ce4a9c3e-ac3a-48cd-848e-5dcbbf369dd3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:33.829156 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ce4a9c3e-ac3a-48cd-848e-5dcbbf369dd3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:33.838009 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ce4a9c3e-ac3a-48cd-848e-5dcbbf369dd3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.161292 Jul 26 07:41:33.838632 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 677/1301] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:41:33 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:41:34.860305 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-24f8e769-34f5-4e49-a7ae-e0a8b1bfd9fb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:34.860964 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-24f8e769-34f5-4e49-a7ae-e0a8b1bfd9fb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:34.868245 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-24f8e769-34f5-4e49-a7ae-e0a8b1bfd9fb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:34.868693 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-24f8e769-34f5-4e49-a7ae-e0a8b1bfd9fb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:34.869456 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-24f8e769-34f5-4e49-a7ae-e0a8b1bfd9fb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:34.869903 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-24f8e769-34f5-4e49-a7ae-e0a8b1bfd9fb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:35.012056 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-24f8e769-34f5-4e49-a7ae-e0a8b1bfd9fb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:35.022517 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-24f8e769-34f5-4e49-a7ae-e0a8b1bfd9fb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.166252 Jul 26 07:41:35.022967 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 625/1302] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:41:34 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:41:36.044893 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b074f97e-c414-49e6-9c14-30ab4a69020e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:36.045562 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b074f97e-c414-49e6-9c14-30ab4a69020e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:36.052977 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b074f97e-c414-49e6-9c14-30ab4a69020e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:36.053383 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b074f97e-c414-49e6-9c14-30ab4a69020e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:36.054473 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b074f97e-c414-49e6-9c14-30ab4a69020e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:36.054607 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b074f97e-c414-49e6-9c14-30ab4a69020e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:36.351400 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-b074f97e-c414-49e6-9c14-30ab4a69020e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:36.359917 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b074f97e-c414-49e6-9c14-30ab4a69020e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.318842 Jul 26 07:41:36.360475 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 678/1303] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:41:36 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:41:37.382560 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-4380ce0a-dde0-4630-9085-bd3a53378f65 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:37.383203 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-4380ce0a-dde0-4630-9085-bd3a53378f65 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:37.390881 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4380ce0a-dde0-4630-9085-bd3a53378f65 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:37.391365 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4380ce0a-dde0-4630-9085-bd3a53378f65 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:37.392211 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4380ce0a-dde0-4630-9085-bd3a53378f65 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:37.392683 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4380ce0a-dde0-4630-9085-bd3a53378f65 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:37.523382 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-4380ce0a-dde0-4630-9085-bd3a53378f65 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:37.531442 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-4380ce0a-dde0-4630-9085-bd3a53378f65 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.153498 Jul 26 07:41:37.531979 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 626/1304] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:41:37 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:41:38.552903 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-cb171bb5-70d7-4bf9-9d71-84b24846b340 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:38.553819 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-cb171bb5-70d7-4bf9-9d71-84b24846b340 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:38.560176 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cb171bb5-70d7-4bf9-9d71-84b24846b340 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:38.560633 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cb171bb5-70d7-4bf9-9d71-84b24846b340 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:38.561421 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cb171bb5-70d7-4bf9-9d71-84b24846b340 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:38.561923 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cb171bb5-70d7-4bf9-9d71-84b24846b340 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:38.705063 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-cb171bb5-70d7-4bf9-9d71-84b24846b340 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:38.715240 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-cb171bb5-70d7-4bf9-9d71-84b24846b340 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.166337 Jul 26 07:41:38.715812 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 679/1305] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:41:38 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:41:39.742229 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-e681dde9-ddc5-46b7-a907-3d0ec4349ff2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:39.743119 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-e681dde9-ddc5-46b7-a907-3d0ec4349ff2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:39.751663 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e681dde9-ddc5-46b7-a907-3d0ec4349ff2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:39.752342 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e681dde9-ddc5-46b7-a907-3d0ec4349ff2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:39.753614 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e681dde9-ddc5-46b7-a907-3d0ec4349ff2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:39.754380 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e681dde9-ddc5-46b7-a907-3d0ec4349ff2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:39.905591 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-e681dde9-ddc5-46b7-a907-3d0ec4349ff2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:39.913865 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-e681dde9-ddc5-46b7-a907-3d0ec4349ff2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.178027 Jul 26 07:41:39.914433 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 627/1306] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:41:39 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:41:40.935682 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-bb00b12b-632d-498a-bab3-61229998248d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:40.936253 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-bb00b12b-632d-498a-bab3-61229998248d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:40.943469 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bb00b12b-632d-498a-bab3-61229998248d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:40.943917 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bb00b12b-632d-498a-bab3-61229998248d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:40.944674 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bb00b12b-632d-498a-bab3-61229998248d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:40.945113 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bb00b12b-632d-498a-bab3-61229998248d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:40.979823 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-5fff2d98-0606-4d54-ac42-b64f87ea9a82 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:40.980441 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-5fff2d98-0606-4d54-ac42-b64f87ea9a82 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:40.987144 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5fff2d98-0606-4d54-ac42-b64f87ea9a82 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:40.987598 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5fff2d98-0606-4d54-ac42-b64f87ea9a82 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:40.988390 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5fff2d98-0606-4d54-ac42-b64f87ea9a82 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:40.988923 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5fff2d98-0606-4d54-ac42-b64f87ea9a82 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:41.016814 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-5fff2d98-0606-4d54-ac42-b64f87ea9a82 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Going to try to terminate instance {{(pid=117716) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 07:41:41.079044 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-bb00b12b-632d-498a-bab3-61229998248d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:41.095148 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-bb00b12b-632d-498a-bab3-61229998248d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.162999 Jul 26 07:41:41.096946 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 680/1307] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:41:40 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:41:41.114375 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-5fff2d98-0606-4d54-ac42-b64f87ea9a82 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "DELETE /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 204 len: 0 microversion: 2.20 time: 0.138215 Jul 26 07:41:41.115504 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 628/1308] 10.222.0.39 () {60 vars in 1280 bytes} [Tue Jul 26 07:41:40 2022] DELETE /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 26 07:41:41.125154 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-636d1466-bed4-433e-a673-0707be60729f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:41.125966 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-636d1466-bed4-433e-a673-0707be60729f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:41.132345 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-636d1466-bed4-433e-a673-0707be60729f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:41.132960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-636d1466-bed4-433e-a673-0707be60729f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:41.134344 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-636d1466-bed4-433e-a673-0707be60729f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:41.134778 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-636d1466-bed4-433e-a673-0707be60729f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:41.278805 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-636d1466-bed4-433e-a673-0707be60729f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:41.287975 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-636d1466-bed4-433e-a673-0707be60729f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:41.289520 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-636d1466-bed4-433e-a673-0707be60729f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:41.290727 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-636d1466-bed4-433e-a673-0707be60729f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1803 microversion: 2.20 time: 0.170688 Jul 26 07:41:41.291288 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 681/1309] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:41:41 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1803 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:41:42.119511 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-e6a109a9-0b4c-474b-897d-9c062430a33d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:42.120175 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-e6a109a9-0b4c-474b-897d-9c062430a33d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:42.127520 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e6a109a9-0b4c-474b-897d-9c062430a33d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:42.127966 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e6a109a9-0b4c-474b-897d-9c062430a33d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:42.128738 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e6a109a9-0b4c-474b-897d-9c062430a33d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:42.129173 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e6a109a9-0b4c-474b-897d-9c062430a33d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:42.314696 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-96481c28-6788-44a1-b759-8f1f6ab0a66c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:42.315486 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-96481c28-6788-44a1-b759-8f1f6ab0a66c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:42.322628 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-96481c28-6788-44a1-b759-8f1f6ab0a66c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:42.323085 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-96481c28-6788-44a1-b759-8f1f6ab0a66c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:42.323853 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-96481c28-6788-44a1-b759-8f1f6ab0a66c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:42.324285 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-96481c28-6788-44a1-b759-8f1f6ab0a66c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:42.362800 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-e6a109a9-0b4c-474b-897d-9c062430a33d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:42.371530 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-e6a109a9-0b4c-474b-897d-9c062430a33d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.256298 Jul 26 07:41:42.372461 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 629/1310] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:41:42 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:41:42.388454 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-96481c28-6788-44a1-b759-8f1f6ab0a66c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:42.398656 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-96481c28-6788-44a1-b759-8f1f6ab0a66c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:42.400269 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-96481c28-6788-44a1-b759-8f1f6ab0a66c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:42.401442 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-96481c28-6788-44a1-b759-8f1f6ab0a66c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1735 microversion: 2.20 time: 0.090778 Jul 26 07:41:42.402042 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 682/1311] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:41:42 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1735 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:41:42.586769 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-802429ea-9c44-4df3-b229-da17487be584 req-530a720e-70d6-4c9a-8f2f-f4c80c061ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "990571a8-aa04-4aac-921c-cf071eca1dd0", "name": "network-vif-deleted", "tag": "06f98651-1a4f-4f3c-a886-1d5aad025305"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:41:42.596906 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-802429ea-9c44-4df3-b229-da17487be584 req-530a720e-70d6-4c9a-8f2f-f4c80c061ce5 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:42.597569 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-802429ea-9c44-4df3-b229-da17487be584 req-530a720e-70d6-4c9a-8f2f-f4c80c061ce5 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:42.610226 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-802429ea-9c44-4df3-b229-da17487be584 req-530a720e-70d6-4c9a-8f2f-f4c80c061ce5 service nova] Creating event network-vif-deleted:06f98651-1a4f-4f3c-a886-1d5aad025305 for instance 990571a8-aa04-4aac-921c-cf071eca1dd0 on hv-cinder-85083 Jul 26 07:41:42.619878 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-802429ea-9c44-4df3-b229-da17487be584 req-530a720e-70d6-4c9a-8f2f-f4c80c061ce5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036961 Jul 26 07:41:42.620669 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 630/1312] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:41:43.393023 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-fec472e6-8c8e-46eb-ac16-826c27bcd982 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:43.393614 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-fec472e6-8c8e-46eb-ac16-826c27bcd982 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:43.401643 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fec472e6-8c8e-46eb-ac16-826c27bcd982 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:43.402463 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fec472e6-8c8e-46eb-ac16-826c27bcd982 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:43.403314 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fec472e6-8c8e-46eb-ac16-826c27bcd982 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:43.403813 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fec472e6-8c8e-46eb-ac16-826c27bcd982 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:43.425479 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ab5d5e84-7d26-4591-b062-515f334b880f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:43.426830 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ab5d5e84-7d26-4591-b062-515f334b880f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:43.439501 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ab5d5e84-7d26-4591-b062-515f334b880f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:43.439501 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ab5d5e84-7d26-4591-b062-515f334b880f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:43.439501 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ab5d5e84-7d26-4591-b062-515f334b880f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:43.439501 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ab5d5e84-7d26-4591-b062-515f334b880f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:43.509501 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ab5d5e84-7d26-4591-b062-515f334b880f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:43.518428 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ab5d5e84-7d26-4591-b062-515f334b880f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:43.520019 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ab5d5e84-7d26-4591-b062-515f334b880f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:43.521249 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ab5d5e84-7d26-4591-b062-515f334b880f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.100399 Jul 26 07:41:43.521999 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 631/1313] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:41:43 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:41:43.552636 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-fec472e6-8c8e-46eb-ac16-826c27bcd982 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:43.561765 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-fec472e6-8c8e-46eb-ac16-826c27bcd982 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.172545 Jul 26 07:41:43.562404 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 683/1314] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:41:43 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:41:44.546409 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-28a093d9-19c1-4f6f-bfc7-b3e0ab30721d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:44.547072 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-28a093d9-19c1-4f6f-bfc7-b3e0ab30721d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:44.556761 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-28a093d9-19c1-4f6f-bfc7-b3e0ab30721d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:44.557236 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-28a093d9-19c1-4f6f-bfc7-b3e0ab30721d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:44.558496 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-28a093d9-19c1-4f6f-bfc7-b3e0ab30721d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:44.558931 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-28a093d9-19c1-4f6f-bfc7-b3e0ab30721d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:44.584350 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-1129253e-a7f0-47d3-b666-18d310310284 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:44.584970 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-1129253e-a7f0-47d3-b666-18d310310284 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:44.592003 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1129253e-a7f0-47d3-b666-18d310310284 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:44.592453 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1129253e-a7f0-47d3-b666-18d310310284 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:44.593223 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1129253e-a7f0-47d3-b666-18d310310284 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:44.593683 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1129253e-a7f0-47d3-b666-18d310310284 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:44.637572 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-28a093d9-19c1-4f6f-bfc7-b3e0ab30721d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:44.646979 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-28a093d9-19c1-4f6f-bfc7-b3e0ab30721d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:44.649425 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-28a093d9-19c1-4f6f-bfc7-b3e0ab30721d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:44.649899 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-28a093d9-19c1-4f6f-bfc7-b3e0ab30721d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.107589 Jul 26 07:41:44.650709 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 632/1315] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:41:44 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:41:44.735394 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-1129253e-a7f0-47d3-b666-18d310310284 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:44.745334 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-1129253e-a7f0-47d3-b666-18d310310284 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.165263 Jul 26 07:41:44.745943 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 684/1316] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:41:44 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:41:45.672801 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-870e31aa-86e0-45e3-b6a3-98848aa2e102 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:45.673419 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-870e31aa-86e0-45e3-b6a3-98848aa2e102 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:45.680760 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-870e31aa-86e0-45e3-b6a3-98848aa2e102 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:45.681240 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-870e31aa-86e0-45e3-b6a3-98848aa2e102 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:45.682051 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-870e31aa-86e0-45e3-b6a3-98848aa2e102 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:45.682488 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-870e31aa-86e0-45e3-b6a3-98848aa2e102 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:45.746982 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-870e31aa-86e0-45e3-b6a3-98848aa2e102 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:45.759458 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-870e31aa-86e0-45e3-b6a3-98848aa2e102 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:45.761162 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-870e31aa-86e0-45e3-b6a3-98848aa2e102 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:45.762379 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-870e31aa-86e0-45e3-b6a3-98848aa2e102 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.093538 Jul 26 07:41:45.762906 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 633/1317] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:41:45 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:41:45.766909 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-25106fda-03f5-4e3d-afde-6d015aaa3799 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:45.767513 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-25106fda-03f5-4e3d-afde-6d015aaa3799 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:45.774504 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-25106fda-03f5-4e3d-afde-6d015aaa3799 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:45.774938 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-25106fda-03f5-4e3d-afde-6d015aaa3799 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:45.775697 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-25106fda-03f5-4e3d-afde-6d015aaa3799 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:45.776118 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-25106fda-03f5-4e3d-afde-6d015aaa3799 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:45.920553 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-25106fda-03f5-4e3d-afde-6d015aaa3799 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:45.932691 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-25106fda-03f5-4e3d-afde-6d015aaa3799 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.169412 Jul 26 07:41:45.933500 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 685/1318] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:41:45 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:41:46.787274 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-dfeba97d-e279-49b0-bd84-126d12a77f58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:46.788007 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-dfeba97d-e279-49b0-bd84-126d12a77f58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:46.795207 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dfeba97d-e279-49b0-bd84-126d12a77f58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:46.795649 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dfeba97d-e279-49b0-bd84-126d12a77f58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:46.796411 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dfeba97d-e279-49b0-bd84-126d12a77f58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:46.796946 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dfeba97d-e279-49b0-bd84-126d12a77f58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:46.861723 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-dfeba97d-e279-49b0-bd84-126d12a77f58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:46.870353 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-dfeba97d-e279-49b0-bd84-126d12a77f58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:46.871830 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-dfeba97d-e279-49b0-bd84-126d12a77f58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:46.872970 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-dfeba97d-e279-49b0-bd84-126d12a77f58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.090717 Jul 26 07:41:46.873531 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 634/1319] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:41:46 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:41:46.960363 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-af037995-3da4-4f6f-bc8b-9089c3a3f152 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:46.960919 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-af037995-3da4-4f6f-bc8b-9089c3a3f152 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:46.967846 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-af037995-3da4-4f6f-bc8b-9089c3a3f152 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:46.968292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-af037995-3da4-4f6f-bc8b-9089c3a3f152 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:46.969045 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-af037995-3da4-4f6f-bc8b-9089c3a3f152 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:46.969472 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-af037995-3da4-4f6f-bc8b-9089c3a3f152 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:47.110769 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-af037995-3da4-4f6f-bc8b-9089c3a3f152 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:47.114228 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:41:47.119604 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-af037995-3da4-4f6f-bc8b-9089c3a3f152 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.165125 Jul 26 07:41:47.120161 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 686/1320] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:41:46 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:41:47.896434 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c497c1af-b40c-48a3-a704-533d8210bb95 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:47.897022 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c497c1af-b40c-48a3-a704-533d8210bb95 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:47.904351 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c497c1af-b40c-48a3-a704-533d8210bb95 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:47.904795 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c497c1af-b40c-48a3-a704-533d8210bb95 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:47.905594 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c497c1af-b40c-48a3-a704-533d8210bb95 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:47.906060 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c497c1af-b40c-48a3-a704-533d8210bb95 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:47.924222 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:41:47.973989 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-c497c1af-b40c-48a3-a704-533d8210bb95 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:47.986453 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-c497c1af-b40c-48a3-a704-533d8210bb95 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:47.988576 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-c497c1af-b40c-48a3-a704-533d8210bb95 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:47.990023 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c497c1af-b40c-48a3-a704-533d8210bb95 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.097589 Jul 26 07:41:47.990719 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 635/1321] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:41:47 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:41:48.140837 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-2cb87491-0592-40f2-8f99-aaf57fa9d21a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:48.141458 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2cb87491-0592-40f2-8f99-aaf57fa9d21a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:48.149488 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2cb87491-0592-40f2-8f99-aaf57fa9d21a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:48.149880 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2cb87491-0592-40f2-8f99-aaf57fa9d21a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:48.150644 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2cb87491-0592-40f2-8f99-aaf57fa9d21a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:48.151073 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2cb87491-0592-40f2-8f99-aaf57fa9d21a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:48.296649 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2cb87491-0592-40f2-8f99-aaf57fa9d21a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:48.306648 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-2cb87491-0592-40f2-8f99-aaf57fa9d21a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.169372 Jul 26 07:41:48.307444 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 687/1322] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:41:48 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:41:49.013659 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-e269d920-23c0-48be-b65f-2fb73a5c5277 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:49.014440 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-e269d920-23c0-48be-b65f-2fb73a5c5277 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:49.021400 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e269d920-23c0-48be-b65f-2fb73a5c5277 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:49.021880 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e269d920-23c0-48be-b65f-2fb73a5c5277 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:49.022648 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e269d920-23c0-48be-b65f-2fb73a5c5277 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:49.023074 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e269d920-23c0-48be-b65f-2fb73a5c5277 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:49.091701 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-e269d920-23c0-48be-b65f-2fb73a5c5277 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:49.103561 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-e269d920-23c0-48be-b65f-2fb73a5c5277 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:49.105029 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-e269d920-23c0-48be-b65f-2fb73a5c5277 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:49.106215 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-e269d920-23c0-48be-b65f-2fb73a5c5277 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.096593 Jul 26 07:41:49.106769 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 636/1323] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:41:49 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:41:49.332409 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-93e2a76b-f5ba-4c6d-b18a-651333da2461 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:49.333032 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-93e2a76b-f5ba-4c6d-b18a-651333da2461 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:49.340504 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-93e2a76b-f5ba-4c6d-b18a-651333da2461 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:49.340965 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-93e2a76b-f5ba-4c6d-b18a-651333da2461 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:49.341774 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-93e2a76b-f5ba-4c6d-b18a-651333da2461 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:49.342228 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-93e2a76b-f5ba-4c6d-b18a-651333da2461 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:49.504366 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-93e2a76b-f5ba-4c6d-b18a-651333da2461 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:49.512745 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-93e2a76b-f5ba-4c6d-b18a-651333da2461 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.184921 Jul 26 07:41:49.513339 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 688/1324] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:41:49 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:41:50.129271 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-246b9744-3433-4268-9259-54e99383d6b4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:50.129898 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-246b9744-3433-4268-9259-54e99383d6b4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:50.136831 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-246b9744-3433-4268-9259-54e99383d6b4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:50.137280 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-246b9744-3433-4268-9259-54e99383d6b4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:50.138088 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-246b9744-3433-4268-9259-54e99383d6b4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:50.138520 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-246b9744-3433-4268-9259-54e99383d6b4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:50.205769 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-246b9744-3433-4268-9259-54e99383d6b4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:50.215188 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-246b9744-3433-4268-9259-54e99383d6b4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:50.216753 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-246b9744-3433-4268-9259-54e99383d6b4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:50.218044 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-246b9744-3433-4268-9259-54e99383d6b4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.092767 Jul 26 07:41:50.218596 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 637/1325] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:41:50 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:41:50.535109 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-0609ead7-b659-4225-b18a-3cdc94efe6b3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:50.535672 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-0609ead7-b659-4225-b18a-3cdc94efe6b3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:50.542913 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0609ead7-b659-4225-b18a-3cdc94efe6b3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:50.543363 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0609ead7-b659-4225-b18a-3cdc94efe6b3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:50.544128 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0609ead7-b659-4225-b18a-3cdc94efe6b3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:50.544564 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0609ead7-b659-4225-b18a-3cdc94efe6b3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:50.689840 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-0609ead7-b659-4225-b18a-3cdc94efe6b3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:50.698764 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-0609ead7-b659-4225-b18a-3cdc94efe6b3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.167515 Jul 26 07:41:50.699241 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 689/1326] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:41:50 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:41:51.242030 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f039c95b-08a8-4602-9899-f0f728311aae tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:51.242681 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-f039c95b-08a8-4602-9899-f0f728311aae tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:51.250840 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f039c95b-08a8-4602-9899-f0f728311aae tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:51.251257 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f039c95b-08a8-4602-9899-f0f728311aae tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:51.252089 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f039c95b-08a8-4602-9899-f0f728311aae tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:51.252705 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f039c95b-08a8-4602-9899-f0f728311aae tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:51.318119 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-f039c95b-08a8-4602-9899-f0f728311aae tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:51.328219 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-f039c95b-08a8-4602-9899-f0f728311aae tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:51.329684 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-f039c95b-08a8-4602-9899-f0f728311aae tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:51.330875 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f039c95b-08a8-4602-9899-f0f728311aae tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.093539 Jul 26 07:41:51.331790 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 638/1327] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:41:51 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:41:51.721095 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-0a4be996-a59a-4e64-bf3c-77aea33f7ba8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:51.721689 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-0a4be996-a59a-4e64-bf3c-77aea33f7ba8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:51.729074 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0a4be996-a59a-4e64-bf3c-77aea33f7ba8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:51.729522 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0a4be996-a59a-4e64-bf3c-77aea33f7ba8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:51.730332 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0a4be996-a59a-4e64-bf3c-77aea33f7ba8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:51.730758 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0a4be996-a59a-4e64-bf3c-77aea33f7ba8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:51.879353 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-0a4be996-a59a-4e64-bf3c-77aea33f7ba8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:51.887452 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-0a4be996-a59a-4e64-bf3c-77aea33f7ba8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.170350 Jul 26 07:41:51.888050 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 690/1328] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:41:51 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:41:52.356736 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7957f424-90f0-4778-a687-564fe4819abf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:52.357479 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7957f424-90f0-4778-a687-564fe4819abf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:52.367784 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7957f424-90f0-4778-a687-564fe4819abf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:52.368246 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7957f424-90f0-4778-a687-564fe4819abf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:52.369064 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7957f424-90f0-4778-a687-564fe4819abf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:52.369726 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7957f424-90f0-4778-a687-564fe4819abf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:52.435433 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7957f424-90f0-4778-a687-564fe4819abf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:52.444384 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7957f424-90f0-4778-a687-564fe4819abf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:52.445888 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7957f424-90f0-4778-a687-564fe4819abf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:52.447045 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7957f424-90f0-4778-a687-564fe4819abf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.096377 Jul 26 07:41:52.447589 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 639/1329] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:41:52 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:41:52.909461 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-4a8d64fd-750b-4128-8f5d-22368e27781c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:52.910014 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-4a8d64fd-750b-4128-8f5d-22368e27781c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:52.912367 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:41:52.918266 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4a8d64fd-750b-4128-8f5d-22368e27781c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:52.918712 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4a8d64fd-750b-4128-8f5d-22368e27781c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:52.919475 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4a8d64fd-750b-4128-8f5d-22368e27781c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:52.919904 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4a8d64fd-750b-4128-8f5d-22368e27781c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:53.064431 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-4a8d64fd-750b-4128-8f5d-22368e27781c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:53.077048 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-4a8d64fd-750b-4128-8f5d-22368e27781c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.171314 Jul 26 07:41:53.077913 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 691/1330] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:41:52 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:41:53.470759 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7cf6defb-851d-4341-adb8-9195d8f4ad61 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:53.471366 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7cf6defb-851d-4341-adb8-9195d8f4ad61 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:53.473701 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:41:53.479501 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7cf6defb-851d-4341-adb8-9195d8f4ad61 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:53.479956 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7cf6defb-851d-4341-adb8-9195d8f4ad61 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:53.480759 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7cf6defb-851d-4341-adb8-9195d8f4ad61 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:53.481190 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7cf6defb-851d-4341-adb8-9195d8f4ad61 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:53.554725 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7cf6defb-851d-4341-adb8-9195d8f4ad61 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:53.567130 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7cf6defb-851d-4341-adb8-9195d8f4ad61 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:53.569324 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7cf6defb-851d-4341-adb8-9195d8f4ad61 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:53.570604 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7cf6defb-851d-4341-adb8-9195d8f4ad61 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.103922 Jul 26 07:41:53.571165 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 640/1331] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:41:53 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:41:54.103177 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-01359246-15be-43ef-b3a1-22f678b033a6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:54.103766 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-01359246-15be-43ef-b3a1-22f678b033a6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:54.110961 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-01359246-15be-43ef-b3a1-22f678b033a6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:54.111413 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-01359246-15be-43ef-b3a1-22f678b033a6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:54.112174 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-01359246-15be-43ef-b3a1-22f678b033a6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:54.112606 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-01359246-15be-43ef-b3a1-22f678b033a6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:54.249623 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-01359246-15be-43ef-b3a1-22f678b033a6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:54.258413 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-01359246-15be-43ef-b3a1-22f678b033a6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.160504 Jul 26 07:41:54.259042 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 692/1332] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:41:54 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:41:54.600477 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-4d64debe-8bcf-4942-8219-b523afd71e57 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:54.601053 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-4d64debe-8bcf-4942-8219-b523afd71e57 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:54.608263 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4d64debe-8bcf-4942-8219-b523afd71e57 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:54.608713 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4d64debe-8bcf-4942-8219-b523afd71e57 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:54.609471 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4d64debe-8bcf-4942-8219-b523afd71e57 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:54.609927 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4d64debe-8bcf-4942-8219-b523afd71e57 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:54.676986 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-4d64debe-8bcf-4942-8219-b523afd71e57 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:54.686858 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-4d64debe-8bcf-4942-8219-b523afd71e57 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:54.688359 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-4d64debe-8bcf-4942-8219-b523afd71e57 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:54.689513 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-4d64debe-8bcf-4942-8219-b523afd71e57 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.093135 Jul 26 07:41:54.690111 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 641/1333] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:41:54 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:41:55.282164 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-4167aa4d-7628-454f-b597-0d0f1d15a32a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:55.282788 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-4167aa4d-7628-454f-b597-0d0f1d15a32a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:55.292053 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4167aa4d-7628-454f-b597-0d0f1d15a32a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:55.292558 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4167aa4d-7628-454f-b597-0d0f1d15a32a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:55.293445 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4167aa4d-7628-454f-b597-0d0f1d15a32a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:55.294095 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4167aa4d-7628-454f-b597-0d0f1d15a32a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:55.430365 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-4167aa4d-7628-454f-b597-0d0f1d15a32a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:55.439368 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-4167aa4d-7628-454f-b597-0d0f1d15a32a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.162950 Jul 26 07:41:55.440175 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 693/1334] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:41:55 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:41:55.714177 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-aef552dc-00c9-42d1-b7e1-bec971f92876 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:55.714825 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-aef552dc-00c9-42d1-b7e1-bec971f92876 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:55.722425 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-aef552dc-00c9-42d1-b7e1-bec971f92876 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:55.722936 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-aef552dc-00c9-42d1-b7e1-bec971f92876 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:55.723714 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-aef552dc-00c9-42d1-b7e1-bec971f92876 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:55.724118 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-aef552dc-00c9-42d1-b7e1-bec971f92876 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:55.787966 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-aef552dc-00c9-42d1-b7e1-bec971f92876 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:55.797910 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-aef552dc-00c9-42d1-b7e1-bec971f92876 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:55.799412 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-aef552dc-00c9-42d1-b7e1-bec971f92876 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:55.800570 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-aef552dc-00c9-42d1-b7e1-bec971f92876 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.091289 Jul 26 07:41:55.801133 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 642/1335] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:41:55 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:41:56.461316 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f439333e-3334-4cdf-9f45-e82569c6cf96 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:56.461967 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f439333e-3334-4cdf-9f45-e82569c6cf96 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:56.468945 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f439333e-3334-4cdf-9f45-e82569c6cf96 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:56.469399 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f439333e-3334-4cdf-9f45-e82569c6cf96 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:56.470208 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f439333e-3334-4cdf-9f45-e82569c6cf96 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:56.470639 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f439333e-3334-4cdf-9f45-e82569c6cf96 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:56.605952 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f439333e-3334-4cdf-9f45-e82569c6cf96 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:56.618589 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f439333e-3334-4cdf-9f45-e82569c6cf96 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.160956 Jul 26 07:41:56.619332 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 694/1336] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:41:56 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:41:56.825653 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-30efe85f-b03a-4132-a296-3066c79cc568 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:56.826537 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-30efe85f-b03a-4132-a296-3066c79cc568 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:56.835728 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-30efe85f-b03a-4132-a296-3066c79cc568 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:56.836173 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-30efe85f-b03a-4132-a296-3066c79cc568 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:56.836933 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-30efe85f-b03a-4132-a296-3066c79cc568 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:56.837322 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-30efe85f-b03a-4132-a296-3066c79cc568 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:56.907206 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-30efe85f-b03a-4132-a296-3066c79cc568 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:56.915738 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-30efe85f-b03a-4132-a296-3066c79cc568 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:56.917201 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-30efe85f-b03a-4132-a296-3066c79cc568 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:56.918382 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-30efe85f-b03a-4132-a296-3066c79cc568 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.097770 Jul 26 07:41:56.918939 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 643/1337] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:41:56 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:41:57.643974 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-12e525be-4f42-441a-84c5-c9a90f840dc4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:57.644565 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-12e525be-4f42-441a-84c5-c9a90f840dc4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:57.651798 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-12e525be-4f42-441a-84c5-c9a90f840dc4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:57.652246 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-12e525be-4f42-441a-84c5-c9a90f840dc4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:57.653087 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-12e525be-4f42-441a-84c5-c9a90f840dc4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:57.653451 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-12e525be-4f42-441a-84c5-c9a90f840dc4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:57.797496 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-12e525be-4f42-441a-84c5-c9a90f840dc4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:57.809253 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-12e525be-4f42-441a-84c5-c9a90f840dc4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.169060 Jul 26 07:41:57.811012 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 695/1338] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:41:57 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:41:57.942838 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c04a1623-73da-442e-bd32-fe7f3d84bf1e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:57.943557 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c04a1623-73da-442e-bd32-fe7f3d84bf1e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:57.950948 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c04a1623-73da-442e-bd32-fe7f3d84bf1e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:57.951390 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c04a1623-73da-442e-bd32-fe7f3d84bf1e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:57.952144 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c04a1623-73da-442e-bd32-fe7f3d84bf1e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:57.952570 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c04a1623-73da-442e-bd32-fe7f3d84bf1e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:58.022702 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-c04a1623-73da-442e-bd32-fe7f3d84bf1e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:58.031756 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-c04a1623-73da-442e-bd32-fe7f3d84bf1e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:58.033234 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-c04a1623-73da-442e-bd32-fe7f3d84bf1e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:58.034427 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c04a1623-73da-442e-bd32-fe7f3d84bf1e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.096645 Jul 26 07:41:58.034977 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 644/1339] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:41:57 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:41:58.838231 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-17a3d824-75b1-44cb-86e3-e97fbafa1aed tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:58.838952 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-17a3d824-75b1-44cb-86e3-e97fbafa1aed tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:58.845874 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-17a3d824-75b1-44cb-86e3-e97fbafa1aed tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:58.846321 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-17a3d824-75b1-44cb-86e3-e97fbafa1aed tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:58.847075 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-17a3d824-75b1-44cb-86e3-e97fbafa1aed tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:58.847486 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-17a3d824-75b1-44cb-86e3-e97fbafa1aed tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:58.989188 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-17a3d824-75b1-44cb-86e3-e97fbafa1aed tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:58.997468 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-17a3d824-75b1-44cb-86e3-e97fbafa1aed tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.165066 Jul 26 07:41:58.998098 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 696/1340] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:41:58 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:41:59.058532 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-de2e0255-e27d-43d2-96ee-8b5346fa765f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:41:59.059104 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-de2e0255-e27d-43d2-96ee-8b5346fa765f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:41:59.066066 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-de2e0255-e27d-43d2-96ee-8b5346fa765f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:59.066535 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-de2e0255-e27d-43d2-96ee-8b5346fa765f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:59.067301 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-de2e0255-e27d-43d2-96ee-8b5346fa765f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:41:59.067696 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-de2e0255-e27d-43d2-96ee-8b5346fa765f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:41:59.136737 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-de2e0255-e27d-43d2-96ee-8b5346fa765f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:59.145694 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-de2e0255-e27d-43d2-96ee-8b5346fa765f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:59.147220 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-de2e0255-e27d-43d2-96ee-8b5346fa765f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:41:59.148373 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-de2e0255-e27d-43d2-96ee-8b5346fa765f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.095241 Jul 26 07:41:59.148930 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 645/1341] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:41:59 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:00.024908 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3da9140c-8dbe-4bc7-93a1-42114910d934 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:00.025692 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3da9140c-8dbe-4bc7-93a1-42114910d934 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:00.034577 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3da9140c-8dbe-4bc7-93a1-42114910d934 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:00.035175 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3da9140c-8dbe-4bc7-93a1-42114910d934 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:00.036193 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3da9140c-8dbe-4bc7-93a1-42114910d934 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:00.036768 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3da9140c-8dbe-4bc7-93a1-42114910d934 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:00.171534 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ab245d04-1c5c-407b-90cf-04a36eec0e76 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:00.172133 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ab245d04-1c5c-407b-90cf-04a36eec0e76 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:00.175487 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3da9140c-8dbe-4bc7-93a1-42114910d934 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:00.179067 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ab245d04-1c5c-407b-90cf-04a36eec0e76 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:00.179515 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ab245d04-1c5c-407b-90cf-04a36eec0e76 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:00.180303 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ab245d04-1c5c-407b-90cf-04a36eec0e76 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:00.180737 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ab245d04-1c5c-407b-90cf-04a36eec0e76 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:00.183714 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3da9140c-8dbe-4bc7-93a1-42114910d934 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.165577 Jul 26 07:42:00.184299 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 697/1342] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:00 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:00.247588 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ab245d04-1c5c-407b-90cf-04a36eec0e76 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:00.256589 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ab245d04-1c5c-407b-90cf-04a36eec0e76 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:00.258086 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ab245d04-1c5c-407b-90cf-04a36eec0e76 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:00.259233 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ab245d04-1c5c-407b-90cf-04a36eec0e76 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.091769 Jul 26 07:42:00.259920 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 646/1343] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:00 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:01.210798 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-5a155ca0-3baf-495f-bfff-9b72436e70b1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:01.211686 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-5a155ca0-3baf-495f-bfff-9b72436e70b1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:01.219380 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5a155ca0-3baf-495f-bfff-9b72436e70b1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:01.219830 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5a155ca0-3baf-495f-bfff-9b72436e70b1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:01.220589 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5a155ca0-3baf-495f-bfff-9b72436e70b1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:01.221018 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5a155ca0-3baf-495f-bfff-9b72436e70b1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:01.282587 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7ff16217-32d2-40a7-b5a9-46c9e58e434a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:01.283235 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7ff16217-32d2-40a7-b5a9-46c9e58e434a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:01.290903 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7ff16217-32d2-40a7-b5a9-46c9e58e434a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:01.291494 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7ff16217-32d2-40a7-b5a9-46c9e58e434a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:01.292273 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7ff16217-32d2-40a7-b5a9-46c9e58e434a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:01.292731 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7ff16217-32d2-40a7-b5a9-46c9e58e434a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:01.356834 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7ff16217-32d2-40a7-b5a9-46c9e58e434a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:01.360402 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-5a155ca0-3baf-495f-bfff-9b72436e70b1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:01.365997 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7ff16217-32d2-40a7-b5a9-46c9e58e434a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:01.367483 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7ff16217-32d2-40a7-b5a9-46c9e58e434a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:01.368417 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-5a155ca0-3baf-495f-bfff-9b72436e70b1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.164792 Jul 26 07:42:01.368672 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7ff16217-32d2-40a7-b5a9-46c9e58e434a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.090195 Jul 26 07:42:01.368994 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 698/1344] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:01 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:01.369258 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 647/1345] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:01 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:02.391598 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-5dc30138-070a-484b-a3eb-0800b0a543ad tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:02.392435 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9e404bda-ecaf-4a63-bca7-e7b34074bfaf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:02.392814 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-5dc30138-070a-484b-a3eb-0800b0a543ad tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:02.392911 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-9e404bda-ecaf-4a63-bca7-e7b34074bfaf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:02.399722 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5dc30138-070a-484b-a3eb-0800b0a543ad tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:02.399945 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9e404bda-ecaf-4a63-bca7-e7b34074bfaf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:02.400154 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5dc30138-070a-484b-a3eb-0800b0a543ad tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:02.400319 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9e404bda-ecaf-4a63-bca7-e7b34074bfaf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:02.401001 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9e404bda-ecaf-4a63-bca7-e7b34074bfaf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:02.401289 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5dc30138-070a-484b-a3eb-0800b0a543ad tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:02.401443 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9e404bda-ecaf-4a63-bca7-e7b34074bfaf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:02.401781 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5dc30138-070a-484b-a3eb-0800b0a543ad tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:02.471783 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-9e404bda-ecaf-4a63-bca7-e7b34074bfaf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:02.481202 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-9e404bda-ecaf-4a63-bca7-e7b34074bfaf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:02.482623 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-9e404bda-ecaf-4a63-bca7-e7b34074bfaf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:02.483687 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-9e404bda-ecaf-4a63-bca7-e7b34074bfaf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.095810 Jul 26 07:42:02.484216 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 648/1346] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:02 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:02.533501 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-5dc30138-070a-484b-a3eb-0800b0a543ad tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:02.541649 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-5dc30138-070a-484b-a3eb-0800b0a543ad tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.154258 Jul 26 07:42:02.542241 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 699/1347] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:02 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:42:03.509211 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-22b9c10f-e375-4c39-bd25-54ab895e8c58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:03.510172 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-22b9c10f-e375-4c39-bd25-54ab895e8c58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:03.519720 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-22b9c10f-e375-4c39-bd25-54ab895e8c58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:03.520348 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-22b9c10f-e375-4c39-bd25-54ab895e8c58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:03.521419 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-22b9c10f-e375-4c39-bd25-54ab895e8c58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:03.522084 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-22b9c10f-e375-4c39-bd25-54ab895e8c58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:03.570871 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-127e9414-1afa-4713-8d93-5676514a3a68 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:03.571511 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-127e9414-1afa-4713-8d93-5676514a3a68 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:03.578483 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-127e9414-1afa-4713-8d93-5676514a3a68 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:03.578937 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-127e9414-1afa-4713-8d93-5676514a3a68 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:03.579716 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-127e9414-1afa-4713-8d93-5676514a3a68 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:03.580152 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-127e9414-1afa-4713-8d93-5676514a3a68 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:03.585338 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-22b9c10f-e375-4c39-bd25-54ab895e8c58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:03.594122 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-22b9c10f-e375-4c39-bd25-54ab895e8c58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:03.595612 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-22b9c10f-e375-4c39-bd25-54ab895e8c58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:03.596904 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-22b9c10f-e375-4c39-bd25-54ab895e8c58 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.093394 Jul 26 07:42:03.597454 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 649/1348] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:03 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:03.727468 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-127e9414-1afa-4713-8d93-5676514a3a68 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:03.736184 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-127e9414-1afa-4713-8d93-5676514a3a68 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.169588 Jul 26 07:42:03.736756 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 700/1349] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:03 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:04.621673 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-05075fd9-e1fa-4120-ac54-e6ecf2a85e0a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:04.622330 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-05075fd9-e1fa-4120-ac54-e6ecf2a85e0a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:04.629640 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-05075fd9-e1fa-4120-ac54-e6ecf2a85e0a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:04.630171 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-05075fd9-e1fa-4120-ac54-e6ecf2a85e0a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:04.630938 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-05075fd9-e1fa-4120-ac54-e6ecf2a85e0a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:04.631390 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-05075fd9-e1fa-4120-ac54-e6ecf2a85e0a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:04.699023 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-05075fd9-e1fa-4120-ac54-e6ecf2a85e0a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:04.708253 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-05075fd9-e1fa-4120-ac54-e6ecf2a85e0a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:04.709715 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-05075fd9-e1fa-4120-ac54-e6ecf2a85e0a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:04.710886 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-05075fd9-e1fa-4120-ac54-e6ecf2a85e0a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.093471 Jul 26 07:42:04.711444 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 650/1350] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:04 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:04.760813 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-fd2a00cd-9b32-4a91-8a56-95e276ae581e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:04.761808 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-fd2a00cd-9b32-4a91-8a56-95e276ae581e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:04.768927 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fd2a00cd-9b32-4a91-8a56-95e276ae581e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:04.769368 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fd2a00cd-9b32-4a91-8a56-95e276ae581e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:04.770164 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fd2a00cd-9b32-4a91-8a56-95e276ae581e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:04.770589 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fd2a00cd-9b32-4a91-8a56-95e276ae581e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:04.922425 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-fd2a00cd-9b32-4a91-8a56-95e276ae581e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:04.930846 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-fd2a00cd-9b32-4a91-8a56-95e276ae581e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.176159 Jul 26 07:42:04.931422 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 701/1351] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:04 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:05.737547 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7ab57f48-6a01-44d7-aa04-8764bb43550a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:05.738172 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7ab57f48-6a01-44d7-aa04-8764bb43550a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:05.747234 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7ab57f48-6a01-44d7-aa04-8764bb43550a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:05.747699 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7ab57f48-6a01-44d7-aa04-8764bb43550a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:05.748548 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7ab57f48-6a01-44d7-aa04-8764bb43550a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:05.748977 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7ab57f48-6a01-44d7-aa04-8764bb43550a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:05.811128 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7ab57f48-6a01-44d7-aa04-8764bb43550a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:05.819830 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7ab57f48-6a01-44d7-aa04-8764bb43550a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:05.821566 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7ab57f48-6a01-44d7-aa04-8764bb43550a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:05.822562 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7ab57f48-6a01-44d7-aa04-8764bb43550a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.091447 Jul 26 07:42:05.823326 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 651/1352] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:05 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:05.953812 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-906637d5-abae-41a6-a575-68df972574cd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:05.954489 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-906637d5-abae-41a6-a575-68df972574cd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:05.962017 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-906637d5-abae-41a6-a575-68df972574cd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:05.962470 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-906637d5-abae-41a6-a575-68df972574cd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:05.963237 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-906637d5-abae-41a6-a575-68df972574cd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:05.963671 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-906637d5-abae-41a6-a575-68df972574cd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:06.095917 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-906637d5-abae-41a6-a575-68df972574cd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:06.104084 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-906637d5-abae-41a6-a575-68df972574cd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.154253 Jul 26 07:42:06.104637 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 702/1353] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:05 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:06.845782 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-51f13c1d-6b49-4c5c-a69c-d87f6ffe4fe6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:06.846441 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-51f13c1d-6b49-4c5c-a69c-d87f6ffe4fe6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:06.853604 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-51f13c1d-6b49-4c5c-a69c-d87f6ffe4fe6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:06.854082 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-51f13c1d-6b49-4c5c-a69c-d87f6ffe4fe6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:06.854842 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-51f13c1d-6b49-4c5c-a69c-d87f6ffe4fe6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:06.855255 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-51f13c1d-6b49-4c5c-a69c-d87f6ffe4fe6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:06.859377 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:06.928659 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-51f13c1d-6b49-4c5c-a69c-d87f6ffe4fe6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:06.941535 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-51f13c1d-6b49-4c5c-a69c-d87f6ffe4fe6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:06.943851 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-51f13c1d-6b49-4c5c-a69c-d87f6ffe4fe6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:06.945556 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-51f13c1d-6b49-4c5c-a69c-d87f6ffe4fe6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.103614 Jul 26 07:42:06.946440 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 652/1354] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:06 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:07.126321 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-1a88c7d6-66d0-4e2b-8124-08757ca3a48f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:07.126887 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-1a88c7d6-66d0-4e2b-8124-08757ca3a48f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:07.133684 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1a88c7d6-66d0-4e2b-8124-08757ca3a48f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:07.134171 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1a88c7d6-66d0-4e2b-8124-08757ca3a48f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:07.134933 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1a88c7d6-66d0-4e2b-8124-08757ca3a48f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:07.135376 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1a88c7d6-66d0-4e2b-8124-08757ca3a48f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:07.157117 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:07.271561 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-1a88c7d6-66d0-4e2b-8124-08757ca3a48f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:07.280015 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-1a88c7d6-66d0-4e2b-8124-08757ca3a48f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.157978 Jul 26 07:42:07.280592 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 703/1355] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:07 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:07.971666 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a114bac2-9318-4a40-b585-c6fb84b7826f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:07.972538 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a114bac2-9318-4a40-b585-c6fb84b7826f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:07.982862 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a114bac2-9318-4a40-b585-c6fb84b7826f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:07.983548 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a114bac2-9318-4a40-b585-c6fb84b7826f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:07.984500 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a114bac2-9318-4a40-b585-c6fb84b7826f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:07.984983 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a114bac2-9318-4a40-b585-c6fb84b7826f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:08.058256 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a114bac2-9318-4a40-b585-c6fb84b7826f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:08.067051 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a114bac2-9318-4a40-b585-c6fb84b7826f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:08.068573 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a114bac2-9318-4a40-b585-c6fb84b7826f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:08.069763 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a114bac2-9318-4a40-b585-c6fb84b7826f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.103956 Jul 26 07:42:08.070345 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 653/1356] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:07 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:08.304986 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-243eab31-da83-4dc0-8c9e-4e818c1ba631 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:08.305641 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-243eab31-da83-4dc0-8c9e-4e818c1ba631 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:08.315720 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-243eab31-da83-4dc0-8c9e-4e818c1ba631 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:08.316338 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-243eab31-da83-4dc0-8c9e-4e818c1ba631 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:08.317468 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-243eab31-da83-4dc0-8c9e-4e818c1ba631 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:08.318039 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-243eab31-da83-4dc0-8c9e-4e818c1ba631 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:08.458480 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-243eab31-da83-4dc0-8c9e-4e818c1ba631 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:08.467119 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-243eab31-da83-4dc0-8c9e-4e818c1ba631 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.168175 Jul 26 07:42:08.467670 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 704/1357] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:08 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:09.096099 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-baee661c-205f-41a0-a5dd-e1fb6ae755f5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:09.096714 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-baee661c-205f-41a0-a5dd-e1fb6ae755f5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:09.103882 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-baee661c-205f-41a0-a5dd-e1fb6ae755f5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:09.104344 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-baee661c-205f-41a0-a5dd-e1fb6ae755f5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:09.105102 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-baee661c-205f-41a0-a5dd-e1fb6ae755f5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:09.105527 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-baee661c-205f-41a0-a5dd-e1fb6ae755f5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:09.182154 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-baee661c-205f-41a0-a5dd-e1fb6ae755f5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:09.195293 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-baee661c-205f-41a0-a5dd-e1fb6ae755f5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:09.197603 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-baee661c-205f-41a0-a5dd-e1fb6ae755f5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:09.199276 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-baee661c-205f-41a0-a5dd-e1fb6ae755f5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.106965 Jul 26 07:42:09.200068 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 654/1358] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:09 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:09.488644 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-fe90ffb4-92b3-4eab-8e89-715097686a26 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:09.489203 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-fe90ffb4-92b3-4eab-8e89-715097686a26 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:09.496005 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fe90ffb4-92b3-4eab-8e89-715097686a26 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:09.496453 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fe90ffb4-92b3-4eab-8e89-715097686a26 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:09.497276 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fe90ffb4-92b3-4eab-8e89-715097686a26 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:09.497710 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fe90ffb4-92b3-4eab-8e89-715097686a26 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:09.632742 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-fe90ffb4-92b3-4eab-8e89-715097686a26 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:09.642640 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-fe90ffb4-92b3-4eab-8e89-715097686a26 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.157995 Jul 26 07:42:09.643208 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 705/1359] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:09 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:10.223267 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-82524b26-1302-4128-ba64-ed091682c115 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:10.223855 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-82524b26-1302-4128-ba64-ed091682c115 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:10.230699 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-82524b26-1302-4128-ba64-ed091682c115 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:10.231142 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-82524b26-1302-4128-ba64-ed091682c115 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:10.231900 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-82524b26-1302-4128-ba64-ed091682c115 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:10.232327 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-82524b26-1302-4128-ba64-ed091682c115 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:10.293658 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-82524b26-1302-4128-ba64-ed091682c115 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:10.302292 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-82524b26-1302-4128-ba64-ed091682c115 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:10.303769 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-82524b26-1302-4128-ba64-ed091682c115 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:10.304897 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-82524b26-1302-4128-ba64-ed091682c115 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.085636 Jul 26 07:42:10.305457 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 655/1360] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:10 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:10.306471 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 07:42:10.306663 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Tue Jul 26 07:42:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 07:42:10.664004 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9955fcf6-b162-4c91-a607-1ec1fb0d9f70 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:10.664720 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-9955fcf6-b162-4c91-a607-1ec1fb0d9f70 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:10.671720 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9955fcf6-b162-4c91-a607-1ec1fb0d9f70 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:10.672205 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9955fcf6-b162-4c91-a607-1ec1fb0d9f70 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:10.672978 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9955fcf6-b162-4c91-a607-1ec1fb0d9f70 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:10.673406 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9955fcf6-b162-4c91-a607-1ec1fb0d9f70 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:10.827131 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-9955fcf6-b162-4c91-a607-1ec1fb0d9f70 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:10.839324 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-9955fcf6-b162-4c91-a607-1ec1fb0d9f70 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.178991 Jul 26 07:42:10.840125 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 706/1361] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:10 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:11.329097 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-13779e97-e908-44a7-a8cf-7602506899b3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:11.329759 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-13779e97-e908-44a7-a8cf-7602506899b3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:11.337299 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-13779e97-e908-44a7-a8cf-7602506899b3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:11.337761 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-13779e97-e908-44a7-a8cf-7602506899b3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:11.338540 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-13779e97-e908-44a7-a8cf-7602506899b3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:11.338967 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-13779e97-e908-44a7-a8cf-7602506899b3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:11.453541 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-13779e97-e908-44a7-a8cf-7602506899b3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:11.463285 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-13779e97-e908-44a7-a8cf-7602506899b3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:11.464809 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-13779e97-e908-44a7-a8cf-7602506899b3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:11.466059 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-13779e97-e908-44a7-a8cf-7602506899b3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.141449 Jul 26 07:42:11.466578 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 656/1362] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:11 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:11.862747 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-2280a583-99e5-42cb-8855-a917b3324075 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:11.863537 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2280a583-99e5-42cb-8855-a917b3324075 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:11.872265 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2280a583-99e5-42cb-8855-a917b3324075 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:11.872719 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2280a583-99e5-42cb-8855-a917b3324075 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:11.873471 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2280a583-99e5-42cb-8855-a917b3324075 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:11.873940 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2280a583-99e5-42cb-8855-a917b3324075 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:12.014120 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2280a583-99e5-42cb-8855-a917b3324075 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:12.022233 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-2280a583-99e5-42cb-8855-a917b3324075 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.164613 Jul 26 07:42:12.022787 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 707/1363] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:11 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:12.489043 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6a783175-e920-4334-af47-a4f77a590967 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:12.489662 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6a783175-e920-4334-af47-a4f77a590967 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:12.496845 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6a783175-e920-4334-af47-a4f77a590967 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:12.497340 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6a783175-e920-4334-af47-a4f77a590967 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:12.498112 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6a783175-e920-4334-af47-a4f77a590967 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:12.498567 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6a783175-e920-4334-af47-a4f77a590967 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:12.573110 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6a783175-e920-4334-af47-a4f77a590967 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:12.582161 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6a783175-e920-4334-af47-a4f77a590967 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:12.583638 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6a783175-e920-4334-af47-a4f77a590967 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:12.584783 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6a783175-e920-4334-af47-a4f77a590967 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.099910 Jul 26 07:42:12.585338 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 657/1364] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:12 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:13.047367 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f8519c2f-501a-4041-87b4-43fdd0d6576e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:13.047999 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f8519c2f-501a-4041-87b4-43fdd0d6576e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:13.058289 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f8519c2f-501a-4041-87b4-43fdd0d6576e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:13.058958 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f8519c2f-501a-4041-87b4-43fdd0d6576e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:13.060103 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f8519c2f-501a-4041-87b4-43fdd0d6576e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:13.060543 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f8519c2f-501a-4041-87b4-43fdd0d6576e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:13.209008 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f8519c2f-501a-4041-87b4-43fdd0d6576e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:13.220840 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f8519c2f-501a-4041-87b4-43fdd0d6576e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.179640 Jul 26 07:42:13.221544 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 708/1365] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:13 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:13.607995 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9429da5d-44d0-4845-97e3-182e820e3e6e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:13.608613 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-9429da5d-44d0-4845-97e3-182e820e3e6e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:13.615418 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9429da5d-44d0-4845-97e3-182e820e3e6e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:13.615866 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9429da5d-44d0-4845-97e3-182e820e3e6e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:13.616634 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9429da5d-44d0-4845-97e3-182e820e3e6e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:13.617104 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9429da5d-44d0-4845-97e3-182e820e3e6e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:13.686293 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-9429da5d-44d0-4845-97e3-182e820e3e6e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:13.695229 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-9429da5d-44d0-4845-97e3-182e820e3e6e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:13.696777 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-9429da5d-44d0-4845-97e3-182e820e3e6e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:13.697939 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-9429da5d-44d0-4845-97e3-182e820e3e6e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.094042 Jul 26 07:42:13.698499 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 658/1366] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:13 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:14.246684 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-cfd81d89-a5ed-40b3-a8b5-e3baa2e537b3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:14.247737 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-cfd81d89-a5ed-40b3-a8b5-e3baa2e537b3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:14.258753 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cfd81d89-a5ed-40b3-a8b5-e3baa2e537b3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:14.259476 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cfd81d89-a5ed-40b3-a8b5-e3baa2e537b3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:14.260722 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cfd81d89-a5ed-40b3-a8b5-e3baa2e537b3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:14.261440 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cfd81d89-a5ed-40b3-a8b5-e3baa2e537b3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:14.415795 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-cfd81d89-a5ed-40b3-a8b5-e3baa2e537b3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:14.424225 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-cfd81d89-a5ed-40b3-a8b5-e3baa2e537b3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.183995 Jul 26 07:42:14.424792 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 709/1367] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:14 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:14.721405 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ff383fc6-d369-4670-8c61-399b3d4580a5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:14.722027 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ff383fc6-d369-4670-8c61-399b3d4580a5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:14.728944 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ff383fc6-d369-4670-8c61-399b3d4580a5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:14.729403 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ff383fc6-d369-4670-8c61-399b3d4580a5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:14.730210 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ff383fc6-d369-4670-8c61-399b3d4580a5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:14.730623 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ff383fc6-d369-4670-8c61-399b3d4580a5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:14.793015 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ff383fc6-d369-4670-8c61-399b3d4580a5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:14.802185 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ff383fc6-d369-4670-8c61-399b3d4580a5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:14.803665 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ff383fc6-d369-4670-8c61-399b3d4580a5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:14.804804 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ff383fc6-d369-4670-8c61-399b3d4580a5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.087484 Jul 26 07:42:14.805358 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 659/1368] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:14 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:15.445919 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ad46bf3c-40dd-497c-b126-a10a35df8765 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:15.446586 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ad46bf3c-40dd-497c-b126-a10a35df8765 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:15.453508 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ad46bf3c-40dd-497c-b126-a10a35df8765 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:15.454002 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ad46bf3c-40dd-497c-b126-a10a35df8765 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:15.454739 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ad46bf3c-40dd-497c-b126-a10a35df8765 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:15.455164 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ad46bf3c-40dd-497c-b126-a10a35df8765 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:15.592259 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ad46bf3c-40dd-497c-b126-a10a35df8765 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:15.601124 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ad46bf3c-40dd-497c-b126-a10a35df8765 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.159151 Jul 26 07:42:15.601701 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 710/1369] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:15 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:15.828963 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-dd296cbc-35b2-4d4c-a145-5fc13dee1770 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:15.829565 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-dd296cbc-35b2-4d4c-a145-5fc13dee1770 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:15.837555 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dd296cbc-35b2-4d4c-a145-5fc13dee1770 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:15.838067 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dd296cbc-35b2-4d4c-a145-5fc13dee1770 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:15.838853 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dd296cbc-35b2-4d4c-a145-5fc13dee1770 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:15.839319 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dd296cbc-35b2-4d4c-a145-5fc13dee1770 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:15.902204 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-dd296cbc-35b2-4d4c-a145-5fc13dee1770 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:15.915185 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-dd296cbc-35b2-4d4c-a145-5fc13dee1770 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:15.917438 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-dd296cbc-35b2-4d4c-a145-5fc13dee1770 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:15.918666 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-dd296cbc-35b2-4d4c-a145-5fc13dee1770 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.094601 Jul 26 07:42:15.919327 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 660/1370] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:15 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:16.630758 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a398b215-ca07-4868-a215-5574a4b6ae65 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:16.631431 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a398b215-ca07-4868-a215-5574a4b6ae65 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:16.638632 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a398b215-ca07-4868-a215-5574a4b6ae65 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:16.639074 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a398b215-ca07-4868-a215-5574a4b6ae65 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:16.639845 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a398b215-ca07-4868-a215-5574a4b6ae65 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:16.640270 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a398b215-ca07-4868-a215-5574a4b6ae65 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:16.832393 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-a398b215-ca07-4868-a215-5574a4b6ae65 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:16.840629 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a398b215-ca07-4868-a215-5574a4b6ae65 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.213958 Jul 26 07:42:16.841251 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 711/1371] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:16 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:16.941899 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f0c1536d-905f-4d4c-9757-6fd95fca9d13 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:16.942500 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-f0c1536d-905f-4d4c-9757-6fd95fca9d13 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:16.949639 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f0c1536d-905f-4d4c-9757-6fd95fca9d13 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:16.950218 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f0c1536d-905f-4d4c-9757-6fd95fca9d13 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:16.950981 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f0c1536d-905f-4d4c-9757-6fd95fca9d13 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:16.951481 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f0c1536d-905f-4d4c-9757-6fd95fca9d13 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:17.019051 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-f0c1536d-905f-4d4c-9757-6fd95fca9d13 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:17.028092 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-f0c1536d-905f-4d4c-9757-6fd95fca9d13 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:17.029635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-f0c1536d-905f-4d4c-9757-6fd95fca9d13 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:17.030807 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f0c1536d-905f-4d4c-9757-6fd95fca9d13 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.092912 Jul 26 07:42:17.031334 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 661/1372] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:16 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:17.663260 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 07:42:17.663514 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Tue Jul 26 07:42:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 07:42:17.864959 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-191a207c-7814-40c6-aa32-db17e89d2ed0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:17.865849 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-191a207c-7814-40c6-aa32-db17e89d2ed0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:17.875048 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-191a207c-7814-40c6-aa32-db17e89d2ed0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:17.875501 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-191a207c-7814-40c6-aa32-db17e89d2ed0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:17.876274 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-191a207c-7814-40c6-aa32-db17e89d2ed0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:17.876709 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-191a207c-7814-40c6-aa32-db17e89d2ed0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:17.975373 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 07:42:17.975614 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Tue Jul 26 07:42:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f (ip 10.222.0.39) !!! Jul 26 07:42:18.016064 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-191a207c-7814-40c6-aa32-db17e89d2ed0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:18.024818 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-191a207c-7814-40c6-aa32-db17e89d2ed0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.165602 Jul 26 07:42:18.025394 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 712/1373] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:17 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:18.053247 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b3c71055-df8f-4d42-9369-4e3124267104 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:18.053858 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-b3c71055-df8f-4d42-9369-4e3124267104 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:18.061680 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b3c71055-df8f-4d42-9369-4e3124267104 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:18.062208 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b3c71055-df8f-4d42-9369-4e3124267104 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:18.063171 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b3c71055-df8f-4d42-9369-4e3124267104 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:18.063608 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b3c71055-df8f-4d42-9369-4e3124267104 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:18.132356 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-b3c71055-df8f-4d42-9369-4e3124267104 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:18.142930 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-b3c71055-df8f-4d42-9369-4e3124267104 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:18.144394 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-b3c71055-df8f-4d42-9369-4e3124267104 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:18.145541 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b3c71055-df8f-4d42-9369-4e3124267104 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.096318 Jul 26 07:42:18.146119 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 662/1374] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:18 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:19.046547 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-606d584b-dc78-4c16-9036-2ccbb8ea908a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:19.047136 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-606d584b-dc78-4c16-9036-2ccbb8ea908a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:19.054075 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-606d584b-dc78-4c16-9036-2ccbb8ea908a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:19.054553 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-606d584b-dc78-4c16-9036-2ccbb8ea908a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:19.055324 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-606d584b-dc78-4c16-9036-2ccbb8ea908a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:19.055752 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-606d584b-dc78-4c16-9036-2ccbb8ea908a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:19.167713 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-306a68bd-61dc-4812-8fb3-158c1fc1af62 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:19.168315 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-306a68bd-61dc-4812-8fb3-158c1fc1af62 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:19.175218 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-306a68bd-61dc-4812-8fb3-158c1fc1af62 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:19.175671 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-306a68bd-61dc-4812-8fb3-158c1fc1af62 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:19.176421 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-306a68bd-61dc-4812-8fb3-158c1fc1af62 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:19.176845 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-306a68bd-61dc-4812-8fb3-158c1fc1af62 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:19.197286 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-606d584b-dc78-4c16-9036-2ccbb8ea908a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:19.205702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-606d584b-dc78-4c16-9036-2ccbb8ea908a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.163190 Jul 26 07:42:19.206678 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 713/1375] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:19 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:19.243335 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-306a68bd-61dc-4812-8fb3-158c1fc1af62 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:19.252086 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-306a68bd-61dc-4812-8fb3-158c1fc1af62 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:19.253539 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-306a68bd-61dc-4812-8fb3-158c1fc1af62 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:19.254732 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-306a68bd-61dc-4812-8fb3-158c1fc1af62 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.091133 Jul 26 07:42:19.255292 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 663/1376] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:19 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 07:42:20.232021 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6c81c993-38df-4b75-844f-377f6fd55715 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:20.232703 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-6c81c993-38df-4b75-844f-377f6fd55715 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:20.239911 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6c81c993-38df-4b75-844f-377f6fd55715 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:20.240384 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6c81c993-38df-4b75-844f-377f6fd55715 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:20.241144 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6c81c993-38df-4b75-844f-377f6fd55715 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:20.241562 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6c81c993-38df-4b75-844f-377f6fd55715 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:20.280195 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a31a7d0b-9892-4545-92f9-9c4232f5dc92 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:20.280804 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a31a7d0b-9892-4545-92f9-9c4232f5dc92 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:20.287622 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a31a7d0b-9892-4545-92f9-9c4232f5dc92 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:20.288065 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a31a7d0b-9892-4545-92f9-9c4232f5dc92 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:20.288834 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a31a7d0b-9892-4545-92f9-9c4232f5dc92 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:20.289267 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a31a7d0b-9892-4545-92f9-9c4232f5dc92 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:20.351044 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a31a7d0b-9892-4545-92f9-9c4232f5dc92 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:20.359724 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a31a7d0b-9892-4545-92f9-9c4232f5dc92 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:20.361198 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a31a7d0b-9892-4545-92f9-9c4232f5dc92 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:20.362350 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a31a7d0b-9892-4545-92f9-9c4232f5dc92 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.086142 Jul 26 07:42:20.362899 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 664/1377] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:20 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:20.372822 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-6c81c993-38df-4b75-844f-377f6fd55715 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:20.381028 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6c81c993-38df-4b75-844f-377f6fd55715 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.155427 Jul 26 07:42:20.381590 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 714/1378] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:20 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:21.387232 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-36037078-fdaf-41c7-80b8-159e90228d00 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:21.387978 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-36037078-fdaf-41c7-80b8-159e90228d00 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:21.398388 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-36037078-fdaf-41c7-80b8-159e90228d00 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:21.398995 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-36037078-fdaf-41c7-80b8-159e90228d00 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:21.399901 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-36037078-fdaf-41c7-80b8-159e90228d00 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:21.400410 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-36037078-fdaf-41c7-80b8-159e90228d00 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:21.405548 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-46d03499-b4c4-4c23-be4b-87915d6c9918 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:21.406193 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-46d03499-b4c4-4c23-be4b-87915d6c9918 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:21.413053 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-46d03499-b4c4-4c23-be4b-87915d6c9918 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:21.413506 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-46d03499-b4c4-4c23-be4b-87915d6c9918 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:21.414306 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-46d03499-b4c4-4c23-be4b-87915d6c9918 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:21.414748 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-46d03499-b4c4-4c23-be4b-87915d6c9918 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:21.465688 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-36037078-fdaf-41c7-80b8-159e90228d00 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:21.474343 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-36037078-fdaf-41c7-80b8-159e90228d00 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:21.475907 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-36037078-fdaf-41c7-80b8-159e90228d00 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:21.477132 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-36037078-fdaf-41c7-80b8-159e90228d00 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.095408 Jul 26 07:42:21.477780 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 665/1379] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:21 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:21.553972 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-46d03499-b4c4-4c23-be4b-87915d6c9918 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:21.562138 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-46d03499-b4c4-4c23-be4b-87915d6c9918 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.161204 Jul 26 07:42:21.562678 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 715/1380] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:21 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:22.500587 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d7609731-76d2-4c06-aed0-076d592ddcff tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:22.501200 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d7609731-76d2-4c06-aed0-076d592ddcff tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:22.508718 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d7609731-76d2-4c06-aed0-076d592ddcff tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:22.509200 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d7609731-76d2-4c06-aed0-076d592ddcff tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:22.510081 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d7609731-76d2-4c06-aed0-076d592ddcff tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:22.510559 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d7609731-76d2-4c06-aed0-076d592ddcff tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:22.574443 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d7609731-76d2-4c06-aed0-076d592ddcff tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:22.586467 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6cbfe4c5-81b6-4df7-b831-d7c09998250c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:22.587249 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d7609731-76d2-4c06-aed0-076d592ddcff tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:22.587439 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-6cbfe4c5-81b6-4df7-b831-d7c09998250c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:22.588783 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d7609731-76d2-4c06-aed0-076d592ddcff tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:22.590591 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d7609731-76d2-4c06-aed0-076d592ddcff tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.094009 Jul 26 07:42:22.591467 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 666/1381] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:22 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:22.596821 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6cbfe4c5-81b6-4df7-b831-d7c09998250c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:22.597531 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6cbfe4c5-81b6-4df7-b831-d7c09998250c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:22.598745 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6cbfe4c5-81b6-4df7-b831-d7c09998250c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:22.599400 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6cbfe4c5-81b6-4df7-b831-d7c09998250c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:22.735378 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-6cbfe4c5-81b6-4df7-b831-d7c09998250c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:22.745061 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6cbfe4c5-81b6-4df7-b831-d7c09998250c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.164819 Jul 26 07:42:22.745913 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 716/1382] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:22 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:23.618980 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-38cb4349-2125-4383-a0a7-306616a95973 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:23.619621 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-38cb4349-2125-4383-a0a7-306616a95973 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:23.621934 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=54 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:23.627616 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-38cb4349-2125-4383-a0a7-306616a95973 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:23.628056 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-38cb4349-2125-4383-a0a7-306616a95973 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:23.628840 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-38cb4349-2125-4383-a0a7-306616a95973 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:23.629239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-38cb4349-2125-4383-a0a7-306616a95973 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:23.693498 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-38cb4349-2125-4383-a0a7-306616a95973 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:23.706499 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-38cb4349-2125-4383-a0a7-306616a95973 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:23.709535 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-38cb4349-2125-4383-a0a7-306616a95973 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:23.711356 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-38cb4349-2125-4383-a0a7-306616a95973 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.096416 Jul 26 07:42:23.711923 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 667/1383] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:23 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:23.769958 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8e2dd54b-2b55-4d5b-9568-21c2f7fe412e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:23.770667 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8e2dd54b-2b55-4d5b-9568-21c2f7fe412e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:23.773074 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=52 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:23.779412 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8e2dd54b-2b55-4d5b-9568-21c2f7fe412e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:23.779848 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8e2dd54b-2b55-4d5b-9568-21c2f7fe412e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:23.780754 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8e2dd54b-2b55-4d5b-9568-21c2f7fe412e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:23.781186 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8e2dd54b-2b55-4d5b-9568-21c2f7fe412e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:23.936122 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8e2dd54b-2b55-4d5b-9568-21c2f7fe412e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:23.948529 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8e2dd54b-2b55-4d5b-9568-21c2f7fe412e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.184154 Jul 26 07:42:23.949332 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 717/1384] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:23 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:24.735031 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-5afe282a-68d6-4715-9022-33aeab58f682 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:24.735641 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-5afe282a-68d6-4715-9022-33aeab58f682 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:24.742555 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5afe282a-68d6-4715-9022-33aeab58f682 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:24.743000 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5afe282a-68d6-4715-9022-33aeab58f682 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:24.743758 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5afe282a-68d6-4715-9022-33aeab58f682 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:24.744183 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5afe282a-68d6-4715-9022-33aeab58f682 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:24.813166 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-5afe282a-68d6-4715-9022-33aeab58f682 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:24.817704 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:24.825241 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-5afe282a-68d6-4715-9022-33aeab58f682 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:24.826880 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-5afe282a-68d6-4715-9022-33aeab58f682 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:24.828040 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-5afe282a-68d6-4715-9022-33aeab58f682 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.097295 Jul 26 07:42:24.828593 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 668/1385] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:24 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:24.971243 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-874c7e69-357e-4b98-97be-54aec49d463c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:24.971809 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-874c7e69-357e-4b98-97be-54aec49d463c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:24.978381 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-874c7e69-357e-4b98-97be-54aec49d463c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:24.978932 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-874c7e69-357e-4b98-97be-54aec49d463c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:24.979683 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-874c7e69-357e-4b98-97be-54aec49d463c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:24.980110 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-874c7e69-357e-4b98-97be-54aec49d463c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:25.112752 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-874c7e69-357e-4b98-97be-54aec49d463c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:25.121358 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-874c7e69-357e-4b98-97be-54aec49d463c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.154284 Jul 26 07:42:25.121960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 718/1386] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:24 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:25.851419 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c7181ce4-27bc-4fe1-8a1a-a6f65ec4e49a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:25.852062 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c7181ce4-27bc-4fe1-8a1a-a6f65ec4e49a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:25.859054 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c7181ce4-27bc-4fe1-8a1a-a6f65ec4e49a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:25.859504 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c7181ce4-27bc-4fe1-8a1a-a6f65ec4e49a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:25.860265 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c7181ce4-27bc-4fe1-8a1a-a6f65ec4e49a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:25.860697 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c7181ce4-27bc-4fe1-8a1a-a6f65ec4e49a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:25.926454 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-c7181ce4-27bc-4fe1-8a1a-a6f65ec4e49a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:25.935567 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-c7181ce4-27bc-4fe1-8a1a-a6f65ec4e49a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:25.937048 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-c7181ce4-27bc-4fe1-8a1a-a6f65ec4e49a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:25.938228 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c7181ce4-27bc-4fe1-8a1a-a6f65ec4e49a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.091346 Jul 26 07:42:25.938783 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 669/1387] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:25 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:26.193372 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e16540e1-fa2a-46a2-bcd0-91d517d07df3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:26.194025 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e16540e1-fa2a-46a2-bcd0-91d517d07df3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:26.200835 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e16540e1-fa2a-46a2-bcd0-91d517d07df3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:26.201331 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e16540e1-fa2a-46a2-bcd0-91d517d07df3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:26.202124 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e16540e1-fa2a-46a2-bcd0-91d517d07df3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:26.202549 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e16540e1-fa2a-46a2-bcd0-91d517d07df3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:26.343329 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-e16540e1-fa2a-46a2-bcd0-91d517d07df3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:26.355385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e16540e1-fa2a-46a2-bcd0-91d517d07df3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.215930 Jul 26 07:42:26.356145 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 719/1388] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:26 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:26.963192 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-911b307c-7988-458c-880e-47060f57edd5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:26.963945 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-911b307c-7988-458c-880e-47060f57edd5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:26.972322 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-911b307c-7988-458c-880e-47060f57edd5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:26.972801 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-911b307c-7988-458c-880e-47060f57edd5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:26.973575 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-911b307c-7988-458c-880e-47060f57edd5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:26.974052 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-911b307c-7988-458c-880e-47060f57edd5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:27.044113 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-911b307c-7988-458c-880e-47060f57edd5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:27.052726 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-911b307c-7988-458c-880e-47060f57edd5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:27.054210 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-911b307c-7988-458c-880e-47060f57edd5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:27.055345 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-911b307c-7988-458c-880e-47060f57edd5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.097689 Jul 26 07:42:27.055872 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 670/1389] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:26 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:27.221760 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 07:42:27.222009 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Tue Jul 26 07:42:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 07:42:27.377640 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-31a89a06-6224-46fe-a1b0-ad2a143b028d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:27.378259 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-31a89a06-6224-46fe-a1b0-ad2a143b028d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:27.385599 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-31a89a06-6224-46fe-a1b0-ad2a143b028d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:27.386105 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-31a89a06-6224-46fe-a1b0-ad2a143b028d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:27.386916 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-31a89a06-6224-46fe-a1b0-ad2a143b028d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:27.387377 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-31a89a06-6224-46fe-a1b0-ad2a143b028d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:27.391628 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:27.543653 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-31a89a06-6224-46fe-a1b0-ad2a143b028d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:27.551618 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-31a89a06-6224-46fe-a1b0-ad2a143b028d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.178301 Jul 26 07:42:27.552442 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 720/1390] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:27 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:28.079253 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f2911878-800a-4127-8182-68b5da587436 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:28.080033 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-f2911878-800a-4127-8182-68b5da587436 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:28.088274 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f2911878-800a-4127-8182-68b5da587436 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:28.088752 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f2911878-800a-4127-8182-68b5da587436 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:28.089527 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f2911878-800a-4127-8182-68b5da587436 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:28.089988 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f2911878-800a-4127-8182-68b5da587436 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:28.153846 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-f2911878-800a-4127-8182-68b5da587436 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:28.162778 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-f2911878-800a-4127-8182-68b5da587436 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:28.164260 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-f2911878-800a-4127-8182-68b5da587436 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:28.165399 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f2911878-800a-4127-8182-68b5da587436 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.090888 Jul 26 07:42:28.165959 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 671/1391] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:28 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:28.575126 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a0d3674d-b61f-4765-873e-09b24b1c3f8b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:28.575979 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a0d3674d-b61f-4765-873e-09b24b1c3f8b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:28.583444 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a0d3674d-b61f-4765-873e-09b24b1c3f8b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:28.583904 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a0d3674d-b61f-4765-873e-09b24b1c3f8b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:28.584673 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a0d3674d-b61f-4765-873e-09b24b1c3f8b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:28.585109 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a0d3674d-b61f-4765-873e-09b24b1c3f8b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:28.727553 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-a0d3674d-b61f-4765-873e-09b24b1c3f8b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:28.737964 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a0d3674d-b61f-4765-873e-09b24b1c3f8b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.168184 Jul 26 07:42:28.738812 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 721/1392] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:28 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:29.190650 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-731b502a-7a94-4d0b-9311-e0c3fb0166eb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:29.191375 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-731b502a-7a94-4d0b-9311-e0c3fb0166eb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:29.200335 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-731b502a-7a94-4d0b-9311-e0c3fb0166eb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:29.200920 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-731b502a-7a94-4d0b-9311-e0c3fb0166eb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:29.201683 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-731b502a-7a94-4d0b-9311-e0c3fb0166eb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:29.202144 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-731b502a-7a94-4d0b-9311-e0c3fb0166eb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:29.273614 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-731b502a-7a94-4d0b-9311-e0c3fb0166eb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:29.282209 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-731b502a-7a94-4d0b-9311-e0c3fb0166eb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:29.283615 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-731b502a-7a94-4d0b-9311-e0c3fb0166eb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:29.284760 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-731b502a-7a94-4d0b-9311-e0c3fb0166eb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.099662 Jul 26 07:42:29.285305 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 672/1393] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:29 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:29.765106 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-338652ff-e16b-4652-b3dd-3ad8c8eb1f11 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:29.765827 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-338652ff-e16b-4652-b3dd-3ad8c8eb1f11 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:29.775915 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-338652ff-e16b-4652-b3dd-3ad8c8eb1f11 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:29.776456 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-338652ff-e16b-4652-b3dd-3ad8c8eb1f11 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:29.777542 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-338652ff-e16b-4652-b3dd-3ad8c8eb1f11 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:29.778204 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-338652ff-e16b-4652-b3dd-3ad8c8eb1f11 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:29.934427 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-338652ff-e16b-4652-b3dd-3ad8c8eb1f11 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:29.942707 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-338652ff-e16b-4652-b3dd-3ad8c8eb1f11 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.183739 Jul 26 07:42:29.943273 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 722/1394] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:29 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:30.311625 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-51f6e0d0-3f5f-4cbd-9083-b0dcbfcc3db5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:30.312202 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-51f6e0d0-3f5f-4cbd-9083-b0dcbfcc3db5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:30.319129 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-51f6e0d0-3f5f-4cbd-9083-b0dcbfcc3db5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:30.319577 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-51f6e0d0-3f5f-4cbd-9083-b0dcbfcc3db5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:30.320341 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-51f6e0d0-3f5f-4cbd-9083-b0dcbfcc3db5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:30.320773 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-51f6e0d0-3f5f-4cbd-9083-b0dcbfcc3db5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:30.385946 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-51f6e0d0-3f5f-4cbd-9083-b0dcbfcc3db5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:30.394595 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-51f6e0d0-3f5f-4cbd-9083-b0dcbfcc3db5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:30.396068 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-51f6e0d0-3f5f-4cbd-9083-b0dcbfcc3db5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:30.397218 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-51f6e0d0-3f5f-4cbd-9083-b0dcbfcc3db5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.090095 Jul 26 07:42:30.397780 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 673/1395] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:30 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:30.966393 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ed196014-d2b5-4846-9d51-c4f57a742365 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:30.967122 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ed196014-d2b5-4846-9d51-c4f57a742365 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:30.976994 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ed196014-d2b5-4846-9d51-c4f57a742365 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:30.977512 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ed196014-d2b5-4846-9d51-c4f57a742365 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:30.978957 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ed196014-d2b5-4846-9d51-c4f57a742365 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:30.979399 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ed196014-d2b5-4846-9d51-c4f57a742365 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:31.115651 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ed196014-d2b5-4846-9d51-c4f57a742365 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:31.124226 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ed196014-d2b5-4846-9d51-c4f57a742365 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.161764 Jul 26 07:42:31.124791 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 723/1396] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:30 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:31.421677 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7875b66a-ada7-4a9a-a8cc-029f8822492f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:31.422328 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7875b66a-ada7-4a9a-a8cc-029f8822492f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:31.428858 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7875b66a-ada7-4a9a-a8cc-029f8822492f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:31.429303 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7875b66a-ada7-4a9a-a8cc-029f8822492f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:31.430145 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7875b66a-ada7-4a9a-a8cc-029f8822492f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:31.430603 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7875b66a-ada7-4a9a-a8cc-029f8822492f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:31.496758 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7875b66a-ada7-4a9a-a8cc-029f8822492f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:31.505342 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7875b66a-ada7-4a9a-a8cc-029f8822492f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:31.506865 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7875b66a-ada7-4a9a-a8cc-029f8822492f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:31.508010 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7875b66a-ada7-4a9a-a8cc-029f8822492f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.090962 Jul 26 07:42:31.508569 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 674/1397] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:31 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:32.155328 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-39a18f9b-75de-4727-ab41-f60019a99108 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:32.156236 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-39a18f9b-75de-4727-ab41-f60019a99108 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:32.166745 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-39a18f9b-75de-4727-ab41-f60019a99108 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:32.167476 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-39a18f9b-75de-4727-ab41-f60019a99108 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:32.168631 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-39a18f9b-75de-4727-ab41-f60019a99108 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:32.169328 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-39a18f9b-75de-4727-ab41-f60019a99108 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:32.316472 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-39a18f9b-75de-4727-ab41-f60019a99108 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:32.328251 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-39a18f9b-75de-4727-ab41-f60019a99108 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.179214 Jul 26 07:42:32.328825 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 724/1398] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:32 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:32.533306 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b863b328-1b78-4c62-b652-5fea292b3843 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:32.534016 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-b863b328-1b78-4c62-b652-5fea292b3843 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:32.541524 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b863b328-1b78-4c62-b652-5fea292b3843 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:32.542092 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b863b328-1b78-4c62-b652-5fea292b3843 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:32.542975 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b863b328-1b78-4c62-b652-5fea292b3843 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:32.543476 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b863b328-1b78-4c62-b652-5fea292b3843 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:32.854995 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-b863b328-1b78-4c62-b652-5fea292b3843 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:32.864949 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-b863b328-1b78-4c62-b652-5fea292b3843 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:32.866483 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-b863b328-1b78-4c62-b652-5fea292b3843 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:32.867619 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b863b328-1b78-4c62-b652-5fea292b3843 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.339569 Jul 26 07:42:32.868143 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 675/1399] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:32 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:33.352629 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8544800f-83ec-4f69-b9ec-d0eb4e2ec76d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:33.353469 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8544800f-83ec-4f69-b9ec-d0eb4e2ec76d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:33.363156 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8544800f-83ec-4f69-b9ec-d0eb4e2ec76d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:33.363801 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8544800f-83ec-4f69-b9ec-d0eb4e2ec76d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:33.364881 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8544800f-83ec-4f69-b9ec-d0eb4e2ec76d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:33.365514 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8544800f-83ec-4f69-b9ec-d0eb4e2ec76d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:33.501781 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8544800f-83ec-4f69-b9ec-d0eb4e2ec76d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:33.510060 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8544800f-83ec-4f69-b9ec-d0eb4e2ec76d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.163144 Jul 26 07:42:33.510638 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 725/1400] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:33 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:33.892057 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-69054f78-56c2-4cc7-97ec-b3ab93b8edaa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:33.892664 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-69054f78-56c2-4cc7-97ec-b3ab93b8edaa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:33.899745 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-69054f78-56c2-4cc7-97ec-b3ab93b8edaa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:33.900200 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-69054f78-56c2-4cc7-97ec-b3ab93b8edaa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:33.900971 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-69054f78-56c2-4cc7-97ec-b3ab93b8edaa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:33.901406 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-69054f78-56c2-4cc7-97ec-b3ab93b8edaa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:33.976254 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-69054f78-56c2-4cc7-97ec-b3ab93b8edaa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:33.989949 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-69054f78-56c2-4cc7-97ec-b3ab93b8edaa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:33.992450 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-69054f78-56c2-4cc7-97ec-b3ab93b8edaa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:33.994293 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-69054f78-56c2-4cc7-97ec-b3ab93b8edaa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.106706 Jul 26 07:42:33.995091 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 676/1401] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:33 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:34.533058 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9881cc52-247f-441c-909c-1e92e95108f7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:34.533650 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-9881cc52-247f-441c-909c-1e92e95108f7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:34.540680 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9881cc52-247f-441c-909c-1e92e95108f7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:34.541133 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9881cc52-247f-441c-909c-1e92e95108f7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:34.541945 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9881cc52-247f-441c-909c-1e92e95108f7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:34.542378 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9881cc52-247f-441c-909c-1e92e95108f7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:34.688676 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-9881cc52-247f-441c-909c-1e92e95108f7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:34.696984 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-9881cc52-247f-441c-909c-1e92e95108f7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.168395 Jul 26 07:42:34.697519 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 726/1402] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:34 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:35.018982 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d613bde6-fc2e-41fa-8f75-750c592a7410 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:35.019628 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d613bde6-fc2e-41fa-8f75-750c592a7410 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:35.026589 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d613bde6-fc2e-41fa-8f75-750c592a7410 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:35.027025 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d613bde6-fc2e-41fa-8f75-750c592a7410 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:35.027780 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d613bde6-fc2e-41fa-8f75-750c592a7410 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:35.028208 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d613bde6-fc2e-41fa-8f75-750c592a7410 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:35.093985 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d613bde6-fc2e-41fa-8f75-750c592a7410 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:35.102975 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d613bde6-fc2e-41fa-8f75-750c592a7410 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:35.104578 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d613bde6-fc2e-41fa-8f75-750c592a7410 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:35.105791 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d613bde6-fc2e-41fa-8f75-750c592a7410 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.090889 Jul 26 07:42:35.106378 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 677/1403] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:35 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:35.719417 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-01e1e43a-72fe-4e63-a288-76778615bcba tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:35.719998 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-01e1e43a-72fe-4e63-a288-76778615bcba tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:35.727133 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-01e1e43a-72fe-4e63-a288-76778615bcba tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:35.727582 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-01e1e43a-72fe-4e63-a288-76778615bcba tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:35.728348 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-01e1e43a-72fe-4e63-a288-76778615bcba tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:35.728785 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-01e1e43a-72fe-4e63-a288-76778615bcba tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:35.867422 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-01e1e43a-72fe-4e63-a288-76778615bcba tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:35.875468 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-01e1e43a-72fe-4e63-a288-76778615bcba tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.160187 Jul 26 07:42:35.876122 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 727/1404] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:35 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:36.131278 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a7587e92-b296-49ca-be3d-a9324b86c951 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:36.131909 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a7587e92-b296-49ca-be3d-a9324b86c951 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:36.139983 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a7587e92-b296-49ca-be3d-a9324b86c951 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:36.140435 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a7587e92-b296-49ca-be3d-a9324b86c951 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:36.141439 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a7587e92-b296-49ca-be3d-a9324b86c951 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:36.142084 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a7587e92-b296-49ca-be3d-a9324b86c951 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:36.209917 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a7587e92-b296-49ca-be3d-a9324b86c951 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:36.218841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a7587e92-b296-49ca-be3d-a9324b86c951 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:36.220319 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a7587e92-b296-49ca-be3d-a9324b86c951 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:36.221431 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a7587e92-b296-49ca-be3d-a9324b86c951 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.095803 Jul 26 07:42:36.222042 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 678/1405] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:36 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:36.898845 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-362e4f00-a06a-4dcb-b9a6-51f9f7c9a4f5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:36.899636 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-362e4f00-a06a-4dcb-b9a6-51f9f7c9a4f5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:36.908833 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-362e4f00-a06a-4dcb-b9a6-51f9f7c9a4f5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:36.909286 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-362e4f00-a06a-4dcb-b9a6-51f9f7c9a4f5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:36.910106 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-362e4f00-a06a-4dcb-b9a6-51f9f7c9a4f5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:36.910578 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-362e4f00-a06a-4dcb-b9a6-51f9f7c9a4f5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:37.051034 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-362e4f00-a06a-4dcb-b9a6-51f9f7c9a4f5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:37.063074 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-362e4f00-a06a-4dcb-b9a6-51f9f7c9a4f5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.169345 Jul 26 07:42:37.063763 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 728/1406] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:36 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:37.244710 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-fc274b8f-d07e-4013-950b-1d4970042b12 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:37.245288 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-fc274b8f-d07e-4013-950b-1d4970042b12 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:37.252150 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fc274b8f-d07e-4013-950b-1d4970042b12 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:37.252592 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fc274b8f-d07e-4013-950b-1d4970042b12 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:37.253916 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fc274b8f-d07e-4013-950b-1d4970042b12 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:37.254545 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fc274b8f-d07e-4013-950b-1d4970042b12 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:37.321858 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-fc274b8f-d07e-4013-950b-1d4970042b12 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:37.331215 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-fc274b8f-d07e-4013-950b-1d4970042b12 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:37.332723 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-fc274b8f-d07e-4013-950b-1d4970042b12 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:37.333898 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-fc274b8f-d07e-4013-950b-1d4970042b12 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.093243 Jul 26 07:42:37.334449 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 679/1407] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:37 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:38.090051 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-1c473171-fca3-4b37-b02d-d40a32359c2d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:38.090645 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-1c473171-fca3-4b37-b02d-d40a32359c2d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:38.097778 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1c473171-fca3-4b37-b02d-d40a32359c2d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:38.098237 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1c473171-fca3-4b37-b02d-d40a32359c2d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:38.098988 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1c473171-fca3-4b37-b02d-d40a32359c2d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:38.099420 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1c473171-fca3-4b37-b02d-d40a32359c2d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:38.242510 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-1c473171-fca3-4b37-b02d-d40a32359c2d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:38.250531 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-1c473171-fca3-4b37-b02d-d40a32359c2d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.164461 Jul 26 07:42:38.251093 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 729/1408] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:38 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:38.356891 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-eaf2f4e0-2424-4dee-a442-d795a27cb809 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:38.357468 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-eaf2f4e0-2424-4dee-a442-d795a27cb809 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:38.364632 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-eaf2f4e0-2424-4dee-a442-d795a27cb809 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:38.365103 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-eaf2f4e0-2424-4dee-a442-d795a27cb809 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:38.365887 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-eaf2f4e0-2424-4dee-a442-d795a27cb809 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:38.366310 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-eaf2f4e0-2424-4dee-a442-d795a27cb809 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:38.429102 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-eaf2f4e0-2424-4dee-a442-d795a27cb809 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:38.438197 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-eaf2f4e0-2424-4dee-a442-d795a27cb809 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:38.439689 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-eaf2f4e0-2424-4dee-a442-d795a27cb809 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:38.440841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-eaf2f4e0-2424-4dee-a442-d795a27cb809 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.088021 Jul 26 07:42:38.441391 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 680/1409] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:38 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:39.274358 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-570175bc-0870-453c-a8cd-330abce636df tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:39.274969 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-570175bc-0870-453c-a8cd-330abce636df tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:39.283834 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-570175bc-0870-453c-a8cd-330abce636df tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:39.284318 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-570175bc-0870-453c-a8cd-330abce636df tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:39.285398 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-570175bc-0870-453c-a8cd-330abce636df tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:39.286028 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-570175bc-0870-453c-a8cd-330abce636df tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:39.425907 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-570175bc-0870-453c-a8cd-330abce636df tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:39.436106 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-570175bc-0870-453c-a8cd-330abce636df tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.167593 Jul 26 07:42:39.436676 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 730/1410] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:39 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:39.464459 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-fd03c000-d49b-479b-a684-9d6546024119 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:39.465072 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-fd03c000-d49b-479b-a684-9d6546024119 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:39.472057 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fd03c000-d49b-479b-a684-9d6546024119 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:39.472515 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fd03c000-d49b-479b-a684-9d6546024119 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:39.473295 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fd03c000-d49b-479b-a684-9d6546024119 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:39.473726 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fd03c000-d49b-479b-a684-9d6546024119 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:39.536704 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-fd03c000-d49b-479b-a684-9d6546024119 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:39.552674 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-fd03c000-d49b-479b-a684-9d6546024119 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:39.554970 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-fd03c000-d49b-479b-a684-9d6546024119 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:39.556376 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-fd03c000-d49b-479b-a684-9d6546024119 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.095939 Jul 26 07:42:39.557433 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 681/1411] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:39 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:40.459487 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-63a7baae-5158-44fb-828a-63ee1d90b23c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:40.460064 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-63a7baae-5158-44fb-828a-63ee1d90b23c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:40.470019 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-63a7baae-5158-44fb-828a-63ee1d90b23c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:40.470610 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-63a7baae-5158-44fb-828a-63ee1d90b23c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:40.471370 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-63a7baae-5158-44fb-828a-63ee1d90b23c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:40.471797 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-63a7baae-5158-44fb-828a-63ee1d90b23c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:40.581303 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f0a6a151-90da-4c5e-88b9-996786555080 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:40.581925 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-f0a6a151-90da-4c5e-88b9-996786555080 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:40.589023 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f0a6a151-90da-4c5e-88b9-996786555080 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:40.589556 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f0a6a151-90da-4c5e-88b9-996786555080 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:40.590348 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f0a6a151-90da-4c5e-88b9-996786555080 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:40.590812 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f0a6a151-90da-4c5e-88b9-996786555080 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:40.615239 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-63a7baae-5158-44fb-828a-63ee1d90b23c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:40.623662 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-63a7baae-5158-44fb-828a-63ee1d90b23c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.170543 Jul 26 07:42:40.624241 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 731/1412] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:40 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:40.653717 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-f0a6a151-90da-4c5e-88b9-996786555080 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:40.664500 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-f0a6a151-90da-4c5e-88b9-996786555080 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:40.666717 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-f0a6a151-90da-4c5e-88b9-996786555080 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:40.668397 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f0a6a151-90da-4c5e-88b9-996786555080 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.091334 Jul 26 07:42:40.668996 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 682/1413] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:40 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:41.645779 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-da8fb01d-ed99-4de6-91e3-a0810352f85b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:41.646401 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-da8fb01d-ed99-4de6-91e3-a0810352f85b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:41.653453 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-da8fb01d-ed99-4de6-91e3-a0810352f85b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:41.653929 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-da8fb01d-ed99-4de6-91e3-a0810352f85b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:41.654696 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-da8fb01d-ed99-4de6-91e3-a0810352f85b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:41.655122 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-da8fb01d-ed99-4de6-91e3-a0810352f85b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:41.691317 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-3fc466fb-caf8-48ee-8c23-bbb6baf79474 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:41.691916 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-3fc466fb-caf8-48ee-8c23-bbb6baf79474 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:41.698961 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3fc466fb-caf8-48ee-8c23-bbb6baf79474 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:41.699355 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3fc466fb-caf8-48ee-8c23-bbb6baf79474 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:41.700119 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3fc466fb-caf8-48ee-8c23-bbb6baf79474 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:41.700547 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3fc466fb-caf8-48ee-8c23-bbb6baf79474 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:41.768845 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-3fc466fb-caf8-48ee-8c23-bbb6baf79474 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:41.777890 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-3fc466fb-caf8-48ee-8c23-bbb6baf79474 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:41.779379 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-3fc466fb-caf8-48ee-8c23-bbb6baf79474 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:41.780538 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-3fc466fb-caf8-48ee-8c23-bbb6baf79474 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.093198 Jul 26 07:42:41.781083 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 683/1414] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:41 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:41.789694 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-da8fb01d-ed99-4de6-91e3-a0810352f85b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:41.798061 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-da8fb01d-ed99-4de6-91e3-a0810352f85b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.156677 Jul 26 07:42:41.798708 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 732/1415] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:41 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:42.805217 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9cde07d9-7789-4337-acb5-b01832a03706 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:42.805868 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-9cde07d9-7789-4337-acb5-b01832a03706 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:42.813066 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9cde07d9-7789-4337-acb5-b01832a03706 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:42.813515 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9cde07d9-7789-4337-acb5-b01832a03706 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:42.814544 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9cde07d9-7789-4337-acb5-b01832a03706 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:42.814947 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9cde07d9-7789-4337-acb5-b01832a03706 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:42.819664 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f4c73f7a-fcd1-4a27-8b75-67979603e375 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:42.820285 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f4c73f7a-fcd1-4a27-8b75-67979603e375 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:42.828840 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f4c73f7a-fcd1-4a27-8b75-67979603e375 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:42.829273 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f4c73f7a-fcd1-4a27-8b75-67979603e375 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:42.830098 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f4c73f7a-fcd1-4a27-8b75-67979603e375 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:42.831179 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f4c73f7a-fcd1-4a27-8b75-67979603e375 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:42.881261 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-9cde07d9-7789-4337-acb5-b01832a03706 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:42.890113 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-9cde07d9-7789-4337-acb5-b01832a03706 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:42.891606 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-9cde07d9-7789-4337-acb5-b01832a03706 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:42.892754 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-9cde07d9-7789-4337-acb5-b01832a03706 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.091798 Jul 26 07:42:42.893301 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 684/1416] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:42 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:42.969154 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f4c73f7a-fcd1-4a27-8b75-67979603e375 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:42.981152 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f4c73f7a-fcd1-4a27-8b75-67979603e375 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.165151 Jul 26 07:42:42.981907 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 733/1417] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:42 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:43.919497 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-93a72f80-1ac2-4f8a-89f9-23e06c70b31a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:43.920268 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-93a72f80-1ac2-4f8a-89f9-23e06c70b31a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:43.928391 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-93a72f80-1ac2-4f8a-89f9-23e06c70b31a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:43.928829 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-93a72f80-1ac2-4f8a-89f9-23e06c70b31a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:43.929598 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-93a72f80-1ac2-4f8a-89f9-23e06c70b31a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:43.930055 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-93a72f80-1ac2-4f8a-89f9-23e06c70b31a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:43.947833 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:43.993196 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-93a72f80-1ac2-4f8a-89f9-23e06c70b31a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:44.003063 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3458cee4-1dfd-4764-ac0f-5ab97e379b90 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:44.003632 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-93a72f80-1ac2-4f8a-89f9-23e06c70b31a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:44.003757 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3458cee4-1dfd-4764-ac0f-5ab97e379b90 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:44.004563 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-93a72f80-1ac2-4f8a-89f9-23e06c70b31a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:44.005719 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-93a72f80-1ac2-4f8a-89f9-23e06c70b31a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.092916 Jul 26 07:42:44.006308 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 685/1418] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:43 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:44.010539 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3458cee4-1dfd-4764-ac0f-5ab97e379b90 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:44.011005 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3458cee4-1dfd-4764-ac0f-5ab97e379b90 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:44.011833 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3458cee4-1dfd-4764-ac0f-5ab97e379b90 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:44.012275 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3458cee4-1dfd-4764-ac0f-5ab97e379b90 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:44.153148 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3458cee4-1dfd-4764-ac0f-5ab97e379b90 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:44.161269 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3458cee4-1dfd-4764-ac0f-5ab97e379b90 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.162119 Jul 26 07:42:44.161851 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 734/1419] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:43 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:45.028191 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9f56876a-44cb-45e2-9fae-2d8f30b1022e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:45.028800 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-9f56876a-44cb-45e2-9fae-2d8f30b1022e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:45.036062 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9f56876a-44cb-45e2-9fae-2d8f30b1022e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:45.036511 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9f56876a-44cb-45e2-9fae-2d8f30b1022e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:45.037271 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9f56876a-44cb-45e2-9fae-2d8f30b1022e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:45.037703 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9f56876a-44cb-45e2-9fae-2d8f30b1022e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:45.105366 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-9f56876a-44cb-45e2-9fae-2d8f30b1022e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:45.114370 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-9f56876a-44cb-45e2-9fae-2d8f30b1022e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:45.115822 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-9f56876a-44cb-45e2-9fae-2d8f30b1022e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:45.116965 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-9f56876a-44cb-45e2-9fae-2d8f30b1022e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.092809 Jul 26 07:42:45.117564 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 686/1420] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:45 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:45.185243 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f837ded2-2105-4963-bf02-c4051d1be153 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:45.186105 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f837ded2-2105-4963-bf02-c4051d1be153 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:45.195622 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f837ded2-2105-4963-bf02-c4051d1be153 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:45.196263 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f837ded2-2105-4963-bf02-c4051d1be153 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:45.197343 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f837ded2-2105-4963-bf02-c4051d1be153 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:45.197998 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f837ded2-2105-4963-bf02-c4051d1be153 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:45.346886 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f837ded2-2105-4963-bf02-c4051d1be153 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:45.355452 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f837ded2-2105-4963-bf02-c4051d1be153 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.175843 Jul 26 07:42:45.356059 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 735/1421] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:45 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:46.141260 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-13f790a1-15fa-420e-b5e6-7c27723fd359 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:46.141909 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-13f790a1-15fa-420e-b5e6-7c27723fd359 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:46.149188 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-13f790a1-15fa-420e-b5e6-7c27723fd359 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:46.149636 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-13f790a1-15fa-420e-b5e6-7c27723fd359 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:46.150407 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-13f790a1-15fa-420e-b5e6-7c27723fd359 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:46.150838 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-13f790a1-15fa-420e-b5e6-7c27723fd359 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:46.214830 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-13f790a1-15fa-420e-b5e6-7c27723fd359 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:46.224108 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-13f790a1-15fa-420e-b5e6-7c27723fd359 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:46.225774 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-13f790a1-15fa-420e-b5e6-7c27723fd359 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:46.226923 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-13f790a1-15fa-420e-b5e6-7c27723fd359 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.091145 Jul 26 07:42:46.227488 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 687/1422] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:46 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:46.377096 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-662f725c-ac26-40e4-a1c3-f351685acce5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:46.377731 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-662f725c-ac26-40e4-a1c3-f351685acce5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:46.384747 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-662f725c-ac26-40e4-a1c3-f351685acce5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:46.385194 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-662f725c-ac26-40e4-a1c3-f351685acce5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:46.385997 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-662f725c-ac26-40e4-a1c3-f351685acce5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:46.386431 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-662f725c-ac26-40e4-a1c3-f351685acce5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:46.526826 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-662f725c-ac26-40e4-a1c3-f351685acce5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:46.530318 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:46.535988 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-662f725c-ac26-40e4-a1c3-f351685acce5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.162947 Jul 26 07:42:46.536562 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 736/1423] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:46 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:47.252884 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6eda1655-2a6a-45ab-abb7-2ce69ba37b94 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:47.253638 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6eda1655-2a6a-45ab-abb7-2ce69ba37b94 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:47.261612 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6eda1655-2a6a-45ab-abb7-2ce69ba37b94 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:47.262088 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6eda1655-2a6a-45ab-abb7-2ce69ba37b94 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:47.262846 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6eda1655-2a6a-45ab-abb7-2ce69ba37b94 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:47.263266 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6eda1655-2a6a-45ab-abb7-2ce69ba37b94 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:47.326029 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6eda1655-2a6a-45ab-abb7-2ce69ba37b94 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:47.335121 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6eda1655-2a6a-45ab-abb7-2ce69ba37b94 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:47.336597 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6eda1655-2a6a-45ab-abb7-2ce69ba37b94 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:47.337775 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6eda1655-2a6a-45ab-abb7-2ce69ba37b94 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.090530 Jul 26 07:42:47.338336 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 688/1424] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:47 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:47.560191 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-406033d5-ae39-417f-b976-83e8856d29f2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:47.560852 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-406033d5-ae39-417f-b976-83e8856d29f2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:47.569990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-406033d5-ae39-417f-b976-83e8856d29f2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:47.570607 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-406033d5-ae39-417f-b976-83e8856d29f2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:47.571806 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-406033d5-ae39-417f-b976-83e8856d29f2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:47.572437 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-406033d5-ae39-417f-b976-83e8856d29f2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:47.711680 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-406033d5-ae39-417f-b976-83e8856d29f2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:47.721705 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-406033d5-ae39-417f-b976-83e8856d29f2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.167141 Jul 26 07:42:47.722677 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 737/1425] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:47 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:48.361223 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d476419d-b8a2-4cf2-8305-7549c4229b2a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:48.362018 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d476419d-b8a2-4cf2-8305-7549c4229b2a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:48.368889 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d476419d-b8a2-4cf2-8305-7549c4229b2a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:48.369330 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d476419d-b8a2-4cf2-8305-7549c4229b2a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:48.370085 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d476419d-b8a2-4cf2-8305-7549c4229b2a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:48.370541 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d476419d-b8a2-4cf2-8305-7549c4229b2a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:48.435769 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d476419d-b8a2-4cf2-8305-7549c4229b2a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:48.444553 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d476419d-b8a2-4cf2-8305-7549c4229b2a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:48.446051 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d476419d-b8a2-4cf2-8305-7549c4229b2a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:48.447198 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d476419d-b8a2-4cf2-8305-7549c4229b2a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.090013 Jul 26 07:42:48.447747 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 689/1426] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:48 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:48.752675 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d5a703d0-e135-4634-909b-6444fc2f63f4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:48.753412 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d5a703d0-e135-4634-909b-6444fc2f63f4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:48.760696 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d5a703d0-e135-4634-909b-6444fc2f63f4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:48.761147 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d5a703d0-e135-4634-909b-6444fc2f63f4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:48.761958 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d5a703d0-e135-4634-909b-6444fc2f63f4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:48.762396 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d5a703d0-e135-4634-909b-6444fc2f63f4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:48.892427 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d5a703d0-e135-4634-909b-6444fc2f63f4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:48.904389 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d5a703d0-e135-4634-909b-6444fc2f63f4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.157910 Jul 26 07:42:48.905168 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 738/1427] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:48 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:49.470454 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b7fa6bb5-f2f0-4451-af6a-e8146d37bfbd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:49.471026 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-b7fa6bb5-f2f0-4451-af6a-e8146d37bfbd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:49.478126 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b7fa6bb5-f2f0-4451-af6a-e8146d37bfbd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:49.478566 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b7fa6bb5-f2f0-4451-af6a-e8146d37bfbd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:49.479356 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b7fa6bb5-f2f0-4451-af6a-e8146d37bfbd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:49.479782 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b7fa6bb5-f2f0-4451-af6a-e8146d37bfbd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:49.553449 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-b7fa6bb5-f2f0-4451-af6a-e8146d37bfbd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:49.566671 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-b7fa6bb5-f2f0-4451-af6a-e8146d37bfbd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:49.568143 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-b7fa6bb5-f2f0-4451-af6a-e8146d37bfbd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:49.569303 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b7fa6bb5-f2f0-4451-af6a-e8146d37bfbd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.102842 Jul 26 07:42:49.569922 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 690/1428] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:49 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:49.932738 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6fd6cf9b-de4f-44b5-bf4b-b39318b08869 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:49.933513 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-6fd6cf9b-de4f-44b5-bf4b-b39318b08869 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:49.943034 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6fd6cf9b-de4f-44b5-bf4b-b39318b08869 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:49.943658 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6fd6cf9b-de4f-44b5-bf4b-b39318b08869 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:49.944699 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6fd6cf9b-de4f-44b5-bf4b-b39318b08869 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:49.945296 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6fd6cf9b-de4f-44b5-bf4b-b39318b08869 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:50.092157 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-6fd6cf9b-de4f-44b5-bf4b-b39318b08869 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:50.102492 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6fd6cf9b-de4f-44b5-bf4b-b39318b08869 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.175207 Jul 26 07:42:50.103070 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 739/1429] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:49 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:50.594063 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2a2e562f-77fd-4b59-994c-04f25bb95286 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:50.594708 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2a2e562f-77fd-4b59-994c-04f25bb95286 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:50.603214 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2a2e562f-77fd-4b59-994c-04f25bb95286 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:50.603750 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2a2e562f-77fd-4b59-994c-04f25bb95286 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:50.604679 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2a2e562f-77fd-4b59-994c-04f25bb95286 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:50.605202 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2a2e562f-77fd-4b59-994c-04f25bb95286 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:50.673413 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2a2e562f-77fd-4b59-994c-04f25bb95286 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:50.687129 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2a2e562f-77fd-4b59-994c-04f25bb95286 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:50.689552 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2a2e562f-77fd-4b59-994c-04f25bb95286 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:50.691477 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2a2e562f-77fd-4b59-994c-04f25bb95286 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.102273 Jul 26 07:42:50.692245 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 691/1430] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:50 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:51.124807 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-faee4630-1dc0-4865-9e8c-ca64d4108b3c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:51.125448 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-faee4630-1dc0-4865-9e8c-ca64d4108b3c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:51.132546 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-faee4630-1dc0-4865-9e8c-ca64d4108b3c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:51.133019 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-faee4630-1dc0-4865-9e8c-ca64d4108b3c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:51.133767 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-faee4630-1dc0-4865-9e8c-ca64d4108b3c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:51.134224 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-faee4630-1dc0-4865-9e8c-ca64d4108b3c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:51.270183 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-faee4630-1dc0-4865-9e8c-ca64d4108b3c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:51.278915 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-faee4630-1dc0-4865-9e8c-ca64d4108b3c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.158093 Jul 26 07:42:51.279489 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 740/1431] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:51 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:51.723900 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-68a2fb58-e3ac-4fa1-8574-96d2e4bfc46e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:51.725048 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-68a2fb58-e3ac-4fa1-8574-96d2e4bfc46e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:51.732140 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-68a2fb58-e3ac-4fa1-8574-96d2e4bfc46e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:51.732692 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-68a2fb58-e3ac-4fa1-8574-96d2e4bfc46e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:51.733442 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-68a2fb58-e3ac-4fa1-8574-96d2e4bfc46e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:51.733921 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-68a2fb58-e3ac-4fa1-8574-96d2e4bfc46e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:51.796174 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-68a2fb58-e3ac-4fa1-8574-96d2e4bfc46e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:51.804988 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-68a2fb58-e3ac-4fa1-8574-96d2e4bfc46e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:51.806507 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-68a2fb58-e3ac-4fa1-8574-96d2e4bfc46e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:51.807649 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-68a2fb58-e3ac-4fa1-8574-96d2e4bfc46e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.089972 Jul 26 07:42:51.808200 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 692/1432] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:51 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:52.302155 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-85d2a83a-1779-40eb-9d56-5d901e2cb10e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:52.302863 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-85d2a83a-1779-40eb-9d56-5d901e2cb10e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:52.313363 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-85d2a83a-1779-40eb-9d56-5d901e2cb10e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:52.314004 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-85d2a83a-1779-40eb-9d56-5d901e2cb10e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:52.315142 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-85d2a83a-1779-40eb-9d56-5d901e2cb10e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:52.315748 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-85d2a83a-1779-40eb-9d56-5d901e2cb10e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:52.462815 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-85d2a83a-1779-40eb-9d56-5d901e2cb10e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:52.471286 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-85d2a83a-1779-40eb-9d56-5d901e2cb10e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.173821 Jul 26 07:42:52.471852 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 741/1433] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:52 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:52.831563 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-cfe7f384-03ad-49c4-a086-b4ec15416bee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:52.832140 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-cfe7f384-03ad-49c4-a086-b4ec15416bee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:52.839115 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cfe7f384-03ad-49c4-a086-b4ec15416bee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:52.839563 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cfe7f384-03ad-49c4-a086-b4ec15416bee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:52.840321 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cfe7f384-03ad-49c4-a086-b4ec15416bee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:52.840751 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cfe7f384-03ad-49c4-a086-b4ec15416bee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:52.910423 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-cfe7f384-03ad-49c4-a086-b4ec15416bee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:52.919468 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-cfe7f384-03ad-49c4-a086-b4ec15416bee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:52.920955 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-cfe7f384-03ad-49c4-a086-b4ec15416bee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:52.922144 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-cfe7f384-03ad-49c4-a086-b4ec15416bee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.095039 Jul 26 07:42:52.922673 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 693/1434] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:52 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:53.493101 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-51b37cf6-4076-4c57-980e-e5f0eb75c05f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:53.493652 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-51b37cf6-4076-4c57-980e-e5f0eb75c05f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:53.500583 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-51b37cf6-4076-4c57-980e-e5f0eb75c05f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:53.501023 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-51b37cf6-4076-4c57-980e-e5f0eb75c05f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:53.501770 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-51b37cf6-4076-4c57-980e-e5f0eb75c05f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:53.502235 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-51b37cf6-4076-4c57-980e-e5f0eb75c05f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:53.635748 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-51b37cf6-4076-4c57-980e-e5f0eb75c05f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:53.643939 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-51b37cf6-4076-4c57-980e-e5f0eb75c05f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.154912 Jul 26 07:42:53.644508 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 742/1435] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:53 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:53.952594 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0d7493f9-4736-4548-b32a-27aa381c7648 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:53.953453 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0d7493f9-4736-4548-b32a-27aa381c7648 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:53.956810 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=54 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:53.964058 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0d7493f9-4736-4548-b32a-27aa381c7648 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:53.964608 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0d7493f9-4736-4548-b32a-27aa381c7648 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:53.965586 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0d7493f9-4736-4548-b32a-27aa381c7648 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:53.966214 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0d7493f9-4736-4548-b32a-27aa381c7648 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:54.033600 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0d7493f9-4736-4548-b32a-27aa381c7648 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:54.042429 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0d7493f9-4736-4548-b32a-27aa381c7648 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:54.043900 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0d7493f9-4736-4548-b32a-27aa381c7648 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:54.045044 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0d7493f9-4736-4548-b32a-27aa381c7648 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.102219 Jul 26 07:42:54.045600 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 694/1436] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:53 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:54.665053 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3ebae86e-aafd-46a1-8aff-900ed7df6fab tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:54.665697 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3ebae86e-aafd-46a1-8aff-900ed7df6fab tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:54.667802 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=52 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:54.673619 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3ebae86e-aafd-46a1-8aff-900ed7df6fab tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:54.674104 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3ebae86e-aafd-46a1-8aff-900ed7df6fab tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:54.674867 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3ebae86e-aafd-46a1-8aff-900ed7df6fab tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:54.675301 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3ebae86e-aafd-46a1-8aff-900ed7df6fab tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:54.809170 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3ebae86e-aafd-46a1-8aff-900ed7df6fab tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:54.819686 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3ebae86e-aafd-46a1-8aff-900ed7df6fab tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.158657 Jul 26 07:42:54.820346 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 743/1437] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:54 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:55.071696 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-86c8f1d6-56b2-4728-949e-91a7d27f1c51 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:55.072303 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-86c8f1d6-56b2-4728-949e-91a7d27f1c51 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:55.079854 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-86c8f1d6-56b2-4728-949e-91a7d27f1c51 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:55.080717 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-86c8f1d6-56b2-4728-949e-91a7d27f1c51 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:55.081536 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-86c8f1d6-56b2-4728-949e-91a7d27f1c51 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:55.082022 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-86c8f1d6-56b2-4728-949e-91a7d27f1c51 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:55.145913 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-86c8f1d6-56b2-4728-949e-91a7d27f1c51 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:55.154980 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-86c8f1d6-56b2-4728-949e-91a7d27f1c51 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:55.156451 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-86c8f1d6-56b2-4728-949e-91a7d27f1c51 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:55.157597 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-86c8f1d6-56b2-4728-949e-91a7d27f1c51 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.090448 Jul 26 07:42:55.158182 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 695/1438] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:55 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:55.843507 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7790fcaa-eee3-4885-b574-d8e698503c8f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:55.844236 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7790fcaa-eee3-4885-b574-d8e698503c8f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:55.852465 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7790fcaa-eee3-4885-b574-d8e698503c8f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:55.852997 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7790fcaa-eee3-4885-b574-d8e698503c8f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:55.853932 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7790fcaa-eee3-4885-b574-d8e698503c8f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:55.854436 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7790fcaa-eee3-4885-b574-d8e698503c8f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:55.993603 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7790fcaa-eee3-4885-b574-d8e698503c8f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:56.006960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7790fcaa-eee3-4885-b574-d8e698503c8f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.167716 Jul 26 07:42:56.007517 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 744/1439] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:55 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:56.183986 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-40a45900-f40b-404e-a10b-09c385cc132c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:56.184870 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-40a45900-f40b-404e-a10b-09c385cc132c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:56.194458 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-40a45900-f40b-404e-a10b-09c385cc132c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:56.194856 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-40a45900-f40b-404e-a10b-09c385cc132c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:56.195617 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-40a45900-f40b-404e-a10b-09c385cc132c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:56.196017 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-40a45900-f40b-404e-a10b-09c385cc132c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:56.268850 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-40a45900-f40b-404e-a10b-09c385cc132c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:56.277420 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-40a45900-f40b-404e-a10b-09c385cc132c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:56.278925 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-40a45900-f40b-404e-a10b-09c385cc132c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:56.280259 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-40a45900-f40b-404e-a10b-09c385cc132c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.102847 Jul 26 07:42:56.280817 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 696/1440] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:56 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:57.035930 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-19812413-b138-4f91-859b-ef27b19216ba tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:57.036658 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-19812413-b138-4f91-859b-ef27b19216ba tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:57.043912 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-19812413-b138-4f91-859b-ef27b19216ba tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:57.044364 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-19812413-b138-4f91-859b-ef27b19216ba tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:57.045144 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-19812413-b138-4f91-859b-ef27b19216ba tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:57.045583 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-19812413-b138-4f91-859b-ef27b19216ba tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:57.178314 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-19812413-b138-4f91-859b-ef27b19216ba tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:57.188865 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-19812413-b138-4f91-859b-ef27b19216ba tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.157082 Jul 26 07:42:57.189504 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 745/1441] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:57 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:57.303285 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8cb84073-5a2e-4375-b197-2b504f522e57 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:57.303941 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8cb84073-5a2e-4375-b197-2b504f522e57 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:57.310869 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8cb84073-5a2e-4375-b197-2b504f522e57 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:57.311312 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8cb84073-5a2e-4375-b197-2b504f522e57 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:57.312054 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8cb84073-5a2e-4375-b197-2b504f522e57 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:57.312510 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8cb84073-5a2e-4375-b197-2b504f522e57 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:57.375766 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8cb84073-5a2e-4375-b197-2b504f522e57 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:57.384480 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8cb84073-5a2e-4375-b197-2b504f522e57 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:57.386002 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8cb84073-5a2e-4375-b197-2b504f522e57 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:57.387163 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8cb84073-5a2e-4375-b197-2b504f522e57 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.087927 Jul 26 07:42:57.387715 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 697/1442] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:57 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:58.212567 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b21fa18d-99b4-4a35-8e7b-c5e951add7b2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:58.213181 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b21fa18d-99b4-4a35-8e7b-c5e951add7b2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:58.222764 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b21fa18d-99b4-4a35-8e7b-c5e951add7b2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:58.223586 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b21fa18d-99b4-4a35-8e7b-c5e951add7b2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:58.224367 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b21fa18d-99b4-4a35-8e7b-c5e951add7b2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:58.224806 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b21fa18d-99b4-4a35-8e7b-c5e951add7b2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:58.361993 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-b21fa18d-99b4-4a35-8e7b-c5e951add7b2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:58.370253 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b21fa18d-99b4-4a35-8e7b-c5e951add7b2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.163665 Jul 26 07:42:58.370832 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 746/1443] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:58 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:58.410248 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-47e9c6c8-af7b-41cc-bdd5-1003807a9b4e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:58.410794 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-47e9c6c8-af7b-41cc-bdd5-1003807a9b4e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:58.417510 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-47e9c6c8-af7b-41cc-bdd5-1003807a9b4e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:58.418012 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-47e9c6c8-af7b-41cc-bdd5-1003807a9b4e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:58.418775 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-47e9c6c8-af7b-41cc-bdd5-1003807a9b4e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:58.419212 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-47e9c6c8-af7b-41cc-bdd5-1003807a9b4e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:58.484565 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-47e9c6c8-af7b-41cc-bdd5-1003807a9b4e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:58.493547 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-47e9c6c8-af7b-41cc-bdd5-1003807a9b4e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:58.495086 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-47e9c6c8-af7b-41cc-bdd5-1003807a9b4e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:58.496379 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-47e9c6c8-af7b-41cc-bdd5-1003807a9b4e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.090293 Jul 26 07:42:58.496958 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 698/1444] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:58 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:42:59.394759 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7a395a3b-074a-4f38-b789-432342aaf270 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:59.395382 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7a395a3b-074a-4f38-b789-432342aaf270 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:59.404963 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7a395a3b-074a-4f38-b789-432342aaf270 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:59.405401 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7a395a3b-074a-4f38-b789-432342aaf270 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:59.406198 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7a395a3b-074a-4f38-b789-432342aaf270 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:59.406623 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7a395a3b-074a-4f38-b789-432342aaf270 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:59.518672 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-14cb8834-520c-4369-9916-f0905cabf02f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:42:59.519290 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-14cb8834-520c-4369-9916-f0905cabf02f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:42:59.526256 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-14cb8834-520c-4369-9916-f0905cabf02f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:59.526704 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-14cb8834-520c-4369-9916-f0905cabf02f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:59.527466 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-14cb8834-520c-4369-9916-f0905cabf02f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:42:59.527893 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-14cb8834-520c-4369-9916-f0905cabf02f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:42:59.539490 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7a395a3b-074a-4f38-b789-432342aaf270 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:59.547803 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7a395a3b-074a-4f38-b789-432342aaf270 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.158962 Jul 26 07:42:59.548353 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 747/1445] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:42:59 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:42:59.590121 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-14cb8834-520c-4369-9916-f0905cabf02f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:59.598905 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-14cb8834-520c-4369-9916-f0905cabf02f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:59.600391 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-14cb8834-520c-4369-9916-f0905cabf02f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:42:59.601533 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-14cb8834-520c-4369-9916-f0905cabf02f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.086906 Jul 26 07:42:59.602165 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 699/1446] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:42:59 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:00.571509 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f23f3610-56cd-49d1-8b05-712e7e723ceb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:00.572219 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f23f3610-56cd-49d1-8b05-712e7e723ceb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:00.581206 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f23f3610-56cd-49d1-8b05-712e7e723ceb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:00.581653 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f23f3610-56cd-49d1-8b05-712e7e723ceb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:00.582462 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f23f3610-56cd-49d1-8b05-712e7e723ceb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:00.582898 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f23f3610-56cd-49d1-8b05-712e7e723ceb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:00.624468 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9fb1ea60-490f-4f1f-b871-01a8acf1022f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:00.625240 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-9fb1ea60-490f-4f1f-b871-01a8acf1022f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:00.632327 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9fb1ea60-490f-4f1f-b871-01a8acf1022f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:00.632773 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9fb1ea60-490f-4f1f-b871-01a8acf1022f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:00.633546 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9fb1ea60-490f-4f1f-b871-01a8acf1022f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:00.634044 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9fb1ea60-490f-4f1f-b871-01a8acf1022f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:00.696342 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-9fb1ea60-490f-4f1f-b871-01a8acf1022f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:00.705799 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-9fb1ea60-490f-4f1f-b871-01a8acf1022f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:00.707323 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-9fb1ea60-490f-4f1f-b871-01a8acf1022f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:00.708483 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-9fb1ea60-490f-4f1f-b871-01a8acf1022f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.088063 Jul 26 07:43:00.709002 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 700/1447] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:00 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:00.720205 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f23f3610-56cd-49d1-8b05-712e7e723ceb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:00.728329 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f23f3610-56cd-49d1-8b05-712e7e723ceb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.162692 Jul 26 07:43:00.728863 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 748/1448] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:00 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:01.733510 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d98d0006-0a89-4020-8666-5a8057835531 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:01.734109 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d98d0006-0a89-4020-8666-5a8057835531 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:01.740930 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d98d0006-0a89-4020-8666-5a8057835531 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:01.741370 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d98d0006-0a89-4020-8666-5a8057835531 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:01.742163 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d98d0006-0a89-4020-8666-5a8057835531 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:01.742587 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d98d0006-0a89-4020-8666-5a8057835531 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:01.748492 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-eeaa5196-4dbd-453e-94a5-58c0898272f3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:01.749093 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-eeaa5196-4dbd-453e-94a5-58c0898272f3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:01.756214 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-eeaa5196-4dbd-453e-94a5-58c0898272f3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:01.756668 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-eeaa5196-4dbd-453e-94a5-58c0898272f3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:01.757476 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-eeaa5196-4dbd-453e-94a5-58c0898272f3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:01.757957 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-eeaa5196-4dbd-453e-94a5-58c0898272f3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:01.804657 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d98d0006-0a89-4020-8666-5a8057835531 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:01.813330 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d98d0006-0a89-4020-8666-5a8057835531 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:01.814867 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d98d0006-0a89-4020-8666-5a8057835531 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:01.816018 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d98d0006-0a89-4020-8666-5a8057835531 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.088506 Jul 26 07:43:01.816584 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 701/1449] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:01 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:01.891031 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-eeaa5196-4dbd-453e-94a5-58c0898272f3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:01.903251 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-eeaa5196-4dbd-453e-94a5-58c0898272f3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.158414 Jul 26 07:43:01.904136 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 749/1450] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:01 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:43:02.839288 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a1c2406c-24f3-43a8-a6d3-681c493b43f3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:02.839969 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a1c2406c-24f3-43a8-a6d3-681c493b43f3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:02.847034 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a1c2406c-24f3-43a8-a6d3-681c493b43f3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:02.847490 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a1c2406c-24f3-43a8-a6d3-681c493b43f3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:02.848242 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a1c2406c-24f3-43a8-a6d3-681c493b43f3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:02.848676 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a1c2406c-24f3-43a8-a6d3-681c493b43f3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:02.852692 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:43:02.923580 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a1c2406c-24f3-43a8-a6d3-681c493b43f3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:02.929758 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-53677661-2a7d-4baa-bb83-c8096d33b1ee tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:02.930390 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-53677661-2a7d-4baa-bb83-c8096d33b1ee tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:02.932794 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a1c2406c-24f3-43a8-a6d3-681c493b43f3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:02.934318 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a1c2406c-24f3-43a8-a6d3-681c493b43f3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:02.935541 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a1c2406c-24f3-43a8-a6d3-681c493b43f3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.100204 Jul 26 07:43:02.936067 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 702/1451] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:02 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:02.937244 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-53677661-2a7d-4baa-bb83-c8096d33b1ee tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:02.937690 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-53677661-2a7d-4baa-bb83-c8096d33b1ee tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:02.938481 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-53677661-2a7d-4baa-bb83-c8096d33b1ee tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:02.938903 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-53677661-2a7d-4baa-bb83-c8096d33b1ee tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:03.084577 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-53677661-2a7d-4baa-bb83-c8096d33b1ee tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:03.093202 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-53677661-2a7d-4baa-bb83-c8096d33b1ee tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.167228 Jul 26 07:43:03.093702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 750/1452] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:02 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:03.961679 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-990d1369-0fee-4b2d-81f9-9a76687024b6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:03.962525 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-990d1369-0fee-4b2d-81f9-9a76687024b6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:03.970918 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-990d1369-0fee-4b2d-81f9-9a76687024b6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:03.971366 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-990d1369-0fee-4b2d-81f9-9a76687024b6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:03.972143 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-990d1369-0fee-4b2d-81f9-9a76687024b6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:03.972630 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-990d1369-0fee-4b2d-81f9-9a76687024b6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:04.039711 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-990d1369-0fee-4b2d-81f9-9a76687024b6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:04.050060 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-990d1369-0fee-4b2d-81f9-9a76687024b6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:04.051535 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-990d1369-0fee-4b2d-81f9-9a76687024b6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:04.052685 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-990d1369-0fee-4b2d-81f9-9a76687024b6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.097276 Jul 26 07:43:04.053206 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 703/1453] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:03 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:04.114806 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ae6d4401-ca48-41bf-b8ff-8371ce9feef0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:04.115450 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ae6d4401-ca48-41bf-b8ff-8371ce9feef0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:04.122522 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ae6d4401-ca48-41bf-b8ff-8371ce9feef0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:04.123047 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ae6d4401-ca48-41bf-b8ff-8371ce9feef0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:04.123946 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ae6d4401-ca48-41bf-b8ff-8371ce9feef0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:04.124377 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ae6d4401-ca48-41bf-b8ff-8371ce9feef0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:04.258578 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ae6d4401-ca48-41bf-b8ff-8371ce9feef0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:04.267119 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ae6d4401-ca48-41bf-b8ff-8371ce9feef0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.156254 Jul 26 07:43:04.267688 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 751/1454] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:04 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:05.078482 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d88e43f0-411d-473e-99e0-4adb05750d4f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:05.079104 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d88e43f0-411d-473e-99e0-4adb05750d4f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:05.086768 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d88e43f0-411d-473e-99e0-4adb05750d4f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:05.087214 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d88e43f0-411d-473e-99e0-4adb05750d4f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:05.087978 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d88e43f0-411d-473e-99e0-4adb05750d4f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:05.088396 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d88e43f0-411d-473e-99e0-4adb05750d4f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:05.166301 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d88e43f0-411d-473e-99e0-4adb05750d4f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:05.175503 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d88e43f0-411d-473e-99e0-4adb05750d4f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:05.176884 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d88e43f0-411d-473e-99e0-4adb05750d4f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:05.178089 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d88e43f0-411d-473e-99e0-4adb05750d4f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.104774 Jul 26 07:43:05.178636 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 704/1455] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:05 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:05.288573 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-156c61a6-eafe-4c14-95dd-4c29dd31ccd4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:05.289173 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-156c61a6-eafe-4c14-95dd-4c29dd31ccd4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:05.296335 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-156c61a6-eafe-4c14-95dd-4c29dd31ccd4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:05.296785 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-156c61a6-eafe-4c14-95dd-4c29dd31ccd4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:05.297548 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-156c61a6-eafe-4c14-95dd-4c29dd31ccd4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:05.298090 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-156c61a6-eafe-4c14-95dd-4c29dd31ccd4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:05.433888 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-156c61a6-eafe-4c14-95dd-4c29dd31ccd4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:05.442571 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-156c61a6-eafe-4c14-95dd-4c29dd31ccd4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.157963 Jul 26 07:43:05.443140 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 752/1456] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:05 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:06.203617 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-23940f5c-5f31-4a0b-a4f8-5f396bb0d004 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:06.204201 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-23940f5c-5f31-4a0b-a4f8-5f396bb0d004 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:06.214186 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-23940f5c-5f31-4a0b-a4f8-5f396bb0d004 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:06.214750 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-23940f5c-5f31-4a0b-a4f8-5f396bb0d004 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:06.215844 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-23940f5c-5f31-4a0b-a4f8-5f396bb0d004 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:06.216406 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-23940f5c-5f31-4a0b-a4f8-5f396bb0d004 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:06.283394 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-23940f5c-5f31-4a0b-a4f8-5f396bb0d004 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:06.292037 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-23940f5c-5f31-4a0b-a4f8-5f396bb0d004 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:06.293516 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-23940f5c-5f31-4a0b-a4f8-5f396bb0d004 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:06.294703 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-23940f5c-5f31-4a0b-a4f8-5f396bb0d004 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.097494 Jul 26 07:43:06.295339 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 705/1457] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:06 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:06.469351 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-357f5f09-c96e-4336-a880-3c1393c2b3d4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:06.469980 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-357f5f09-c96e-4336-a880-3c1393c2b3d4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:06.480114 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-357f5f09-c96e-4336-a880-3c1393c2b3d4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:06.480767 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-357f5f09-c96e-4336-a880-3c1393c2b3d4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:06.481916 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-357f5f09-c96e-4336-a880-3c1393c2b3d4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:06.482516 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-357f5f09-c96e-4336-a880-3c1393c2b3d4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:06.501751 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:43:06.636490 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-357f5f09-c96e-4336-a880-3c1393c2b3d4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:06.645691 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-357f5f09-c96e-4336-a880-3c1393c2b3d4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.182480 Jul 26 07:43:06.646303 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 753/1458] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:06 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:07.320656 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-342e6cc8-6a06-4ba9-82ad-2b8bcf6fb52b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:07.321371 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-342e6cc8-6a06-4ba9-82ad-2b8bcf6fb52b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:07.330699 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-342e6cc8-6a06-4ba9-82ad-2b8bcf6fb52b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:07.331149 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-342e6cc8-6a06-4ba9-82ad-2b8bcf6fb52b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:07.331914 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-342e6cc8-6a06-4ba9-82ad-2b8bcf6fb52b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:07.332342 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-342e6cc8-6a06-4ba9-82ad-2b8bcf6fb52b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:07.400770 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-342e6cc8-6a06-4ba9-82ad-2b8bcf6fb52b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:07.412822 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-342e6cc8-6a06-4ba9-82ad-2b8bcf6fb52b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:07.415108 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-342e6cc8-6a06-4ba9-82ad-2b8bcf6fb52b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:07.416849 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-342e6cc8-6a06-4ba9-82ad-2b8bcf6fb52b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.102411 Jul 26 07:43:07.417604 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 706/1459] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:07 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:07.668239 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-528d8e49-892f-4e92-94ed-6ac41cba9856 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:07.679908 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-528d8e49-892f-4e92-94ed-6ac41cba9856 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:07.679908 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-528d8e49-892f-4e92-94ed-6ac41cba9856 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:07.679908 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-528d8e49-892f-4e92-94ed-6ac41cba9856 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:07.679908 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-528d8e49-892f-4e92-94ed-6ac41cba9856 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:07.680315 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-528d8e49-892f-4e92-94ed-6ac41cba9856 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:07.814122 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-528d8e49-892f-4e92-94ed-6ac41cba9856 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:07.822570 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-528d8e49-892f-4e92-94ed-6ac41cba9856 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.158759 Jul 26 07:43:07.823118 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 754/1460] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:07 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:08.440036 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2fc1ddc8-75ef-47f9-a2e8-beaa0538fbbe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:08.440650 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2fc1ddc8-75ef-47f9-a2e8-beaa0538fbbe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:08.447597 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2fc1ddc8-75ef-47f9-a2e8-beaa0538fbbe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:08.448046 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2fc1ddc8-75ef-47f9-a2e8-beaa0538fbbe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:08.448814 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2fc1ddc8-75ef-47f9-a2e8-beaa0538fbbe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:08.449246 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2fc1ddc8-75ef-47f9-a2e8-beaa0538fbbe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:08.511923 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2fc1ddc8-75ef-47f9-a2e8-beaa0538fbbe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:08.520527 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2fc1ddc8-75ef-47f9-a2e8-beaa0538fbbe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:08.522084 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2fc1ddc8-75ef-47f9-a2e8-beaa0538fbbe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:08.523230 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2fc1ddc8-75ef-47f9-a2e8-beaa0538fbbe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.087317 Jul 26 07:43:08.523786 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 707/1461] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:08 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:08.846136 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-0c33056e-5904-4962-99e2-14d49d199e2d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:08.846758 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-0c33056e-5904-4962-99e2-14d49d199e2d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:08.853706 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0c33056e-5904-4962-99e2-14d49d199e2d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:08.854204 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0c33056e-5904-4962-99e2-14d49d199e2d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:08.854971 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0c33056e-5904-4962-99e2-14d49d199e2d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:08.855409 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0c33056e-5904-4962-99e2-14d49d199e2d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:08.995120 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-0c33056e-5904-4962-99e2-14d49d199e2d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:09.003605 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-0c33056e-5904-4962-99e2-14d49d199e2d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.161933 Jul 26 07:43:09.004179 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 755/1462] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:08 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:09.546305 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ddeb5370-ca5c-46ff-bc85-23a8947c254b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:09.546971 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ddeb5370-ca5c-46ff-bc85-23a8947c254b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:09.554050 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ddeb5370-ca5c-46ff-bc85-23a8947c254b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:09.554498 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ddeb5370-ca5c-46ff-bc85-23a8947c254b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:09.555257 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ddeb5370-ca5c-46ff-bc85-23a8947c254b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:09.555696 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ddeb5370-ca5c-46ff-bc85-23a8947c254b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:09.623143 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ddeb5370-ca5c-46ff-bc85-23a8947c254b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:09.632086 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ddeb5370-ca5c-46ff-bc85-23a8947c254b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:09.633589 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ddeb5370-ca5c-46ff-bc85-23a8947c254b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:09.634765 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ddeb5370-ca5c-46ff-bc85-23a8947c254b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.092461 Jul 26 07:43:09.635324 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 708/1463] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:09 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:10.025646 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d586b3f4-c449-4a24-ab49-e192461b64bb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:10.026307 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d586b3f4-c449-4a24-ab49-e192461b64bb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:10.033682 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d586b3f4-c449-4a24-ab49-e192461b64bb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:10.034255 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d586b3f4-c449-4a24-ab49-e192461b64bb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:10.035009 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d586b3f4-c449-4a24-ab49-e192461b64bb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:10.035442 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d586b3f4-c449-4a24-ab49-e192461b64bb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:10.174012 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d586b3f4-c449-4a24-ab49-e192461b64bb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:10.185817 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d586b3f4-c449-4a24-ab49-e192461b64bb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.164117 Jul 26 07:43:10.186571 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 756/1464] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:10 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:10.658512 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-4df8d52a-dcf9-44f1-93b4-a857f8486e56 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:10.659127 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-4df8d52a-dcf9-44f1-93b4-a857f8486e56 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:10.666056 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4df8d52a-dcf9-44f1-93b4-a857f8486e56 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:10.666499 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4df8d52a-dcf9-44f1-93b4-a857f8486e56 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:10.667262 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4df8d52a-dcf9-44f1-93b4-a857f8486e56 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:10.667690 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4df8d52a-dcf9-44f1-93b4-a857f8486e56 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:10.738076 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-4df8d52a-dcf9-44f1-93b4-a857f8486e56 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:10.747305 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-4df8d52a-dcf9-44f1-93b4-a857f8486e56 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:10.748772 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-4df8d52a-dcf9-44f1-93b4-a857f8486e56 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:10.749987 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-4df8d52a-dcf9-44f1-93b4-a857f8486e56 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.096203 Jul 26 07:43:10.750584 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 709/1465] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:10 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:11.217893 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-1a842002-2a96-4141-9e68-9c3267fe2ae2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:11.219049 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-1a842002-2a96-4141-9e68-9c3267fe2ae2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:11.226177 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1a842002-2a96-4141-9e68-9c3267fe2ae2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:11.226682 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1a842002-2a96-4141-9e68-9c3267fe2ae2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:11.227497 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1a842002-2a96-4141-9e68-9c3267fe2ae2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:11.227979 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1a842002-2a96-4141-9e68-9c3267fe2ae2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:11.359995 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-1a842002-2a96-4141-9e68-9c3267fe2ae2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:11.372803 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-1a842002-2a96-4141-9e68-9c3267fe2ae2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.161091 Jul 26 07:43:11.373572 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 757/1466] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:11 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:11.776785 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a1717383-f69e-4a99-aa46-5efb3ed0b683 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:11.777605 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a1717383-f69e-4a99-aa46-5efb3ed0b683 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:11.788679 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a1717383-f69e-4a99-aa46-5efb3ed0b683 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:11.789188 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a1717383-f69e-4a99-aa46-5efb3ed0b683 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:11.790404 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a1717383-f69e-4a99-aa46-5efb3ed0b683 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:11.791063 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a1717383-f69e-4a99-aa46-5efb3ed0b683 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:11.864257 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a1717383-f69e-4a99-aa46-5efb3ed0b683 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:11.873162 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a1717383-f69e-4a99-aa46-5efb3ed0b683 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:11.874702 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a1717383-f69e-4a99-aa46-5efb3ed0b683 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:11.875917 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a1717383-f69e-4a99-aa46-5efb3ed0b683 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.105883 Jul 26 07:43:11.876472 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 710/1467] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:11 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:12.400222 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-cdf4a78b-ad33-4d62-9fd4-33e487ddca03 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:12.400888 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-cdf4a78b-ad33-4d62-9fd4-33e487ddca03 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:12.408749 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cdf4a78b-ad33-4d62-9fd4-33e487ddca03 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:12.409244 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cdf4a78b-ad33-4d62-9fd4-33e487ddca03 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:12.410121 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cdf4a78b-ad33-4d62-9fd4-33e487ddca03 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:12.410598 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cdf4a78b-ad33-4d62-9fd4-33e487ddca03 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:12.560319 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-cdf4a78b-ad33-4d62-9fd4-33e487ddca03 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:12.572208 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-cdf4a78b-ad33-4d62-9fd4-33e487ddca03 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.176182 Jul 26 07:43:12.572987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 758/1468] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:12 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:12.899752 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7dd8e94b-7da3-4d68-abea-e72f2b89066a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:12.900368 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7dd8e94b-7da3-4d68-abea-e72f2b89066a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:12.907427 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7dd8e94b-7da3-4d68-abea-e72f2b89066a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:12.907797 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7dd8e94b-7da3-4d68-abea-e72f2b89066a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:12.908555 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7dd8e94b-7da3-4d68-abea-e72f2b89066a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:12.908979 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7dd8e94b-7da3-4d68-abea-e72f2b89066a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:12.973106 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7dd8e94b-7da3-4d68-abea-e72f2b89066a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:12.985724 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7dd8e94b-7da3-4d68-abea-e72f2b89066a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:12.987251 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7dd8e94b-7da3-4d68-abea-e72f2b89066a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:12.988438 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7dd8e94b-7da3-4d68-abea-e72f2b89066a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.092690 Jul 26 07:43:12.988994 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 711/1469] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:12 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:13.598039 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f1aa206a-5201-45c2-8144-90f220623194 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:13.598916 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f1aa206a-5201-45c2-8144-90f220623194 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:13.608467 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f1aa206a-5201-45c2-8144-90f220623194 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:13.609140 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f1aa206a-5201-45c2-8144-90f220623194 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:13.610575 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f1aa206a-5201-45c2-8144-90f220623194 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:13.611252 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f1aa206a-5201-45c2-8144-90f220623194 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:13.752909 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f1aa206a-5201-45c2-8144-90f220623194 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:13.764915 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f1aa206a-5201-45c2-8144-90f220623194 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.172827 Jul 26 07:43:13.765966 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 759/1470] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:13 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:14.014702 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-62d8913c-f530-42a5-baa1-9d06a93f1523 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:14.015711 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-62d8913c-f530-42a5-baa1-9d06a93f1523 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:14.022784 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-62d8913c-f530-42a5-baa1-9d06a93f1523 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:14.023223 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-62d8913c-f530-42a5-baa1-9d06a93f1523 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:14.023973 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-62d8913c-f530-42a5-baa1-9d06a93f1523 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:14.024404 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-62d8913c-f530-42a5-baa1-9d06a93f1523 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:14.087807 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-62d8913c-f530-42a5-baa1-9d06a93f1523 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:14.096795 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-62d8913c-f530-42a5-baa1-9d06a93f1523 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:14.098309 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-62d8913c-f530-42a5-baa1-9d06a93f1523 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:14.099491 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-62d8913c-f530-42a5-baa1-9d06a93f1523 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.091311 Jul 26 07:43:14.100050 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 712/1471] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:14 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:14.790747 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8e8473e0-4971-4067-8dce-5c9b46cec531 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:14.791472 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8e8473e0-4971-4067-8dce-5c9b46cec531 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:14.800295 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8e8473e0-4971-4067-8dce-5c9b46cec531 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:14.800727 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8e8473e0-4971-4067-8dce-5c9b46cec531 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:14.801488 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8e8473e0-4971-4067-8dce-5c9b46cec531 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:14.802042 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8e8473e0-4971-4067-8dce-5c9b46cec531 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:14.947117 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8e8473e0-4971-4067-8dce-5c9b46cec531 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:14.955659 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8e8473e0-4971-4067-8dce-5c9b46cec531 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.170998 Jul 26 07:43:14.956228 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 760/1472] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:14 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:15.130917 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6c1e0dca-7f9f-4e44-8814-1d9650801e0e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:15.131533 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6c1e0dca-7f9f-4e44-8814-1d9650801e0e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:15.139041 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6c1e0dca-7f9f-4e44-8814-1d9650801e0e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:15.139515 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6c1e0dca-7f9f-4e44-8814-1d9650801e0e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:15.140310 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6c1e0dca-7f9f-4e44-8814-1d9650801e0e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:15.140762 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6c1e0dca-7f9f-4e44-8814-1d9650801e0e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:15.213256 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6c1e0dca-7f9f-4e44-8814-1d9650801e0e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:15.222639 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6c1e0dca-7f9f-4e44-8814-1d9650801e0e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:15.224129 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6c1e0dca-7f9f-4e44-8814-1d9650801e0e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:15.225611 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6c1e0dca-7f9f-4e44-8814-1d9650801e0e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.098999 Jul 26 07:43:15.226217 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 713/1473] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:15 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:15.980248 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-097bdf7a-5bc4-488f-8c4f-c26439ba1d3b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:15.981113 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-097bdf7a-5bc4-488f-8c4f-c26439ba1d3b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:15.989048 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-097bdf7a-5bc4-488f-8c4f-c26439ba1d3b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:15.989494 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-097bdf7a-5bc4-488f-8c4f-c26439ba1d3b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:15.990281 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-097bdf7a-5bc4-488f-8c4f-c26439ba1d3b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:15.990710 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-097bdf7a-5bc4-488f-8c4f-c26439ba1d3b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:16.125767 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-097bdf7a-5bc4-488f-8c4f-c26439ba1d3b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:16.133802 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-097bdf7a-5bc4-488f-8c4f-c26439ba1d3b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.159137 Jul 26 07:43:16.134362 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 761/1474] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:15 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:16.249261 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-def275ed-e976-400c-af74-d13806de19ba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:16.249860 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-def275ed-e976-400c-af74-d13806de19ba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:16.257018 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-def275ed-e976-400c-af74-d13806de19ba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:16.257457 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-def275ed-e976-400c-af74-d13806de19ba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:16.258250 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-def275ed-e976-400c-af74-d13806de19ba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:16.258738 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-def275ed-e976-400c-af74-d13806de19ba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:16.324634 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-def275ed-e976-400c-af74-d13806de19ba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:16.334084 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-def275ed-e976-400c-af74-d13806de19ba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:16.335697 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-def275ed-e976-400c-af74-d13806de19ba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:16.336846 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-def275ed-e976-400c-af74-d13806de19ba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.091653 Jul 26 07:43:16.337400 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 714/1475] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:16 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:17.156697 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f132c89d-db15-4e69-a615-fb38ba6fcf02 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:17.157300 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f132c89d-db15-4e69-a615-fb38ba6fcf02 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:17.164304 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f132c89d-db15-4e69-a615-fb38ba6fcf02 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:17.164755 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f132c89d-db15-4e69-a615-fb38ba6fcf02 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:17.165519 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f132c89d-db15-4e69-a615-fb38ba6fcf02 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:17.165993 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f132c89d-db15-4e69-a615-fb38ba6fcf02 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:17.298130 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f132c89d-db15-4e69-a615-fb38ba6fcf02 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:17.306341 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f132c89d-db15-4e69-a615-fb38ba6fcf02 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.154472 Jul 26 07:43:17.306916 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 762/1476] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:17 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:17.364103 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-454063cc-a526-4f0f-86e2-980eb3660dbd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:17.364976 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-454063cc-a526-4f0f-86e2-980eb3660dbd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:17.374780 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-454063cc-a526-4f0f-86e2-980eb3660dbd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:17.375393 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-454063cc-a526-4f0f-86e2-980eb3660dbd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:17.376181 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-454063cc-a526-4f0f-86e2-980eb3660dbd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:17.376606 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-454063cc-a526-4f0f-86e2-980eb3660dbd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:17.441160 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-454063cc-a526-4f0f-86e2-980eb3660dbd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:17.449849 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-454063cc-a526-4f0f-86e2-980eb3660dbd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:17.451294 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-454063cc-a526-4f0f-86e2-980eb3660dbd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:17.452462 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-454063cc-a526-4f0f-86e2-980eb3660dbd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.095258 Jul 26 07:43:17.453074 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 715/1477] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:17 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:18.328919 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-75cdd1bc-81ea-42ae-b08f-10ebdc22d01a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:18.329544 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-75cdd1bc-81ea-42ae-b08f-10ebdc22d01a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:18.336893 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-75cdd1bc-81ea-42ae-b08f-10ebdc22d01a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:18.337340 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-75cdd1bc-81ea-42ae-b08f-10ebdc22d01a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:18.338143 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-75cdd1bc-81ea-42ae-b08f-10ebdc22d01a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:18.338575 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-75cdd1bc-81ea-42ae-b08f-10ebdc22d01a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:18.475607 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6cc3d4ee-d54c-4e70-8d0b-94b1ad37fc4c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:18.476238 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6cc3d4ee-d54c-4e70-8d0b-94b1ad37fc4c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:18.478272 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-75cdd1bc-81ea-42ae-b08f-10ebdc22d01a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:18.483161 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6cc3d4ee-d54c-4e70-8d0b-94b1ad37fc4c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:18.483607 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6cc3d4ee-d54c-4e70-8d0b-94b1ad37fc4c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:18.484471 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6cc3d4ee-d54c-4e70-8d0b-94b1ad37fc4c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:18.484897 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6cc3d4ee-d54c-4e70-8d0b-94b1ad37fc4c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:18.486671 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-75cdd1bc-81ea-42ae-b08f-10ebdc22d01a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.162187 Jul 26 07:43:18.487486 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 763/1478] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:18 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:18.547220 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6cc3d4ee-d54c-4e70-8d0b-94b1ad37fc4c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:18.556183 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6cc3d4ee-d54c-4e70-8d0b-94b1ad37fc4c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:18.557877 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6cc3d4ee-d54c-4e70-8d0b-94b1ad37fc4c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:18.559215 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6cc3d4ee-d54c-4e70-8d0b-94b1ad37fc4c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.087434 Jul 26 07:43:18.559906 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 716/1479] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:18 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:19.509212 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c48ddd64-c101-4393-89c5-d02650f80467 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:19.509791 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c48ddd64-c101-4393-89c5-d02650f80467 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:19.517070 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c48ddd64-c101-4393-89c5-d02650f80467 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:19.517518 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c48ddd64-c101-4393-89c5-d02650f80467 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:19.518312 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c48ddd64-c101-4393-89c5-d02650f80467 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:19.518743 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c48ddd64-c101-4393-89c5-d02650f80467 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:19.583634 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-cce0e8ba-2430-45bd-b1c4-c2b4f61fc613 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:19.584401 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-cce0e8ba-2430-45bd-b1c4-c2b4f61fc613 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:19.591069 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cce0e8ba-2430-45bd-b1c4-c2b4f61fc613 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:19.591492 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cce0e8ba-2430-45bd-b1c4-c2b4f61fc613 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:19.592264 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cce0e8ba-2430-45bd-b1c4-c2b4f61fc613 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:19.592701 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cce0e8ba-2430-45bd-b1c4-c2b4f61fc613 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:19.655148 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-cce0e8ba-2430-45bd-b1c4-c2b4f61fc613 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:19.659268 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c48ddd64-c101-4393-89c5-d02650f80467 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:19.663869 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-cce0e8ba-2430-45bd-b1c4-c2b4f61fc613 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:19.665347 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-cce0e8ba-2430-45bd-b1c4-c2b4f61fc613 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:19.666701 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-cce0e8ba-2430-45bd-b1c4-c2b4f61fc613 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.087478 Jul 26 07:43:19.667589 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 717/1480] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:19 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:19.668958 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c48ddd64-c101-4393-89c5-d02650f80467 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.163702 Jul 26 07:43:19.669529 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 764/1481] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:19 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:20.690751 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2381c8b5-5835-4eba-bbff-5a8d3e0df62c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:20.691380 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2381c8b5-5835-4eba-bbff-5a8d3e0df62c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:20.692109 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-0601bf6e-3758-4420-aa40-e9fa3bf69f68 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:20.692669 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-0601bf6e-3758-4420-aa40-e9fa3bf69f68 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:20.698550 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2381c8b5-5835-4eba-bbff-5a8d3e0df62c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:20.698998 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2381c8b5-5835-4eba-bbff-5a8d3e0df62c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:20.699685 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0601bf6e-3758-4420-aa40-e9fa3bf69f68 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:20.699804 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2381c8b5-5835-4eba-bbff-5a8d3e0df62c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:20.700123 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0601bf6e-3758-4420-aa40-e9fa3bf69f68 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:20.700237 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2381c8b5-5835-4eba-bbff-5a8d3e0df62c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:20.700899 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0601bf6e-3758-4420-aa40-e9fa3bf69f68 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:20.701328 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0601bf6e-3758-4420-aa40-e9fa3bf69f68 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:20.763762 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-0601bf6e-3758-4420-aa40-e9fa3bf69f68 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:20.772530 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-0601bf6e-3758-4420-aa40-e9fa3bf69f68 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:20.774060 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-0601bf6e-3758-4420-aa40-e9fa3bf69f68 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:20.775260 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-0601bf6e-3758-4420-aa40-e9fa3bf69f68 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.087156 Jul 26 07:43:20.775791 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 765/1482] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:20 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:20.836484 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2381c8b5-5835-4eba-bbff-5a8d3e0df62c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:20.841698 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:43:20.847551 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2381c8b5-5835-4eba-bbff-5a8d3e0df62c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.160801 Jul 26 07:43:20.848132 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 718/1483] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:20 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:21.798704 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6e23f949-c3c4-4caa-b807-7615a57986d6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:21.799318 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-6e23f949-c3c4-4caa-b807-7615a57986d6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:21.806365 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6e23f949-c3c4-4caa-b807-7615a57986d6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:21.806809 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6e23f949-c3c4-4caa-b807-7615a57986d6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:21.807559 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6e23f949-c3c4-4caa-b807-7615a57986d6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:21.807983 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6e23f949-c3c4-4caa-b807-7615a57986d6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:21.876116 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d1a0ef3b-b691-48b7-910a-9accb48b11c9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:21.876116 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d1a0ef3b-b691-48b7-910a-9accb48b11c9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:21.878887 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-6e23f949-c3c4-4caa-b807-7615a57986d6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:21.883743 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d1a0ef3b-b691-48b7-910a-9accb48b11c9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:21.884164 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d1a0ef3b-b691-48b7-910a-9accb48b11c9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:21.884923 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d1a0ef3b-b691-48b7-910a-9accb48b11c9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:21.885347 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d1a0ef3b-b691-48b7-910a-9accb48b11c9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:21.887995 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-6e23f949-c3c4-4caa-b807-7615a57986d6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:21.889451 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-6e23f949-c3c4-4caa-b807-7615a57986d6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:21.890661 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6e23f949-c3c4-4caa-b807-7615a57986d6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.096348 Jul 26 07:43:21.891209 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 766/1484] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:21 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:22.020777 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d1a0ef3b-b691-48b7-910a-9accb48b11c9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:22.032822 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d1a0ef3b-b691-48b7-910a-9accb48b11c9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.161708 Jul 26 07:43:22.033683 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 719/1485] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:21 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:43:22.913258 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-cc944ea6-e9c3-4af0-9c74-e435ea21de15 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:22.913860 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-cc944ea6-e9c3-4af0-9c74-e435ea21de15 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:22.920889 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cc944ea6-e9c3-4af0-9c74-e435ea21de15 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:22.921329 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cc944ea6-e9c3-4af0-9c74-e435ea21de15 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:22.922126 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cc944ea6-e9c3-4af0-9c74-e435ea21de15 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:22.922554 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cc944ea6-e9c3-4af0-9c74-e435ea21de15 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:22.985152 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-cc944ea6-e9c3-4af0-9c74-e435ea21de15 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:22.994329 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-cc944ea6-e9c3-4af0-9c74-e435ea21de15 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:22.995800 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-cc944ea6-e9c3-4af0-9c74-e435ea21de15 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:22.996940 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-cc944ea6-e9c3-4af0-9c74-e435ea21de15 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.087796 Jul 26 07:43:22.997497 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 767/1486] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:22 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:23.062023 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-21d62deb-5878-4ae7-99f9-a1c85ef72f8a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:23.062890 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-21d62deb-5878-4ae7-99f9-a1c85ef72f8a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:23.070359 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-21d62deb-5878-4ae7-99f9-a1c85ef72f8a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:23.070806 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-21d62deb-5878-4ae7-99f9-a1c85ef72f8a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:23.071553 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-21d62deb-5878-4ae7-99f9-a1c85ef72f8a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:23.071979 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-21d62deb-5878-4ae7-99f9-a1c85ef72f8a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:23.220069 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-21d62deb-5878-4ae7-99f9-a1c85ef72f8a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:23.228681 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-21d62deb-5878-4ae7-99f9-a1c85ef72f8a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.172690 Jul 26 07:43:23.229243 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 720/1487] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:23 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:24.021368 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3026b07d-6e34-45d3-83e4-53a69d18cc7b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:24.022119 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3026b07d-6e34-45d3-83e4-53a69d18cc7b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:24.030223 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3026b07d-6e34-45d3-83e4-53a69d18cc7b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:24.030751 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3026b07d-6e34-45d3-83e4-53a69d18cc7b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:24.031631 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3026b07d-6e34-45d3-83e4-53a69d18cc7b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:24.032161 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3026b07d-6e34-45d3-83e4-53a69d18cc7b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:24.095306 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3026b07d-6e34-45d3-83e4-53a69d18cc7b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:24.103891 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3026b07d-6e34-45d3-83e4-53a69d18cc7b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:24.105350 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3026b07d-6e34-45d3-83e4-53a69d18cc7b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:24.106529 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3026b07d-6e34-45d3-83e4-53a69d18cc7b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.089947 Jul 26 07:43:24.107094 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 768/1488] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:24 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:24.252966 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6176f37a-1ec0-4873-8794-dafcf2f52ad8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:24.253560 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6176f37a-1ec0-4873-8794-dafcf2f52ad8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:24.257058 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=54 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:43:24.264496 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6176f37a-1ec0-4873-8794-dafcf2f52ad8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:24.265128 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6176f37a-1ec0-4873-8794-dafcf2f52ad8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:24.266288 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6176f37a-1ec0-4873-8794-dafcf2f52ad8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:24.266903 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6176f37a-1ec0-4873-8794-dafcf2f52ad8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:24.410468 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6176f37a-1ec0-4873-8794-dafcf2f52ad8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:24.419178 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6176f37a-1ec0-4873-8794-dafcf2f52ad8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.172317 Jul 26 07:43:24.419742 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 721/1489] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:24 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:25.132120 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d76ed5d1-696a-4d96-9fe6-fc4783f5dbc9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:25.133079 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d76ed5d1-696a-4d96-9fe6-fc4783f5dbc9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:25.136161 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=52 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:43:25.144403 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d76ed5d1-696a-4d96-9fe6-fc4783f5dbc9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:25.145169 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d76ed5d1-696a-4d96-9fe6-fc4783f5dbc9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:25.145967 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d76ed5d1-696a-4d96-9fe6-fc4783f5dbc9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:25.146393 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d76ed5d1-696a-4d96-9fe6-fc4783f5dbc9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:25.209310 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d76ed5d1-696a-4d96-9fe6-fc4783f5dbc9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:25.218056 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d76ed5d1-696a-4d96-9fe6-fc4783f5dbc9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:25.219534 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d76ed5d1-696a-4d96-9fe6-fc4783f5dbc9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:25.220714 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d76ed5d1-696a-4d96-9fe6-fc4783f5dbc9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.095263 Jul 26 07:43:25.221450 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 769/1490] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:25 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:25.440799 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0d3affa7-d40b-4bde-94ec-a5d015226760 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:25.441399 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0d3affa7-d40b-4bde-94ec-a5d015226760 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:25.448256 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0d3affa7-d40b-4bde-94ec-a5d015226760 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:25.448703 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0d3affa7-d40b-4bde-94ec-a5d015226760 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:25.449460 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0d3affa7-d40b-4bde-94ec-a5d015226760 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:25.449949 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0d3affa7-d40b-4bde-94ec-a5d015226760 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:25.586112 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0d3affa7-d40b-4bde-94ec-a5d015226760 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:25.594820 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0d3affa7-d40b-4bde-94ec-a5d015226760 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.157991 Jul 26 07:43:25.595386 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 722/1491] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:25 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:26.250635 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-28d9db8f-2293-4a98-8a18-8cb0a7bc9912 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:26.251253 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-28d9db8f-2293-4a98-8a18-8cb0a7bc9912 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:26.258194 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-28d9db8f-2293-4a98-8a18-8cb0a7bc9912 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:26.258641 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-28d9db8f-2293-4a98-8a18-8cb0a7bc9912 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:26.259406 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-28d9db8f-2293-4a98-8a18-8cb0a7bc9912 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:26.259842 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-28d9db8f-2293-4a98-8a18-8cb0a7bc9912 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:26.263847 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:43:26.328297 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-28d9db8f-2293-4a98-8a18-8cb0a7bc9912 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:26.337495 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-28d9db8f-2293-4a98-8a18-8cb0a7bc9912 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:26.339015 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-28d9db8f-2293-4a98-8a18-8cb0a7bc9912 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:26.340159 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-28d9db8f-2293-4a98-8a18-8cb0a7bc9912 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.093549 Jul 26 07:43:26.340718 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 770/1492] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:26 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:26.624324 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ad8e201b-47ae-44f4-97df-2a28047383e4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:26.625021 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ad8e201b-47ae-44f4-97df-2a28047383e4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:26.632231 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ad8e201b-47ae-44f4-97df-2a28047383e4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:26.632670 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ad8e201b-47ae-44f4-97df-2a28047383e4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:26.633405 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ad8e201b-47ae-44f4-97df-2a28047383e4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:26.633853 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ad8e201b-47ae-44f4-97df-2a28047383e4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:26.791782 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ad8e201b-47ae-44f4-97df-2a28047383e4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:26.800430 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ad8e201b-47ae-44f4-97df-2a28047383e4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.180999 Jul 26 07:43:26.801106 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 723/1493] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:26 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:27.373614 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9bba438e-b2de-4b85-8b7f-a33bbeb684d9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:27.374413 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-9bba438e-b2de-4b85-8b7f-a33bbeb684d9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:27.383207 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9bba438e-b2de-4b85-8b7f-a33bbeb684d9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:27.383661 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9bba438e-b2de-4b85-8b7f-a33bbeb684d9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:27.384442 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9bba438e-b2de-4b85-8b7f-a33bbeb684d9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:27.384873 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9bba438e-b2de-4b85-8b7f-a33bbeb684d9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:27.450616 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-9bba438e-b2de-4b85-8b7f-a33bbeb684d9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:27.460157 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-9bba438e-b2de-4b85-8b7f-a33bbeb684d9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:27.461724 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-9bba438e-b2de-4b85-8b7f-a33bbeb684d9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:27.462839 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-9bba438e-b2de-4b85-8b7f-a33bbeb684d9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.094787 Jul 26 07:43:27.463428 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 771/1494] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:27 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:27.823476 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-89b68d0a-81cb-440c-97ee-60e8553735ab tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:27.824080 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-89b68d0a-81cb-440c-97ee-60e8553735ab tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:27.831368 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-89b68d0a-81cb-440c-97ee-60e8553735ab tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:27.831811 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-89b68d0a-81cb-440c-97ee-60e8553735ab tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:27.832573 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-89b68d0a-81cb-440c-97ee-60e8553735ab tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:27.833007 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-89b68d0a-81cb-440c-97ee-60e8553735ab tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:27.968477 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-89b68d0a-81cb-440c-97ee-60e8553735ab tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:27.976813 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-89b68d0a-81cb-440c-97ee-60e8553735ab tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.157394 Jul 26 07:43:27.977385 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 724/1495] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:27 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:28.495986 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3011f911-b470-4800-9a29-47018918fe11 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:28.496623 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3011f911-b470-4800-9a29-47018918fe11 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:28.504861 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3011f911-b470-4800-9a29-47018918fe11 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:28.505285 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3011f911-b470-4800-9a29-47018918fe11 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:28.506081 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3011f911-b470-4800-9a29-47018918fe11 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:28.506505 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3011f911-b470-4800-9a29-47018918fe11 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:28.576464 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3011f911-b470-4800-9a29-47018918fe11 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:28.585780 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3011f911-b470-4800-9a29-47018918fe11 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:28.587251 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3011f911-b470-4800-9a29-47018918fe11 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:28.588426 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3011f911-b470-4800-9a29-47018918fe11 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.097225 Jul 26 07:43:28.588951 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 772/1496] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:28 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:29.002382 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0503ba23-a280-4442-80ea-36e53a4654a2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:29.002975 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0503ba23-a280-4442-80ea-36e53a4654a2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:29.013081 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0503ba23-a280-4442-80ea-36e53a4654a2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:29.013623 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0503ba23-a280-4442-80ea-36e53a4654a2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:29.014422 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0503ba23-a280-4442-80ea-36e53a4654a2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:29.015025 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0503ba23-a280-4442-80ea-36e53a4654a2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:29.153868 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0503ba23-a280-4442-80ea-36e53a4654a2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:29.162515 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0503ba23-a280-4442-80ea-36e53a4654a2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.166187 Jul 26 07:43:29.163259 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 725/1497] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:28 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:29.611817 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ae971378-8212-4a72-8ceb-2e35b5c7a6e8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:29.612428 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ae971378-8212-4a72-8ceb-2e35b5c7a6e8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:29.621637 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ae971378-8212-4a72-8ceb-2e35b5c7a6e8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:29.622234 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ae971378-8212-4a72-8ceb-2e35b5c7a6e8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:29.623216 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ae971378-8212-4a72-8ceb-2e35b5c7a6e8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:29.623704 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ae971378-8212-4a72-8ceb-2e35b5c7a6e8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:29.691737 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ae971378-8212-4a72-8ceb-2e35b5c7a6e8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:29.701617 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ae971378-8212-4a72-8ceb-2e35b5c7a6e8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:29.703036 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ae971378-8212-4a72-8ceb-2e35b5c7a6e8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:29.704195 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ae971378-8212-4a72-8ceb-2e35b5c7a6e8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.096488 Jul 26 07:43:29.704764 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 773/1498] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:29 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:30.187703 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a8318dab-e375-4064-8a44-a73c8465bb2c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:30.188314 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a8318dab-e375-4064-8a44-a73c8465bb2c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:30.196861 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a8318dab-e375-4064-8a44-a73c8465bb2c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:30.197305 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a8318dab-e375-4064-8a44-a73c8465bb2c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:30.198101 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a8318dab-e375-4064-8a44-a73c8465bb2c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:30.198535 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a8318dab-e375-4064-8a44-a73c8465bb2c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:30.338988 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a8318dab-e375-4064-8a44-a73c8465bb2c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:30.347340 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a8318dab-e375-4064-8a44-a73c8465bb2c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.165713 Jul 26 07:43:30.347884 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 726/1499] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:30 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:30.730463 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-0813f5e9-3af3-4aa0-9546-152042c62e41 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:30.731607 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-0813f5e9-3af3-4aa0-9546-152042c62e41 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:30.740020 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0813f5e9-3af3-4aa0-9546-152042c62e41 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:30.740789 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0813f5e9-3af3-4aa0-9546-152042c62e41 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:30.741549 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0813f5e9-3af3-4aa0-9546-152042c62e41 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:30.742011 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0813f5e9-3af3-4aa0-9546-152042c62e41 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:30.805770 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-0813f5e9-3af3-4aa0-9546-152042c62e41 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:30.814171 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-0813f5e9-3af3-4aa0-9546-152042c62e41 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:30.815675 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-0813f5e9-3af3-4aa0-9546-152042c62e41 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:30.816784 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-0813f5e9-3af3-4aa0-9546-152042c62e41 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.092015 Jul 26 07:43:30.817332 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 774/1500] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:30 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:31.373615 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-abad02d8-31d7-4f04-a6c7-3cdfe9706609 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:31.374525 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-abad02d8-31d7-4f04-a6c7-3cdfe9706609 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:31.384672 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-abad02d8-31d7-4f04-a6c7-3cdfe9706609 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:31.385388 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-abad02d8-31d7-4f04-a6c7-3cdfe9706609 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:31.386546 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-abad02d8-31d7-4f04-a6c7-3cdfe9706609 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:31.387205 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-abad02d8-31d7-4f04-a6c7-3cdfe9706609 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:31.519813 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-abad02d8-31d7-4f04-a6c7-3cdfe9706609 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:31.528611 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-abad02d8-31d7-4f04-a6c7-3cdfe9706609 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.161069 Jul 26 07:43:31.529200 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 727/1501] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:31 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:31.842020 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-4b55afd6-0391-4d6c-b71f-bfd551858911 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:31.842798 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-4b55afd6-0391-4d6c-b71f-bfd551858911 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:31.851397 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4b55afd6-0391-4d6c-b71f-bfd551858911 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:31.851837 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4b55afd6-0391-4d6c-b71f-bfd551858911 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:31.852782 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4b55afd6-0391-4d6c-b71f-bfd551858911 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:31.853221 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4b55afd6-0391-4d6c-b71f-bfd551858911 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:31.916099 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-4b55afd6-0391-4d6c-b71f-bfd551858911 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:31.924887 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-4b55afd6-0391-4d6c-b71f-bfd551858911 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:31.926408 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-4b55afd6-0391-4d6c-b71f-bfd551858911 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:31.927548 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-4b55afd6-0391-4d6c-b71f-bfd551858911 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.090874 Jul 26 07:43:31.928117 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 775/1502] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:31 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:32.554964 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6812c992-6c99-4247-b995-e4813309988a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:32.555862 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6812c992-6c99-4247-b995-e4813309988a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:32.566137 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6812c992-6c99-4247-b995-e4813309988a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:32.566834 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6812c992-6c99-4247-b995-e4813309988a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:32.567996 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6812c992-6c99-4247-b995-e4813309988a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:32.568659 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6812c992-6c99-4247-b995-e4813309988a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:32.733581 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6812c992-6c99-4247-b995-e4813309988a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:32.744241 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6812c992-6c99-4247-b995-e4813309988a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.195332 Jul 26 07:43:32.744820 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 728/1503] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:32 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:32.952380 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-180b6b0b-8910-44df-a9bf-821c0a82e7cb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:32.953078 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-180b6b0b-8910-44df-a9bf-821c0a82e7cb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:32.962873 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-180b6b0b-8910-44df-a9bf-821c0a82e7cb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:32.963316 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-180b6b0b-8910-44df-a9bf-821c0a82e7cb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:32.964155 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-180b6b0b-8910-44df-a9bf-821c0a82e7cb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:32.964579 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-180b6b0b-8910-44df-a9bf-821c0a82e7cb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:33.039943 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-180b6b0b-8910-44df-a9bf-821c0a82e7cb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:33.053769 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-180b6b0b-8910-44df-a9bf-821c0a82e7cb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:33.055369 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-180b6b0b-8910-44df-a9bf-821c0a82e7cb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:33.056534 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-180b6b0b-8910-44df-a9bf-821c0a82e7cb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.109499 Jul 26 07:43:33.057093 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 776/1504] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:32 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:33.776995 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6968a6e0-3cf4-455f-8f24-f33aa5dd8114 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:33.777588 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6968a6e0-3cf4-455f-8f24-f33aa5dd8114 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:33.784553 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6968a6e0-3cf4-455f-8f24-f33aa5dd8114 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:33.784993 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6968a6e0-3cf4-455f-8f24-f33aa5dd8114 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:33.785712 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6968a6e0-3cf4-455f-8f24-f33aa5dd8114 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:33.786213 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6968a6e0-3cf4-455f-8f24-f33aa5dd8114 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:33.941913 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6968a6e0-3cf4-455f-8f24-f33aa5dd8114 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:33.951170 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6968a6e0-3cf4-455f-8f24-f33aa5dd8114 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.178154 Jul 26 07:43:33.951751 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 729/1505] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:33 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:34.079354 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-fbef5f42-a46d-46b1-b272-3962eb409df6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:34.080357 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-fbef5f42-a46d-46b1-b272-3962eb409df6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:34.087483 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fbef5f42-a46d-46b1-b272-3962eb409df6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:34.087969 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fbef5f42-a46d-46b1-b272-3962eb409df6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:34.088735 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fbef5f42-a46d-46b1-b272-3962eb409df6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:34.089155 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fbef5f42-a46d-46b1-b272-3962eb409df6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:34.155407 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-fbef5f42-a46d-46b1-b272-3962eb409df6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:34.168613 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-fbef5f42-a46d-46b1-b272-3962eb409df6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:34.170955 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-fbef5f42-a46d-46b1-b272-3962eb409df6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:34.172742 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-fbef5f42-a46d-46b1-b272-3962eb409df6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.097433 Jul 26 07:43:34.173567 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 777/1506] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:34 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:34.974116 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-fb49b652-6196-474f-90ee-3eb834eedb4c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:34.974722 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-fb49b652-6196-474f-90ee-3eb834eedb4c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:34.981897 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fb49b652-6196-474f-90ee-3eb834eedb4c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:34.982341 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fb49b652-6196-474f-90ee-3eb834eedb4c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:34.983108 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fb49b652-6196-474f-90ee-3eb834eedb4c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:34.983539 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fb49b652-6196-474f-90ee-3eb834eedb4c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:35.124260 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-fb49b652-6196-474f-90ee-3eb834eedb4c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:35.133042 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-fb49b652-6196-474f-90ee-3eb834eedb4c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.162999 Jul 26 07:43:35.133619 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 730/1507] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:34 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:35.203204 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7a0b9a62-9b78-48ca-9e3f-707f655c8a53 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:35.204131 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7a0b9a62-9b78-48ca-9e3f-707f655c8a53 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:35.214394 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7a0b9a62-9b78-48ca-9e3f-707f655c8a53 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:35.214847 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7a0b9a62-9b78-48ca-9e3f-707f655c8a53 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:35.215622 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7a0b9a62-9b78-48ca-9e3f-707f655c8a53 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:35.216058 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7a0b9a62-9b78-48ca-9e3f-707f655c8a53 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:35.286995 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7a0b9a62-9b78-48ca-9e3f-707f655c8a53 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:35.296584 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7a0b9a62-9b78-48ca-9e3f-707f655c8a53 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:35.298092 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7a0b9a62-9b78-48ca-9e3f-707f655c8a53 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:35.299225 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7a0b9a62-9b78-48ca-9e3f-707f655c8a53 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.103181 Jul 26 07:43:35.299784 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 778/1508] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:35 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:36.154840 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c0c59b2a-6d7c-431b-91f8-75d9a8c3003d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:36.155481 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c0c59b2a-6d7c-431b-91f8-75d9a8c3003d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:36.162556 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c0c59b2a-6d7c-431b-91f8-75d9a8c3003d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:36.162997 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c0c59b2a-6d7c-431b-91f8-75d9a8c3003d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:36.163756 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c0c59b2a-6d7c-431b-91f8-75d9a8c3003d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:36.164187 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c0c59b2a-6d7c-431b-91f8-75d9a8c3003d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:36.300612 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-c0c59b2a-6d7c-431b-91f8-75d9a8c3003d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:36.313053 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c0c59b2a-6d7c-431b-91f8-75d9a8c3003d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.161986 Jul 26 07:43:36.313930 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 731/1509] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:36 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:36.322329 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-98868dde-a76b-4282-b3a1-07e9d316b76f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:36.322943 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-98868dde-a76b-4282-b3a1-07e9d316b76f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:36.330364 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-98868dde-a76b-4282-b3a1-07e9d316b76f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:36.330815 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-98868dde-a76b-4282-b3a1-07e9d316b76f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:36.331577 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-98868dde-a76b-4282-b3a1-07e9d316b76f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:36.332067 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-98868dde-a76b-4282-b3a1-07e9d316b76f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:36.399924 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-98868dde-a76b-4282-b3a1-07e9d316b76f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:36.408901 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-98868dde-a76b-4282-b3a1-07e9d316b76f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:36.410359 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-98868dde-a76b-4282-b3a1-07e9d316b76f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:36.411511 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-98868dde-a76b-4282-b3a1-07e9d316b76f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.093451 Jul 26 07:43:36.412065 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 779/1510] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:36 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:37.336317 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-bd492e71-39f9-4368-8cba-4f53b9c4e9bf tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:37.337066 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-bd492e71-39f9-4368-8cba-4f53b9c4e9bf tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:37.344077 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bd492e71-39f9-4368-8cba-4f53b9c4e9bf tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:37.344522 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bd492e71-39f9-4368-8cba-4f53b9c4e9bf tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:37.345292 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bd492e71-39f9-4368-8cba-4f53b9c4e9bf tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:37.345692 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bd492e71-39f9-4368-8cba-4f53b9c4e9bf tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:37.433884 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-10c87c50-e8be-4ea1-a911-30ccc9f255a6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:37.434491 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-10c87c50-e8be-4ea1-a911-30ccc9f255a6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:37.441452 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-10c87c50-e8be-4ea1-a911-30ccc9f255a6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:37.442244 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-10c87c50-e8be-4ea1-a911-30ccc9f255a6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:37.442689 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-10c87c50-e8be-4ea1-a911-30ccc9f255a6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:37.443115 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-10c87c50-e8be-4ea1-a911-30ccc9f255a6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:37.491461 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-bd492e71-39f9-4368-8cba-4f53b9c4e9bf tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:37.499831 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-bd492e71-39f9-4368-8cba-4f53b9c4e9bf tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.167889 Jul 26 07:43:37.500399 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 732/1511] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:37 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:37.507739 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-10c87c50-e8be-4ea1-a911-30ccc9f255a6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:37.516328 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-10c87c50-e8be-4ea1-a911-30ccc9f255a6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:37.517834 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-10c87c50-e8be-4ea1-a911-30ccc9f255a6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:37.518980 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-10c87c50-e8be-4ea1-a911-30ccc9f255a6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.089108 Jul 26 07:43:37.519524 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 780/1512] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:37 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:38.522764 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-583379a5-a147-4c34-898b-cb8d6d2a945e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:38.523576 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-583379a5-a147-4c34-898b-cb8d6d2a945e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:38.532674 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-583379a5-a147-4c34-898b-cb8d6d2a945e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:38.533267 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-583379a5-a147-4c34-898b-cb8d6d2a945e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:38.534319 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-583379a5-a147-4c34-898b-cb8d6d2a945e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:38.534892 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-583379a5-a147-4c34-898b-cb8d6d2a945e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:38.542626 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ad0cb72f-9ac7-46c5-844d-b8396d9500ba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:38.543334 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ad0cb72f-9ac7-46c5-844d-b8396d9500ba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:38.550241 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ad0cb72f-9ac7-46c5-844d-b8396d9500ba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:38.550682 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ad0cb72f-9ac7-46c5-844d-b8396d9500ba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:38.551439 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ad0cb72f-9ac7-46c5-844d-b8396d9500ba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:38.551863 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ad0cb72f-9ac7-46c5-844d-b8396d9500ba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:38.616210 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ad0cb72f-9ac7-46c5-844d-b8396d9500ba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:38.625310 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ad0cb72f-9ac7-46c5-844d-b8396d9500ba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:38.626849 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ad0cb72f-9ac7-46c5-844d-b8396d9500ba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:38.627993 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ad0cb72f-9ac7-46c5-844d-b8396d9500ba tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.089987 Jul 26 07:43:38.628529 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 781/1513] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:38 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:38.670513 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-583379a5-a147-4c34-898b-cb8d6d2a945e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:38.682051 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-583379a5-a147-4c34-898b-cb8d6d2a945e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.164469 Jul 26 07:43:38.682613 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 733/1514] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:38 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:39.653009 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-2804c37d-3751-4b13-b1af-72313cf3da76 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:39.653656 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2804c37d-3751-4b13-b1af-72313cf3da76 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:39.660718 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2804c37d-3751-4b13-b1af-72313cf3da76 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:39.661167 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2804c37d-3751-4b13-b1af-72313cf3da76 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:39.661981 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2804c37d-3751-4b13-b1af-72313cf3da76 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:39.662415 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2804c37d-3751-4b13-b1af-72313cf3da76 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:39.706119 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-dd1eff81-45be-4b0f-99a7-05c191d8d876 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:39.706680 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-dd1eff81-45be-4b0f-99a7-05c191d8d876 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:39.714349 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dd1eff81-45be-4b0f-99a7-05c191d8d876 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:39.714797 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dd1eff81-45be-4b0f-99a7-05c191d8d876 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:39.715567 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dd1eff81-45be-4b0f-99a7-05c191d8d876 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:39.716018 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dd1eff81-45be-4b0f-99a7-05c191d8d876 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:39.732230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2804c37d-3751-4b13-b1af-72313cf3da76 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:39.740720 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2804c37d-3751-4b13-b1af-72313cf3da76 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:39.742237 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2804c37d-3751-4b13-b1af-72313cf3da76 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:39.743443 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-2804c37d-3751-4b13-b1af-72313cf3da76 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.094647 Jul 26 07:43:39.744006 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 782/1515] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:39 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:39.850239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-dd1eff81-45be-4b0f-99a7-05c191d8d876 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:39.859165 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-dd1eff81-45be-4b0f-99a7-05c191d8d876 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.159298 Jul 26 07:43:39.859744 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 734/1516] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:39 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:40.770079 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b07c1f94-db4c-4631-b991-8c47f93010f7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:40.770911 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b07c1f94-db4c-4631-b991-8c47f93010f7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:40.784283 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b07c1f94-db4c-4631-b991-8c47f93010f7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:40.784925 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b07c1f94-db4c-4631-b991-8c47f93010f7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:40.786190 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b07c1f94-db4c-4631-b991-8c47f93010f7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:40.787229 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b07c1f94-db4c-4631-b991-8c47f93010f7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:40.857857 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-b07c1f94-db4c-4631-b991-8c47f93010f7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:40.866950 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-b07c1f94-db4c-4631-b991-8c47f93010f7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:40.868587 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-b07c1f94-db4c-4631-b991-8c47f93010f7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:40.869779 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b07c1f94-db4c-4631-b991-8c47f93010f7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.106077 Jul 26 07:43:40.870697 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 783/1517] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:40 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:40.883783 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c2e53e71-9ebc-46e7-a945-8824814391ea tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:40.884422 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c2e53e71-9ebc-46e7-a945-8824814391ea tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:40.891869 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c2e53e71-9ebc-46e7-a945-8824814391ea tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:40.892499 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c2e53e71-9ebc-46e7-a945-8824814391ea tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:40.893655 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c2e53e71-9ebc-46e7-a945-8824814391ea tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:40.894293 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c2e53e71-9ebc-46e7-a945-8824814391ea tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:40.914474 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:43:41.031930 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-c2e53e71-9ebc-46e7-a945-8824814391ea tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:41.040019 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c2e53e71-9ebc-46e7-a945-8824814391ea tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.162440 Jul 26 07:43:41.040568 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 735/1518] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:40 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:41.901779 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3167bb78-f918-4c85-b606-7c3cb338c2e5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:41.902422 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3167bb78-f918-4c85-b606-7c3cb338c2e5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:41.909260 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3167bb78-f918-4c85-b606-7c3cb338c2e5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:41.909702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3167bb78-f918-4c85-b606-7c3cb338c2e5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:41.910486 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3167bb78-f918-4c85-b606-7c3cb338c2e5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:41.910912 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3167bb78-f918-4c85-b606-7c3cb338c2e5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:41.981005 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3167bb78-f918-4c85-b606-7c3cb338c2e5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:41.992787 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3167bb78-f918-4c85-b606-7c3cb338c2e5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:41.994444 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3167bb78-f918-4c85-b606-7c3cb338c2e5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:41.995621 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3167bb78-f918-4c85-b606-7c3cb338c2e5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.099459 Jul 26 07:43:41.996215 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 784/1519] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:41 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:42.061685 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0dfb4cda-2696-4b5c-948b-1ecc729e2d09 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:42.062305 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0dfb4cda-2696-4b5c-948b-1ecc729e2d09 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:42.069910 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0dfb4cda-2696-4b5c-948b-1ecc729e2d09 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:42.070524 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0dfb4cda-2696-4b5c-948b-1ecc729e2d09 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:42.071362 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0dfb4cda-2696-4b5c-948b-1ecc729e2d09 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:42.071846 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0dfb4cda-2696-4b5c-948b-1ecc729e2d09 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:42.208261 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0dfb4cda-2696-4b5c-948b-1ecc729e2d09 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:42.221083 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0dfb4cda-2696-4b5c-948b-1ecc729e2d09 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.162955 Jul 26 07:43:42.221923 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 736/1520] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:42 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:42.942364 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-37499081-2576-4ae9-b2ba-7d91b4330966 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:42.942364 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-37499081-2576-4ae9-b2ba-7d91b4330966 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:42.949674 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-37499081-2576-4ae9-b2ba-7d91b4330966 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:42.950154 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-37499081-2576-4ae9-b2ba-7d91b4330966 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:42.950901 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-37499081-2576-4ae9-b2ba-7d91b4330966 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:42.951327 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-37499081-2576-4ae9-b2ba-7d91b4330966 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:42.977184 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-37499081-2576-4ae9-b2ba-7d91b4330966 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Going to try to terminate instance {{(pid=117715) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 07:43:43.010297 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:43:43.024478 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-51065872-9b6e-451c-9eab-fb07415f4358 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:43.025310 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-51065872-9b6e-451c-9eab-fb07415f4358 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:43.035085 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-51065872-9b6e-451c-9eab-fb07415f4358 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:43.035774 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-51065872-9b6e-451c-9eab-fb07415f4358 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:43.037217 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-51065872-9b6e-451c-9eab-fb07415f4358 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:43.038075 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-51065872-9b6e-451c-9eab-fb07415f4358 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:43.068122 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-37499081-2576-4ae9-b2ba-7d91b4330966 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 204 len: 0 microversion: 2.1 time: 0.130044 Jul 26 07:43:43.068950 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 785/1521] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Jul 26 07:43:42 2022] DELETE /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 07:43:43.077633 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-2ba8bee9-c8b5-4783-8755-2205a2943dc4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:43.078352 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2ba8bee9-c8b5-4783-8755-2205a2943dc4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:43.084806 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2ba8bee9-c8b5-4783-8755-2205a2943dc4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:43.085257 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2ba8bee9-c8b5-4783-8755-2205a2943dc4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:43.086066 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2ba8bee9-c8b5-4783-8755-2205a2943dc4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:43.086499 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2ba8bee9-c8b5-4783-8755-2205a2943dc4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:43.104115 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-51065872-9b6e-451c-9eab-fb07415f4358 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:43.112640 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-51065872-9b6e-451c-9eab-fb07415f4358 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:43.114143 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-51065872-9b6e-451c-9eab-fb07415f4358 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:43.115287 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-51065872-9b6e-451c-9eab-fb07415f4358 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.095221 Jul 26 07:43:43.115849 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 737/1522] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:43 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:43.228631 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2ba8bee9-c8b5-4783-8755-2205a2943dc4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:43.241954 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-2ba8bee9-c8b5-4783-8755-2205a2943dc4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.168410 Jul 26 07:43:43.242552 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 786/1523] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:43 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:43:43.245912 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7b3067e8-b098-4b74-86fc-542bc86fe8b0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:43.246634 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7b3067e8-b098-4b74-86fc-542bc86fe8b0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:43.253062 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7b3067e8-b098-4b74-86fc-542bc86fe8b0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:43.253513 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7b3067e8-b098-4b74-86fc-542bc86fe8b0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:43.254309 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7b3067e8-b098-4b74-86fc-542bc86fe8b0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:43.254742 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7b3067e8-b098-4b74-86fc-542bc86fe8b0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:43.417305 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7b3067e8-b098-4b74-86fc-542bc86fe8b0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:43.426068 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7b3067e8-b098-4b74-86fc-542bc86fe8b0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.184505 Jul 26 07:43:43.426613 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 738/1524] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:43 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:44.139422 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-fe9b5886-c37a-444d-a8d9-3ab5e49bb8dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:44.140043 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-fe9b5886-c37a-444d-a8d9-3ab5e49bb8dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:44.147511 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fe9b5886-c37a-444d-a8d9-3ab5e49bb8dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:44.148009 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fe9b5886-c37a-444d-a8d9-3ab5e49bb8dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:44.148858 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fe9b5886-c37a-444d-a8d9-3ab5e49bb8dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:44.149427 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fe9b5886-c37a-444d-a8d9-3ab5e49bb8dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:44.224385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-fe9b5886-c37a-444d-a8d9-3ab5e49bb8dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:44.238322 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-fe9b5886-c37a-444d-a8d9-3ab5e49bb8dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:44.240636 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-fe9b5886-c37a-444d-a8d9-3ab5e49bb8dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:44.242320 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-fe9b5886-c37a-444d-a8d9-3ab5e49bb8dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.107121 Jul 26 07:43:44.243179 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 787/1525] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:44 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:44.263464 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0103545d-7242-459d-b4ba-dd474dc513f7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:44.264043 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0103545d-7242-459d-b4ba-dd474dc513f7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:44.270711 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0103545d-7242-459d-b4ba-dd474dc513f7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:44.271163 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0103545d-7242-459d-b4ba-dd474dc513f7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:44.271905 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0103545d-7242-459d-b4ba-dd474dc513f7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:44.272380 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0103545d-7242-459d-b4ba-dd474dc513f7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:44.406714 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0103545d-7242-459d-b4ba-dd474dc513f7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:44.415539 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0103545d-7242-459d-b4ba-dd474dc513f7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.155988 Jul 26 07:43:44.416085 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 739/1526] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:44 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:44.448181 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c572e348-4a8a-46f8-ade5-20a967b3b6ee tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:44.448798 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c572e348-4a8a-46f8-ade5-20a967b3b6ee tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:44.455705 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c572e348-4a8a-46f8-ade5-20a967b3b6ee tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:44.456151 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c572e348-4a8a-46f8-ade5-20a967b3b6ee tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:44.456913 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c572e348-4a8a-46f8-ade5-20a967b3b6ee tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:44.457329 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c572e348-4a8a-46f8-ade5-20a967b3b6ee tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:44.598054 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c572e348-4a8a-46f8-ade5-20a967b3b6ee tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:44.606773 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c572e348-4a8a-46f8-ade5-20a967b3b6ee tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.162473 Jul 26 07:43:44.607350 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 788/1527] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:44 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:45.265293 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-73b5bf21-1324-4bde-8848-1a17a489c063 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:45.265922 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-73b5bf21-1324-4bde-8848-1a17a489c063 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:45.273225 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-73b5bf21-1324-4bde-8848-1a17a489c063 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:45.273677 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-73b5bf21-1324-4bde-8848-1a17a489c063 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:45.274506 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-73b5bf21-1324-4bde-8848-1a17a489c063 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:45.274946 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-73b5bf21-1324-4bde-8848-1a17a489c063 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:45.339990 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-73b5bf21-1324-4bde-8848-1a17a489c063 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:45.348445 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-73b5bf21-1324-4bde-8848-1a17a489c063 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:45.349970 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-73b5bf21-1324-4bde-8848-1a17a489c063 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:45.351126 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-73b5bf21-1324-4bde-8848-1a17a489c063 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.089902 Jul 26 07:43:45.351688 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 740/1528] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:45 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:45.437132 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-29af91bc-b2b6-4b0a-a57c-03de15de2ce1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:45.437793 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-29af91bc-b2b6-4b0a-a57c-03de15de2ce1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:45.444881 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-29af91bc-b2b6-4b0a-a57c-03de15de2ce1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:45.445350 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-29af91bc-b2b6-4b0a-a57c-03de15de2ce1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:45.446159 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-29af91bc-b2b6-4b0a-a57c-03de15de2ce1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:45.446616 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-29af91bc-b2b6-4b0a-a57c-03de15de2ce1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:45.585940 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-29af91bc-b2b6-4b0a-a57c-03de15de2ce1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:45.594951 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-29af91bc-b2b6-4b0a-a57c-03de15de2ce1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.161741 Jul 26 07:43:45.595477 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 789/1529] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:45 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:45.631132 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-5ffb65a6-504f-4b79-bac9-1b780a29156e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:45.632028 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-5ffb65a6-504f-4b79-bac9-1b780a29156e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:45.641331 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5ffb65a6-504f-4b79-bac9-1b780a29156e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:45.641978 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5ffb65a6-504f-4b79-bac9-1b780a29156e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:45.643079 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5ffb65a6-504f-4b79-bac9-1b780a29156e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:45.643681 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5ffb65a6-504f-4b79-bac9-1b780a29156e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:45.788927 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-5ffb65a6-504f-4b79-bac9-1b780a29156e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:45.798015 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-5ffb65a6-504f-4b79-bac9-1b780a29156e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.172732 Jul 26 07:43:45.798568 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 741/1530] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:45 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:46.382699 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-cf466c92-6b35-414b-9df2-758ad5459740 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:46.383309 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-cf466c92-6b35-414b-9df2-758ad5459740 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:46.389703 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cf466c92-6b35-414b-9df2-758ad5459740 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:46.390133 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cf466c92-6b35-414b-9df2-758ad5459740 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:46.390897 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cf466c92-6b35-414b-9df2-758ad5459740 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:46.391349 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cf466c92-6b35-414b-9df2-758ad5459740 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:46.460387 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-cf466c92-6b35-414b-9df2-758ad5459740 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:46.469398 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-cf466c92-6b35-414b-9df2-758ad5459740 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:46.470926 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-cf466c92-6b35-414b-9df2-758ad5459740 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:46.472087 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-cf466c92-6b35-414b-9df2-758ad5459740 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.093386 Jul 26 07:43:46.472612 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 790/1531] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:46 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:46.616842 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-74d7bf09-4c31-49f0-b7cd-499452a43d7f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:46.617703 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-74d7bf09-4c31-49f0-b7cd-499452a43d7f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:46.624464 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-74d7bf09-4c31-49f0-b7cd-499452a43d7f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:46.624913 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-74d7bf09-4c31-49f0-b7cd-499452a43d7f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:46.625678 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-74d7bf09-4c31-49f0-b7cd-499452a43d7f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:46.626138 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-74d7bf09-4c31-49f0-b7cd-499452a43d7f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:46.769668 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-74d7bf09-4c31-49f0-b7cd-499452a43d7f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:46.782666 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-74d7bf09-4c31-49f0-b7cd-499452a43d7f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.170041 Jul 26 07:43:46.783539 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 742/1532] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:46 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:46.819467 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7b8180e2-f510-40af-9001-dc4bcbcb6609 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:46.820082 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7b8180e2-f510-40af-9001-dc4bcbcb6609 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:46.826508 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7b8180e2-f510-40af-9001-dc4bcbcb6609 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:46.826950 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7b8180e2-f510-40af-9001-dc4bcbcb6609 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:46.827704 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7b8180e2-f510-40af-9001-dc4bcbcb6609 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:46.828129 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7b8180e2-f510-40af-9001-dc4bcbcb6609 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:46.962802 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7b8180e2-f510-40af-9001-dc4bcbcb6609 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:46.971233 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7b8180e2-f510-40af-9001-dc4bcbcb6609 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.155662 Jul 26 07:43:46.971814 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 791/1533] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:46 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:47.495764 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-017e2644-40fb-4cec-a1e0-aacc7d09afbf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:47.496406 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-017e2644-40fb-4cec-a1e0-aacc7d09afbf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:47.503297 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-017e2644-40fb-4cec-a1e0-aacc7d09afbf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:47.503747 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-017e2644-40fb-4cec-a1e0-aacc7d09afbf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:47.504503 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-017e2644-40fb-4cec-a1e0-aacc7d09afbf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:47.504937 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-017e2644-40fb-4cec-a1e0-aacc7d09afbf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:47.577884 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-017e2644-40fb-4cec-a1e0-aacc7d09afbf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:47.590930 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-017e2644-40fb-4cec-a1e0-aacc7d09afbf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:47.592715 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-017e2644-40fb-4cec-a1e0-aacc7d09afbf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:47.594383 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-017e2644-40fb-4cec-a1e0-aacc7d09afbf tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.102432 Jul 26 07:43:47.595102 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 743/1534] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:47 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:47.808101 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-751157f3-d0c5-415b-b94f-c70ee83b9bcb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:47.808746 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-751157f3-d0c5-415b-b94f-c70ee83b9bcb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:47.815773 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-751157f3-d0c5-415b-b94f-c70ee83b9bcb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:47.816215 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-751157f3-d0c5-415b-b94f-c70ee83b9bcb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:47.817003 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-751157f3-d0c5-415b-b94f-c70ee83b9bcb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:47.817427 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-751157f3-d0c5-415b-b94f-c70ee83b9bcb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:47.955580 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-751157f3-d0c5-415b-b94f-c70ee83b9bcb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:47.964119 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-751157f3-d0c5-415b-b94f-c70ee83b9bcb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.160734 Jul 26 07:43:47.964730 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 792/1535] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:47 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:47.995184 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-16438459-4236-4679-8002-e31f0794b510 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:47.995742 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-16438459-4236-4679-8002-e31f0794b510 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:48.002588 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-16438459-4236-4679-8002-e31f0794b510 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:48.003033 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-16438459-4236-4679-8002-e31f0794b510 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:48.003813 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-16438459-4236-4679-8002-e31f0794b510 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:48.004335 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-16438459-4236-4679-8002-e31f0794b510 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:48.139576 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-16438459-4236-4679-8002-e31f0794b510 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:48.147544 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-16438459-4236-4679-8002-e31f0794b510 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.157671 Jul 26 07:43:48.148109 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 744/1536] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:47 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:48.620278 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6e56d1c1-f801-435d-ba0a-a598a5a80869 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:48.620888 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-6e56d1c1-f801-435d-ba0a-a598a5a80869 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:48.627410 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6e56d1c1-f801-435d-ba0a-a598a5a80869 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:48.627853 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6e56d1c1-f801-435d-ba0a-a598a5a80869 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:48.628604 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6e56d1c1-f801-435d-ba0a-a598a5a80869 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:48.629037 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6e56d1c1-f801-435d-ba0a-a598a5a80869 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:48.706249 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-6e56d1c1-f801-435d-ba0a-a598a5a80869 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:48.717084 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-6e56d1c1-f801-435d-ba0a-a598a5a80869 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:48.718624 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-6e56d1c1-f801-435d-ba0a-a598a5a80869 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:48.719787 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6e56d1c1-f801-435d-ba0a-a598a5a80869 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.103825 Jul 26 07:43:48.720341 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 793/1537] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:48 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:48.996292 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-cc9e64ea-c594-4f1a-98f7-3dc5e5926962 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:48.996872 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-cc9e64ea-c594-4f1a-98f7-3dc5e5926962 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:49.006843 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cc9e64ea-c594-4f1a-98f7-3dc5e5926962 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:49.007400 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cc9e64ea-c594-4f1a-98f7-3dc5e5926962 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:49.008520 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cc9e64ea-c594-4f1a-98f7-3dc5e5926962 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:49.008952 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cc9e64ea-c594-4f1a-98f7-3dc5e5926962 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:49.150694 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-cc9e64ea-c594-4f1a-98f7-3dc5e5926962 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:49.158935 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-cc9e64ea-c594-4f1a-98f7-3dc5e5926962 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.168907 Jul 26 07:43:49.159514 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 745/1538] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:48 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:49.168531 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-51369860-aae2-48f7-b1b4-7464ed229ae7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:49.169141 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-51369860-aae2-48f7-b1b4-7464ed229ae7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:49.176322 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-51369860-aae2-48f7-b1b4-7464ed229ae7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:49.176771 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-51369860-aae2-48f7-b1b4-7464ed229ae7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:49.177551 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-51369860-aae2-48f7-b1b4-7464ed229ae7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:49.178016 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-51369860-aae2-48f7-b1b4-7464ed229ae7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:49.333858 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-51369860-aae2-48f7-b1b4-7464ed229ae7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:49.343033 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-51369860-aae2-48f7-b1b4-7464ed229ae7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.177762 Jul 26 07:43:49.343033 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 794/1539] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:49 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:49.745578 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-3d9925df-07d8-4927-a982-d853408280bc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:49.746260 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-3d9925df-07d8-4927-a982-d853408280bc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:49.755673 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3d9925df-07d8-4927-a982-d853408280bc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:49.756205 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3d9925df-07d8-4927-a982-d853408280bc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:49.757306 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3d9925df-07d8-4927-a982-d853408280bc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:49.757950 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3d9925df-07d8-4927-a982-d853408280bc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:49.819254 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-3d9925df-07d8-4927-a982-d853408280bc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:49.828189 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-3d9925df-07d8-4927-a982-d853408280bc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:49.830263 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-3d9925df-07d8-4927-a982-d853408280bc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:49.831398 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-3d9925df-07d8-4927-a982-d853408280bc tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.092187 Jul 26 07:43:49.831954 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 746/1540] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:49 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:50.180719 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d16a4c98-ab51-4a58-8a04-36becf439bc0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:50.181536 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d16a4c98-ab51-4a58-8a04-36becf439bc0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:50.188426 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d16a4c98-ab51-4a58-8a04-36becf439bc0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:50.188876 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d16a4c98-ab51-4a58-8a04-36becf439bc0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:50.189650 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d16a4c98-ab51-4a58-8a04-36becf439bc0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:50.190122 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d16a4c98-ab51-4a58-8a04-36becf439bc0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:50.335740 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d16a4c98-ab51-4a58-8a04-36becf439bc0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:50.344452 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d16a4c98-ab51-4a58-8a04-36becf439bc0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.167784 Jul 26 07:43:50.345034 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 795/1541] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:50 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:50.370129 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-1713f6ec-0bb5-4ce2-8898-a7443f1531bb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:50.370864 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-1713f6ec-0bb5-4ce2-8898-a7443f1531bb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:50.377695 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1713f6ec-0bb5-4ce2-8898-a7443f1531bb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:50.378174 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1713f6ec-0bb5-4ce2-8898-a7443f1531bb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:50.378933 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1713f6ec-0bb5-4ce2-8898-a7443f1531bb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:50.379356 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1713f6ec-0bb5-4ce2-8898-a7443f1531bb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:50.518167 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-1713f6ec-0bb5-4ce2-8898-a7443f1531bb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:50.526596 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-1713f6ec-0bb5-4ce2-8898-a7443f1531bb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.160443 Jul 26 07:43:50.527135 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 747/1542] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:50 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:50.856639 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d3fc1245-faed-486d-9327-bf2192dbd945 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:50.857448 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d3fc1245-faed-486d-9327-bf2192dbd945 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:50.866692 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d3fc1245-faed-486d-9327-bf2192dbd945 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:50.867252 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d3fc1245-faed-486d-9327-bf2192dbd945 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:50.868236 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d3fc1245-faed-486d-9327-bf2192dbd945 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:50.868698 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d3fc1245-faed-486d-9327-bf2192dbd945 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:50.931676 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d3fc1245-faed-486d-9327-bf2192dbd945 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:50.940384 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d3fc1245-faed-486d-9327-bf2192dbd945 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:50.941914 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d3fc1245-faed-486d-9327-bf2192dbd945 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:50.943063 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d3fc1245-faed-486d-9327-bf2192dbd945 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.092264 Jul 26 07:43:50.943623 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 796/1543] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:50 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:51.370619 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-4963ac68-a11f-4bc9-ad5e-5548b2ac3ddb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:51.371660 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-4963ac68-a11f-4bc9-ad5e-5548b2ac3ddb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:51.382383 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4963ac68-a11f-4bc9-ad5e-5548b2ac3ddb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:51.383115 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4963ac68-a11f-4bc9-ad5e-5548b2ac3ddb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:51.384147 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4963ac68-a11f-4bc9-ad5e-5548b2ac3ddb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:51.384581 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4963ac68-a11f-4bc9-ad5e-5548b2ac3ddb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:51.531468 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-4963ac68-a11f-4bc9-ad5e-5548b2ac3ddb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:51.540073 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-4963ac68-a11f-4bc9-ad5e-5548b2ac3ddb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.176059 Jul 26 07:43:51.540678 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 748/1544] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:51 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:51.551701 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-88a1a6e2-b15c-4964-bb71-32e5a0a3e0df tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:51.552344 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-88a1a6e2-b15c-4964-bb71-32e5a0a3e0df tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:51.560399 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-88a1a6e2-b15c-4964-bb71-32e5a0a3e0df tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:51.560845 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-88a1a6e2-b15c-4964-bb71-32e5a0a3e0df tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:51.561599 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-88a1a6e2-b15c-4964-bb71-32e5a0a3e0df tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:51.562066 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-88a1a6e2-b15c-4964-bb71-32e5a0a3e0df tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:51.697821 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-88a1a6e2-b15c-4964-bb71-32e5a0a3e0df tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:51.710261 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-88a1a6e2-b15c-4964-bb71-32e5a0a3e0df tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.164271 Jul 26 07:43:51.710861 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 797/1545] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:51 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:51.968340 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-335a061c-597f-4284-9678-204f50bd452e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:51.968984 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-335a061c-597f-4284-9678-204f50bd452e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:51.977326 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-335a061c-597f-4284-9678-204f50bd452e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:51.977781 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-335a061c-597f-4284-9678-204f50bd452e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:51.978577 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-335a061c-597f-4284-9678-204f50bd452e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:51.979012 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-335a061c-597f-4284-9678-204f50bd452e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:52.054351 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-335a061c-597f-4284-9678-204f50bd452e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:52.063433 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-335a061c-597f-4284-9678-204f50bd452e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:52.064919 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-335a061c-597f-4284-9678-204f50bd452e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:52.066114 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-335a061c-597f-4284-9678-204f50bd452e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.102943 Jul 26 07:43:52.066677 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 749/1546] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:51 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:52.571109 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9b0d8c91-3901-4ae8-bc6a-20d38fd6b113 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:52.571717 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-9b0d8c91-3901-4ae8-bc6a-20d38fd6b113 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:52.578715 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9b0d8c91-3901-4ae8-bc6a-20d38fd6b113 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:52.579139 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9b0d8c91-3901-4ae8-bc6a-20d38fd6b113 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:52.580283 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9b0d8c91-3901-4ae8-bc6a-20d38fd6b113 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:52.580710 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9b0d8c91-3901-4ae8-bc6a-20d38fd6b113 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:52.713597 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-9b0d8c91-3901-4ae8-bc6a-20d38fd6b113 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:52.722021 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-9b0d8c91-3901-4ae8-bc6a-20d38fd6b113 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.157728 Jul 26 07:43:52.722594 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 798/1547] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:52 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:52.737641 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8085e8a4-05ed-42b5-bd10-007cc369e045 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:52.738274 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8085e8a4-05ed-42b5-bd10-007cc369e045 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:52.748660 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8085e8a4-05ed-42b5-bd10-007cc369e045 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:52.749274 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8085e8a4-05ed-42b5-bd10-007cc369e045 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:52.750402 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8085e8a4-05ed-42b5-bd10-007cc369e045 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:52.750856 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8085e8a4-05ed-42b5-bd10-007cc369e045 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:52.882362 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8085e8a4-05ed-42b5-bd10-007cc369e045 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:52.891054 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8085e8a4-05ed-42b5-bd10-007cc369e045 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.162634 Jul 26 07:43:52.891620 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 750/1548] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:52 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:53.090337 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-814a287b-3152-4e5f-83b9-8d4d2ac5729b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:53.091295 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-814a287b-3152-4e5f-83b9-8d4d2ac5729b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:53.100782 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-814a287b-3152-4e5f-83b9-8d4d2ac5729b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:53.101338 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-814a287b-3152-4e5f-83b9-8d4d2ac5729b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:53.102141 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-814a287b-3152-4e5f-83b9-8d4d2ac5729b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:53.102656 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-814a287b-3152-4e5f-83b9-8d4d2ac5729b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:53.167961 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-814a287b-3152-4e5f-83b9-8d4d2ac5729b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:53.176568 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-814a287b-3152-4e5f-83b9-8d4d2ac5729b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:53.178088 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-814a287b-3152-4e5f-83b9-8d4d2ac5729b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:53.179253 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-814a287b-3152-4e5f-83b9-8d4d2ac5729b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.093612 Jul 26 07:43:53.179814 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 799/1549] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:53 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:53.744137 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-456acb74-452a-4093-bcdb-a4bcb6203f37 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:53.744727 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-456acb74-452a-4093-bcdb-a4bcb6203f37 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:53.752071 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-456acb74-452a-4093-bcdb-a4bcb6203f37 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:53.752518 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-456acb74-452a-4093-bcdb-a4bcb6203f37 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:53.753283 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-456acb74-452a-4093-bcdb-a4bcb6203f37 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:53.753709 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-456acb74-452a-4093-bcdb-a4bcb6203f37 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:53.905884 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-456acb74-452a-4093-bcdb-a4bcb6203f37 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:53.912505 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ef8b61c5-b2ab-44a3-b71d-dccdb984c684 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:53.913126 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ef8b61c5-b2ab-44a3-b71d-dccdb984c684 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:53.914309 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-456acb74-452a-4093-bcdb-a4bcb6203f37 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.174235 Jul 26 07:43:53.915034 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 751/1550] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:53 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:53.920082 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef8b61c5-b2ab-44a3-b71d-dccdb984c684 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:53.920528 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef8b61c5-b2ab-44a3-b71d-dccdb984c684 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:53.921287 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef8b61c5-b2ab-44a3-b71d-dccdb984c684 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:53.921727 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef8b61c5-b2ab-44a3-b71d-dccdb984c684 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:54.059869 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ef8b61c5-b2ab-44a3-b71d-dccdb984c684 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:54.071838 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ef8b61c5-b2ab-44a3-b71d-dccdb984c684 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.162910 Jul 26 07:43:54.072687 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 800/1551] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:53 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:54.203383 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9c3c3ed9-3f5e-43a8-92c7-a6604677a02f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:54.203981 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-9c3c3ed9-3f5e-43a8-92c7-a6604677a02f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:54.211037 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9c3c3ed9-3f5e-43a8-92c7-a6604677a02f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:54.211475 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9c3c3ed9-3f5e-43a8-92c7-a6604677a02f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:54.212227 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9c3c3ed9-3f5e-43a8-92c7-a6604677a02f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:54.212647 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9c3c3ed9-3f5e-43a8-92c7-a6604677a02f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:54.216600 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:43:54.275281 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-9c3c3ed9-3f5e-43a8-92c7-a6604677a02f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:54.283781 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-9c3c3ed9-3f5e-43a8-92c7-a6604677a02f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:54.285249 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-9c3c3ed9-3f5e-43a8-92c7-a6604677a02f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:54.286420 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-9c3c3ed9-3f5e-43a8-92c7-a6604677a02f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.087048 Jul 26 07:43:54.286981 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 752/1552] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:54 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:54.939591 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d8bb6812-3296-4d49-98bf-249638049aff tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:54.940440 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d8bb6812-3296-4d49-98bf-249638049aff tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:54.949557 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d8bb6812-3296-4d49-98bf-249638049aff tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:54.950037 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d8bb6812-3296-4d49-98bf-249638049aff tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:54.950783 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d8bb6812-3296-4d49-98bf-249638049aff tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:54.951191 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d8bb6812-3296-4d49-98bf-249638049aff tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:55.089804 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d8bb6812-3296-4d49-98bf-249638049aff tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:55.093570 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:43:55.094142 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7c51e08e-b29b-4a9d-9610-43dcd379901c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:55.094844 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7c51e08e-b29b-4a9d-9610-43dcd379901c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:55.097348 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=64 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:43:55.098971 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d8bb6812-3296-4d49-98bf-249638049aff tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.165729 Jul 26 07:43:55.099565 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 801/1553] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:54 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:55.103065 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7c51e08e-b29b-4a9d-9610-43dcd379901c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:55.103505 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7c51e08e-b29b-4a9d-9610-43dcd379901c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:55.104278 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7c51e08e-b29b-4a9d-9610-43dcd379901c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:55.104708 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7c51e08e-b29b-4a9d-9610-43dcd379901c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:55.250380 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7c51e08e-b29b-4a9d-9610-43dcd379901c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:55.258309 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7c51e08e-b29b-4a9d-9610-43dcd379901c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.168314 Jul 26 07:43:55.258849 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 753/1554] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:55 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:55.310459 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ab8767ac-07e5-42aa-9c89-7e38089cd902 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:55.311058 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ab8767ac-07e5-42aa-9c89-7e38089cd902 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:55.313214 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:43:55.319510 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ab8767ac-07e5-42aa-9c89-7e38089cd902 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:55.319950 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ab8767ac-07e5-42aa-9c89-7e38089cd902 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:55.320706 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ab8767ac-07e5-42aa-9c89-7e38089cd902 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:55.321132 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ab8767ac-07e5-42aa-9c89-7e38089cd902 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:55.383888 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ab8767ac-07e5-42aa-9c89-7e38089cd902 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:55.392536 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ab8767ac-07e5-42aa-9c89-7e38089cd902 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:55.394049 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ab8767ac-07e5-42aa-9c89-7e38089cd902 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:55.395188 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ab8767ac-07e5-42aa-9c89-7e38089cd902 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.089483 Jul 26 07:43:55.395744 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 802/1555] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:55 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:56.121029 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f603c874-e60c-43ee-930b-126e8ec23572 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:56.121644 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-f603c874-e60c-43ee-930b-126e8ec23572 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:56.127985 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f603c874-e60c-43ee-930b-126e8ec23572 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:56.128432 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f603c874-e60c-43ee-930b-126e8ec23572 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:56.129323 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f603c874-e60c-43ee-930b-126e8ec23572 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:56.129773 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f603c874-e60c-43ee-930b-126e8ec23572 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:56.269802 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-f603c874-e60c-43ee-930b-126e8ec23572 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:56.278914 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f603c874-e60c-43ee-930b-126e8ec23572 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.162221 Jul 26 07:43:56.279141 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-840d404d-9814-4710-9ff8-641c38357808 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:56.279632 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 754/1556] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:56 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:56.279738 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-840d404d-9814-4710-9ff8-641c38357808 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:56.286592 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-840d404d-9814-4710-9ff8-641c38357808 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:56.287103 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-840d404d-9814-4710-9ff8-641c38357808 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:56.287948 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-840d404d-9814-4710-9ff8-641c38357808 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:56.288444 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-840d404d-9814-4710-9ff8-641c38357808 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:56.418159 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a494f196-b26e-4d61-8b0b-2a87d2a3d490 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:56.418770 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a494f196-b26e-4d61-8b0b-2a87d2a3d490 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:56.421886 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-840d404d-9814-4710-9ff8-641c38357808 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:56.425175 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a494f196-b26e-4d61-8b0b-2a87d2a3d490 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:56.425622 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a494f196-b26e-4d61-8b0b-2a87d2a3d490 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:56.426440 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a494f196-b26e-4d61-8b0b-2a87d2a3d490 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:56.426856 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a494f196-b26e-4d61-8b0b-2a87d2a3d490 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:56.430551 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-840d404d-9814-4710-9ff8-641c38357808 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.155269 Jul 26 07:43:56.432436 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 803/1557] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:56 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:56.493465 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a494f196-b26e-4d61-8b0b-2a87d2a3d490 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:56.502552 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a494f196-b26e-4d61-8b0b-2a87d2a3d490 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:56.504019 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a494f196-b26e-4d61-8b0b-2a87d2a3d490 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:56.505165 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a494f196-b26e-4d61-8b0b-2a87d2a3d490 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.091163 Jul 26 07:43:56.505711 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 755/1558] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:56 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:57.299438 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-01278400-5da5-4a59-bbf1-e91020f795ee tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:57.300022 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-01278400-5da5-4a59-bbf1-e91020f795ee tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:57.307270 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-01278400-5da5-4a59-bbf1-e91020f795ee tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:57.307713 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-01278400-5da5-4a59-bbf1-e91020f795ee tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:57.308514 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-01278400-5da5-4a59-bbf1-e91020f795ee tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:57.308943 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-01278400-5da5-4a59-bbf1-e91020f795ee tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:57.450502 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-01278400-5da5-4a59-bbf1-e91020f795ee tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:57.452515 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-4f1a0703-b6e4-4db2-94de-d8f4c41ee8a5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:57.453010 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-4f1a0703-b6e4-4db2-94de-d8f4c41ee8a5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:57.459468 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-01278400-5da5-4a59-bbf1-e91020f795ee tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.163995 Jul 26 07:43:57.459898 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4f1a0703-b6e4-4db2-94de-d8f4c41ee8a5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:57.460053 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 804/1559] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:57 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:57.460314 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4f1a0703-b6e4-4db2-94de-d8f4c41ee8a5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:57.461093 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4f1a0703-b6e4-4db2-94de-d8f4c41ee8a5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:57.461502 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4f1a0703-b6e4-4db2-94de-d8f4c41ee8a5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:57.533120 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-59576d6a-4415-45fa-9c3e-3cdd990de617 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:57.534428 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-59576d6a-4415-45fa-9c3e-3cdd990de617 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:57.540531 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-59576d6a-4415-45fa-9c3e-3cdd990de617 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:57.540975 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-59576d6a-4415-45fa-9c3e-3cdd990de617 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:57.541733 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-59576d6a-4415-45fa-9c3e-3cdd990de617 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:57.542200 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-59576d6a-4415-45fa-9c3e-3cdd990de617 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:57.594851 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-4f1a0703-b6e4-4db2-94de-d8f4c41ee8a5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:57.603048 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-4f1a0703-b6e4-4db2-94de-d8f4c41ee8a5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.154695 Jul 26 07:43:57.603667 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 756/1560] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:57 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:57.603853 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-59576d6a-4415-45fa-9c3e-3cdd990de617 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:57.612453 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-59576d6a-4415-45fa-9c3e-3cdd990de617 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:57.613949 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-59576d6a-4415-45fa-9c3e-3cdd990de617 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:57.615184 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-59576d6a-4415-45fa-9c3e-3cdd990de617 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.087778 Jul 26 07:43:57.615716 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 805/1561] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:57 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:58.481188 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-59078062-c679-435f-a412-97902d56fdb8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:58.481781 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-59078062-c679-435f-a412-97902d56fdb8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:58.488877 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-59078062-c679-435f-a412-97902d56fdb8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:58.489328 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-59078062-c679-435f-a412-97902d56fdb8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:58.490131 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-59078062-c679-435f-a412-97902d56fdb8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:58.490559 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-59078062-c679-435f-a412-97902d56fdb8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:58.624665 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-5fc4bf21-cbd2-4cbe-bcaa-63741cfff472 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:58.625289 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-5fc4bf21-cbd2-4cbe-bcaa-63741cfff472 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:58.628435 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-59078062-c679-435f-a412-97902d56fdb8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:58.632171 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5fc4bf21-cbd2-4cbe-bcaa-63741cfff472 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:58.632703 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5fc4bf21-cbd2-4cbe-bcaa-63741cfff472 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:58.633868 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5fc4bf21-cbd2-4cbe-bcaa-63741cfff472 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:58.634344 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5fc4bf21-cbd2-4cbe-bcaa-63741cfff472 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:58.637000 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-59078062-c679-435f-a412-97902d56fdb8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.159732 Jul 26 07:43:58.637571 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 757/1562] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:58 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:58.643099 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d4967c1e-5dbc-4c19-aa38-b4a337b5f10e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:58.643950 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d4967c1e-5dbc-4c19-aa38-b4a337b5f10e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:58.650204 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d4967c1e-5dbc-4c19-aa38-b4a337b5f10e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:58.650646 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d4967c1e-5dbc-4c19-aa38-b4a337b5f10e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:58.651408 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d4967c1e-5dbc-4c19-aa38-b4a337b5f10e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:58.651990 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d4967c1e-5dbc-4c19-aa38-b4a337b5f10e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:58.721758 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d4967c1e-5dbc-4c19-aa38-b4a337b5f10e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:58.731158 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d4967c1e-5dbc-4c19-aa38-b4a337b5f10e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:58.732674 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d4967c1e-5dbc-4c19-aa38-b4a337b5f10e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:58.733865 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d4967c1e-5dbc-4c19-aa38-b4a337b5f10e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.095340 Jul 26 07:43:58.734464 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 758/1563] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:58 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:58.804687 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-5fc4bf21-cbd2-4cbe-bcaa-63741cfff472 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:58.813908 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-5fc4bf21-cbd2-4cbe-bcaa-63741cfff472 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.193255 Jul 26 07:43:58.814476 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 806/1564] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:58 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:59.662983 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-fdd5a151-385b-497b-9bfe-05968664562b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:59.663841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-fdd5a151-385b-497b-9bfe-05968664562b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:59.672156 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fdd5a151-385b-497b-9bfe-05968664562b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:59.672607 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fdd5a151-385b-497b-9bfe-05968664562b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:59.673378 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fdd5a151-385b-497b-9bfe-05968664562b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:59.673845 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fdd5a151-385b-497b-9bfe-05968664562b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:59.768370 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6ae19b08-2e14-4a70-926b-6c90a785a89b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:59.768997 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-6ae19b08-2e14-4a70-926b-6c90a785a89b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:59.775963 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6ae19b08-2e14-4a70-926b-6c90a785a89b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:59.776398 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6ae19b08-2e14-4a70-926b-6c90a785a89b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:59.777230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6ae19b08-2e14-4a70-926b-6c90a785a89b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:59.777664 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6ae19b08-2e14-4a70-926b-6c90a785a89b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:59.814435 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-fdd5a151-385b-497b-9bfe-05968664562b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:59.825171 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-fdd5a151-385b-497b-9bfe-05968664562b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.168508 Jul 26 07:43:59.825793 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 759/1565] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:59 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:43:59.835714 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2150558a-0447-4b2f-9fd9-4118f12b5bfa tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:43:59.836631 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2150558a-0447-4b2f-9fd9-4118f12b5bfa tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:43:59.843098 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2150558a-0447-4b2f-9fd9-4118f12b5bfa tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:59.843541 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2150558a-0447-4b2f-9fd9-4118f12b5bfa tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:59.844181 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-6ae19b08-2e14-4a70-926b-6c90a785a89b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:59.844357 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2150558a-0447-4b2f-9fd9-4118f12b5bfa tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:43:59.844704 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2150558a-0447-4b2f-9fd9-4118f12b5bfa tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:43:59.852772 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-6ae19b08-2e14-4a70-926b-6c90a785a89b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:59.854281 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-6ae19b08-2e14-4a70-926b-6c90a785a89b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:59.855508 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6ae19b08-2e14-4a70-926b-6c90a785a89b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.091130 Jul 26 07:43:59.856064 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 807/1566] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:43:59 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:43:59.974582 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2150558a-0447-4b2f-9fd9-4118f12b5bfa tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:43:59.983249 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2150558a-0447-4b2f-9fd9-4118f12b5bfa tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.151685 Jul 26 07:43:59.983805 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 760/1567] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:43:59 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:44:00.847431 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-20a5d919-ff6c-4429-a5fd-55e18413da3d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:00.848044 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-20a5d919-ff6c-4429-a5fd-55e18413da3d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:00.854968 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-20a5d919-ff6c-4429-a5fd-55e18413da3d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:00.855415 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-20a5d919-ff6c-4429-a5fd-55e18413da3d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:00.856197 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-20a5d919-ff6c-4429-a5fd-55e18413da3d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:00.856627 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-20a5d919-ff6c-4429-a5fd-55e18413da3d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:00.878504 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-bf669f54-ec71-4be1-b52c-413fa9ba7099 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:00.879200 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-bf669f54-ec71-4be1-b52c-413fa9ba7099 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:00.886259 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bf669f54-ec71-4be1-b52c-413fa9ba7099 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:00.886704 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bf669f54-ec71-4be1-b52c-413fa9ba7099 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:00.887513 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bf669f54-ec71-4be1-b52c-413fa9ba7099 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:00.887962 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bf669f54-ec71-4be1-b52c-413fa9ba7099 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:00.949658 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-bf669f54-ec71-4be1-b52c-413fa9ba7099 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:00.959806 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-bf669f54-ec71-4be1-b52c-413fa9ba7099 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:00.961287 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-bf669f54-ec71-4be1-b52c-413fa9ba7099 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:00.962467 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-bf669f54-ec71-4be1-b52c-413fa9ba7099 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.087963 Jul 26 07:44:00.963300 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 761/1568] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:00 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:00.988866 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-20a5d919-ff6c-4429-a5fd-55e18413da3d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:00.999663 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-20a5d919-ff6c-4429-a5fd-55e18413da3d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.156212 Jul 26 07:44:01.000229 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 808/1569] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:00 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:01.004554 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-28e60201-6007-4eb4-9832-334726fb1899 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:01.005205 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-28e60201-6007-4eb4-9832-334726fb1899 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:01.011387 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-28e60201-6007-4eb4-9832-334726fb1899 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:01.011868 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-28e60201-6007-4eb4-9832-334726fb1899 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:01.012627 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-28e60201-6007-4eb4-9832-334726fb1899 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:01.013063 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-28e60201-6007-4eb4-9832-334726fb1899 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:01.158884 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-28e60201-6007-4eb4-9832-334726fb1899 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:01.167577 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-28e60201-6007-4eb4-9832-334726fb1899 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.166857 Jul 26 07:44:01.168244 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 762/1570] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:00 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:01.989418 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d1eac04d-d0e8-4f48-a5b1-75c4148bb22d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:01.990097 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d1eac04d-d0e8-4f48-a5b1-75c4148bb22d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:01.999789 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d1eac04d-d0e8-4f48-a5b1-75c4148bb22d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:02.000232 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d1eac04d-d0e8-4f48-a5b1-75c4148bb22d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:02.001321 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d1eac04d-d0e8-4f48-a5b1-75c4148bb22d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:02.001884 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d1eac04d-d0e8-4f48-a5b1-75c4148bb22d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:02.020935 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-01a77eee-04a4-4103-b76b-fad5fd5522f4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:02.021525 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-01a77eee-04a4-4103-b76b-fad5fd5522f4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:02.028514 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-01a77eee-04a4-4103-b76b-fad5fd5522f4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:02.028959 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-01a77eee-04a4-4103-b76b-fad5fd5522f4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:02.029715 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-01a77eee-04a4-4103-b76b-fad5fd5522f4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:02.030177 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-01a77eee-04a4-4103-b76b-fad5fd5522f4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:02.173381 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-01a77eee-04a4-4103-b76b-fad5fd5522f4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:02.182049 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-01a77eee-04a4-4103-b76b-fad5fd5522f4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.165067 Jul 26 07:44:02.182618 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 763/1571] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:02 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:44:02.197304 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9f515844-7689-49ae-9573-9a86d676a01d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:02.197966 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-9f515844-7689-49ae-9573-9a86d676a01d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:02.204812 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9f515844-7689-49ae-9573-9a86d676a01d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:02.205263 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9f515844-7689-49ae-9573-9a86d676a01d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:02.206272 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9f515844-7689-49ae-9573-9a86d676a01d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:02.206703 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9f515844-7689-49ae-9573-9a86d676a01d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:02.348087 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-9f515844-7689-49ae-9573-9a86d676a01d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:02.356569 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-9f515844-7689-49ae-9573-9a86d676a01d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.164597 Jul 26 07:44:02.357190 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 764/1572] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:02 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:02.362272 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d1eac04d-d0e8-4f48-a5b1-75c4148bb22d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:02.371365 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d1eac04d-d0e8-4f48-a5b1-75c4148bb22d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:02.372806 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d1eac04d-d0e8-4f48-a5b1-75c4148bb22d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:02.375198 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d1eac04d-d0e8-4f48-a5b1-75c4148bb22d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.390785 Jul 26 07:44:02.375198 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 809/1573] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:01 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:03.206877 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-45e5c56b-0b88-496e-b454-494b10c29451 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:03.207550 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-45e5c56b-0b88-496e-b454-494b10c29451 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:03.215533 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-45e5c56b-0b88-496e-b454-494b10c29451 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:03.215976 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-45e5c56b-0b88-496e-b454-494b10c29451 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:03.216737 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-45e5c56b-0b88-496e-b454-494b10c29451 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:03.217171 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-45e5c56b-0b88-496e-b454-494b10c29451 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:03.357177 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-45e5c56b-0b88-496e-b454-494b10c29451 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:03.368433 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-45e5c56b-0b88-496e-b454-494b10c29451 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.166395 Jul 26 07:44:03.369311 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 765/1574] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:03 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:03.378478 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6dbcc82c-6f4a-43a7-b18e-b685429d7073 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:03.379092 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-6dbcc82c-6f4a-43a7-b18e-b685429d7073 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:03.385855 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6dbcc82c-6f4a-43a7-b18e-b685429d7073 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:03.386313 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6dbcc82c-6f4a-43a7-b18e-b685429d7073 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:03.387131 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6dbcc82c-6f4a-43a7-b18e-b685429d7073 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:03.387677 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6dbcc82c-6f4a-43a7-b18e-b685429d7073 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:03.402386 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-565bb18b-4c81-4fcb-9de3-4420cde1e460 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:03.403014 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-565bb18b-4c81-4fcb-9de3-4420cde1e460 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:03.409159 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-565bb18b-4c81-4fcb-9de3-4420cde1e460 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:03.409609 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-565bb18b-4c81-4fcb-9de3-4420cde1e460 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:03.410466 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-565bb18b-4c81-4fcb-9de3-4420cde1e460 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:03.410875 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-565bb18b-4c81-4fcb-9de3-4420cde1e460 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:03.475237 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-565bb18b-4c81-4fcb-9de3-4420cde1e460 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:03.484321 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-565bb18b-4c81-4fcb-9de3-4420cde1e460 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:03.485842 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-565bb18b-4c81-4fcb-9de3-4420cde1e460 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:03.487042 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-565bb18b-4c81-4fcb-9de3-4420cde1e460 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.088604 Jul 26 07:44:03.487567 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 766/1575] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:03 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 07:44:03.516823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-6dbcc82c-6f4a-43a7-b18e-b685429d7073 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:03.524871 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6dbcc82c-6f4a-43a7-b18e-b685429d7073 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.150346 Jul 26 07:44:03.525440 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 810/1576] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:03 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:04.393081 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-73363d0c-20c1-4899-a6e0-f4fd98e21f5a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:04.393808 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-73363d0c-20c1-4899-a6e0-f4fd98e21f5a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:04.402822 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-73363d0c-20c1-4899-a6e0-f4fd98e21f5a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:04.403421 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-73363d0c-20c1-4899-a6e0-f4fd98e21f5a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:04.404390 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-73363d0c-20c1-4899-a6e0-f4fd98e21f5a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:04.404975 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-73363d0c-20c1-4899-a6e0-f4fd98e21f5a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:04.510077 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b6e9bddb-6b5b-46cb-b27d-43817d364db2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:04.510679 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b6e9bddb-6b5b-46cb-b27d-43817d364db2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:04.517757 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b6e9bddb-6b5b-46cb-b27d-43817d364db2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:04.518218 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b6e9bddb-6b5b-46cb-b27d-43817d364db2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:04.519239 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b6e9bddb-6b5b-46cb-b27d-43817d364db2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:04.519380 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b6e9bddb-6b5b-46cb-b27d-43817d364db2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:04.554183 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-73363d0c-20c1-4899-a6e0-f4fd98e21f5a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:04.562735 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-73363d0c-20c1-4899-a6e0-f4fd98e21f5a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.175035 Jul 26 07:44:04.563335 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 767/1577] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:04 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:04.567746 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-422957b7-ce29-48a1-aa9c-c970fce22230 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:04.568353 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-422957b7-ce29-48a1-aa9c-c970fce22230 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:04.574551 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-422957b7-ce29-48a1-aa9c-c970fce22230 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:04.574996 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-422957b7-ce29-48a1-aa9c-c970fce22230 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:04.575758 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-422957b7-ce29-48a1-aa9c-c970fce22230 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:04.576179 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-422957b7-ce29-48a1-aa9c-c970fce22230 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:04.585807 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-b6e9bddb-6b5b-46cb-b27d-43817d364db2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:04.594667 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-b6e9bddb-6b5b-46cb-b27d-43817d364db2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:04.596177 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-b6e9bddb-6b5b-46cb-b27d-43817d364db2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:04.597325 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b6e9bddb-6b5b-46cb-b27d-43817d364db2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.091256 Jul 26 07:44:04.598205 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 811/1578] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:04 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:04.726083 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-422957b7-ce29-48a1-aa9c-c970fce22230 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:04.731269 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:04.738822 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-422957b7-ce29-48a1-aa9c-c970fce22230 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.174498 Jul 26 07:44:04.745849 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 768/1579] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:04 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:05.587415 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c6128fcd-0c83-4f65-a4b1-679a0646e21b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:05.588157 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c6128fcd-0c83-4f65-a4b1-679a0646e21b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:05.597064 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c6128fcd-0c83-4f65-a4b1-679a0646e21b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:05.597675 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c6128fcd-0c83-4f65-a4b1-679a0646e21b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:05.598713 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c6128fcd-0c83-4f65-a4b1-679a0646e21b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:05.599282 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c6128fcd-0c83-4f65-a4b1-679a0646e21b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:05.620151 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7aa8bccc-ef0b-4e7b-8ae8-c5a375ce2856 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:05.620754 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7aa8bccc-ef0b-4e7b-8ae8-c5a375ce2856 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:05.627525 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7aa8bccc-ef0b-4e7b-8ae8-c5a375ce2856 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:05.627964 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7aa8bccc-ef0b-4e7b-8ae8-c5a375ce2856 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:05.628700 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7aa8bccc-ef0b-4e7b-8ae8-c5a375ce2856 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:05.629159 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7aa8bccc-ef0b-4e7b-8ae8-c5a375ce2856 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:05.696508 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7aa8bccc-ef0b-4e7b-8ae8-c5a375ce2856 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:05.705993 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7aa8bccc-ef0b-4e7b-8ae8-c5a375ce2856 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:05.707480 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7aa8bccc-ef0b-4e7b-8ae8-c5a375ce2856 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:05.708643 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7aa8bccc-ef0b-4e7b-8ae8-c5a375ce2856 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.092663 Jul 26 07:44:05.709201 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 769/1580] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:05 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:05.736382 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c6128fcd-0c83-4f65-a4b1-679a0646e21b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:05.748506 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c6128fcd-0c83-4f65-a4b1-679a0646e21b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.166291 Jul 26 07:44:05.749288 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 812/1581] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:05 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:05.768645 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-aacbd8da-4e71-4152-96c0-61b1a93d0319 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:05.769259 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-aacbd8da-4e71-4152-96c0-61b1a93d0319 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:05.775763 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-aacbd8da-4e71-4152-96c0-61b1a93d0319 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:05.776219 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-aacbd8da-4e71-4152-96c0-61b1a93d0319 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:05.776975 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-aacbd8da-4e71-4152-96c0-61b1a93d0319 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:05.777456 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-aacbd8da-4e71-4152-96c0-61b1a93d0319 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:05.924586 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-aacbd8da-4e71-4152-96c0-61b1a93d0319 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:05.932784 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-aacbd8da-4e71-4152-96c0-61b1a93d0319 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.168097 Jul 26 07:44:05.933337 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 770/1582] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:05 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:06.733694 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c7fbfa0e-d22b-4d82-9574-0c9d9a2a7b97 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:06.734293 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c7fbfa0e-d22b-4d82-9574-0c9d9a2a7b97 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:06.743113 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c7fbfa0e-d22b-4d82-9574-0c9d9a2a7b97 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:06.743561 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c7fbfa0e-d22b-4d82-9574-0c9d9a2a7b97 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:06.744353 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c7fbfa0e-d22b-4d82-9574-0c9d9a2a7b97 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:06.744784 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c7fbfa0e-d22b-4d82-9574-0c9d9a2a7b97 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:06.772591 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0f34571e-8ef6-4105-b3d7-cfac533cd420 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:06.773225 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0f34571e-8ef6-4105-b3d7-cfac533cd420 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:06.780232 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0f34571e-8ef6-4105-b3d7-cfac533cd420 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:06.780699 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0f34571e-8ef6-4105-b3d7-cfac533cd420 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:06.781469 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0f34571e-8ef6-4105-b3d7-cfac533cd420 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:06.781946 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0f34571e-8ef6-4105-b3d7-cfac533cd420 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:06.807017 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c7fbfa0e-d22b-4d82-9574-0c9d9a2a7b97 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:06.816142 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c7fbfa0e-d22b-4d82-9574-0c9d9a2a7b97 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:06.817643 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c7fbfa0e-d22b-4d82-9574-0c9d9a2a7b97 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:06.818826 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c7fbfa0e-d22b-4d82-9574-0c9d9a2a7b97 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.091339 Jul 26 07:44:06.819393 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 813/1583] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:06 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:06.914521 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0f34571e-8ef6-4105-b3d7-cfac533cd420 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:06.927077 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0f34571e-8ef6-4105-b3d7-cfac533cd420 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.158102 Jul 26 07:44:06.927910 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 771/1584] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:06 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:06.954220 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-1b928f53-0572-4ed6-a242-992bbd056478 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:06.955216 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-1b928f53-0572-4ed6-a242-992bbd056478 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:06.961619 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1b928f53-0572-4ed6-a242-992bbd056478 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:06.962093 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1b928f53-0572-4ed6-a242-992bbd056478 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:06.962877 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1b928f53-0572-4ed6-a242-992bbd056478 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:06.963303 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1b928f53-0572-4ed6-a242-992bbd056478 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:07.092988 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-1b928f53-0572-4ed6-a242-992bbd056478 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:07.101085 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-1b928f53-0572-4ed6-a242-992bbd056478 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.150724 Jul 26 07:44:07.101654 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 814/1585] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:06 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:07.846061 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-4bd1f9c9-cc1f-4763-b4eb-1299e6480f63 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:07.846945 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-4bd1f9c9-cc1f-4763-b4eb-1299e6480f63 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:07.857596 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4bd1f9c9-cc1f-4763-b4eb-1299e6480f63 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:07.858079 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4bd1f9c9-cc1f-4763-b4eb-1299e6480f63 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:07.858845 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4bd1f9c9-cc1f-4763-b4eb-1299e6480f63 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:07.859276 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4bd1f9c9-cc1f-4763-b4eb-1299e6480f63 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:07.932847 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-4bd1f9c9-cc1f-4763-b4eb-1299e6480f63 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:07.943544 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-4bd1f9c9-cc1f-4763-b4eb-1299e6480f63 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:07.945034 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-4bd1f9c9-cc1f-4763-b4eb-1299e6480f63 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:07.946223 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-4bd1f9c9-cc1f-4763-b4eb-1299e6480f63 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.106333 Jul 26 07:44:07.946918 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 772/1586] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:07 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:07.948923 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f8806f8f-a8fb-45e8-a274-0bd0f251dc89 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:07.949634 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f8806f8f-a8fb-45e8-a274-0bd0f251dc89 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:07.957797 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f8806f8f-a8fb-45e8-a274-0bd0f251dc89 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:07.958273 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f8806f8f-a8fb-45e8-a274-0bd0f251dc89 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:07.959057 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f8806f8f-a8fb-45e8-a274-0bd0f251dc89 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:07.959488 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f8806f8f-a8fb-45e8-a274-0bd0f251dc89 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:08.098767 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f8806f8f-a8fb-45e8-a274-0bd0f251dc89 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:08.106982 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f8806f8f-a8fb-45e8-a274-0bd0f251dc89 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.162358 Jul 26 07:44:08.107701 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 815/1587] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:07 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:44:08.122243 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a67c8434-ac42-47ce-860a-a016de60608f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:08.122854 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a67c8434-ac42-47ce-860a-a016de60608f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:08.129571 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a67c8434-ac42-47ce-860a-a016de60608f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:08.130039 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a67c8434-ac42-47ce-860a-a016de60608f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:08.130877 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a67c8434-ac42-47ce-860a-a016de60608f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:08.132225 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a67c8434-ac42-47ce-860a-a016de60608f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:08.269890 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a67c8434-ac42-47ce-860a-a016de60608f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:08.277974 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a67c8434-ac42-47ce-860a-a016de60608f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.159530 Jul 26 07:44:08.278547 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 773/1588] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:08 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:08.971674 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6032940e-6453-44c4-9039-09acefcfac86 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:08.972297 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-6032940e-6453-44c4-9039-09acefcfac86 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:08.979471 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6032940e-6453-44c4-9039-09acefcfac86 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:08.979913 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6032940e-6453-44c4-9039-09acefcfac86 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:08.980677 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6032940e-6453-44c4-9039-09acefcfac86 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:08.981102 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6032940e-6453-44c4-9039-09acefcfac86 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:09.045666 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-6032940e-6453-44c4-9039-09acefcfac86 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:09.054816 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-6032940e-6453-44c4-9039-09acefcfac86 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:09.056326 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-6032940e-6453-44c4-9039-09acefcfac86 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:09.057470 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6032940e-6453-44c4-9039-09acefcfac86 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.089803 Jul 26 07:44:09.058060 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 816/1589] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:08 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:09.129842 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-64cf0945-6d3e-4c17-9287-97d6ff74b16b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:09.130581 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-64cf0945-6d3e-4c17-9287-97d6ff74b16b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:09.140951 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-64cf0945-6d3e-4c17-9287-97d6ff74b16b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:09.141558 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-64cf0945-6d3e-4c17-9287-97d6ff74b16b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:09.142719 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-64cf0945-6d3e-4c17-9287-97d6ff74b16b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:09.143349 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-64cf0945-6d3e-4c17-9287-97d6ff74b16b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:09.290199 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-64cf0945-6d3e-4c17-9287-97d6ff74b16b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:09.298424 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-64cf0945-6d3e-4c17-9287-97d6ff74b16b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.174434 Jul 26 07:44:09.299015 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 774/1590] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:09 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:09.299373 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c51729f1-478f-4bbd-88e7-4e9b5f1d8186 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:09.300055 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c51729f1-478f-4bbd-88e7-4e9b5f1d8186 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:09.306087 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c51729f1-478f-4bbd-88e7-4e9b5f1d8186 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:09.306525 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c51729f1-478f-4bbd-88e7-4e9b5f1d8186 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:09.307281 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c51729f1-478f-4bbd-88e7-4e9b5f1d8186 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:09.307707 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c51729f1-478f-4bbd-88e7-4e9b5f1d8186 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:09.446260 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c51729f1-478f-4bbd-88e7-4e9b5f1d8186 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:09.455166 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c51729f1-478f-4bbd-88e7-4e9b5f1d8186 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.159613 Jul 26 07:44:09.455746 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 817/1591] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:09 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:44:10.081279 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f80932ac-7a9c-4600-bf4c-90b8b2b0f5c2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:10.081918 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-f80932ac-7a9c-4600-bf4c-90b8b2b0f5c2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:10.088875 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f80932ac-7a9c-4600-bf4c-90b8b2b0f5c2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:10.089320 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f80932ac-7a9c-4600-bf4c-90b8b2b0f5c2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:10.090130 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f80932ac-7a9c-4600-bf4c-90b8b2b0f5c2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:10.090555 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f80932ac-7a9c-4600-bf4c-90b8b2b0f5c2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:10.154866 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-f80932ac-7a9c-4600-bf4c-90b8b2b0f5c2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:10.163438 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-f80932ac-7a9c-4600-bf4c-90b8b2b0f5c2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:10.164913 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-f80932ac-7a9c-4600-bf4c-90b8b2b0f5c2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:10.166116 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f80932ac-7a9c-4600-bf4c-90b8b2b0f5c2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.089263 Jul 26 07:44:10.166665 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 775/1592] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:10 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:10.320431 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-895145d5-8ded-42d1-a1d5-6f632230404d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:10.321038 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-895145d5-8ded-42d1-a1d5-6f632230404d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:10.328283 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-895145d5-8ded-42d1-a1d5-6f632230404d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:10.328740 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-895145d5-8ded-42d1-a1d5-6f632230404d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:10.329898 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-895145d5-8ded-42d1-a1d5-6f632230404d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:10.330328 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-895145d5-8ded-42d1-a1d5-6f632230404d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:10.349525 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:10.474634 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-895145d5-8ded-42d1-a1d5-6f632230404d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:10.476582 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-4947342f-e50a-49d1-93eb-2e84ac1c8d5e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:10.477181 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-4947342f-e50a-49d1-93eb-2e84ac1c8d5e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:10.483225 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-895145d5-8ded-42d1-a1d5-6f632230404d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.166833 Jul 26 07:44:10.483381 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4947342f-e50a-49d1-93eb-2e84ac1c8d5e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:10.483987 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4947342f-e50a-49d1-93eb-2e84ac1c8d5e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:10.484113 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 818/1593] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:10 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:10.484637 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4947342f-e50a-49d1-93eb-2e84ac1c8d5e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:10.485073 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4947342f-e50a-49d1-93eb-2e84ac1c8d5e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:10.634108 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-4947342f-e50a-49d1-93eb-2e84ac1c8d5e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:10.642693 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-4947342f-e50a-49d1-93eb-2e84ac1c8d5e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.170030 Jul 26 07:44:10.643304 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 776/1594] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:10 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:11.197379 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-058ad524-780a-4202-a081-09ac012e8c66 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:11.198404 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-058ad524-780a-4202-a081-09ac012e8c66 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:11.207251 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-058ad524-780a-4202-a081-09ac012e8c66 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:11.207702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-058ad524-780a-4202-a081-09ac012e8c66 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:11.208624 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-058ad524-780a-4202-a081-09ac012e8c66 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:11.209234 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-058ad524-780a-4202-a081-09ac012e8c66 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:11.276661 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-058ad524-780a-4202-a081-09ac012e8c66 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:11.286329 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-058ad524-780a-4202-a081-09ac012e8c66 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:11.287801 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-058ad524-780a-4202-a081-09ac012e8c66 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:11.288948 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-058ad524-780a-4202-a081-09ac012e8c66 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.095850 Jul 26 07:44:11.289492 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 819/1595] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:11 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:11.508277 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7458e770-61ed-48eb-a360-c7e9e8e6e19e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:11.508838 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7458e770-61ed-48eb-a360-c7e9e8e6e19e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:11.515954 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7458e770-61ed-48eb-a360-c7e9e8e6e19e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:11.516393 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7458e770-61ed-48eb-a360-c7e9e8e6e19e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:11.517152 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7458e770-61ed-48eb-a360-c7e9e8e6e19e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:11.517573 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7458e770-61ed-48eb-a360-c7e9e8e6e19e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:11.657845 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7458e770-61ed-48eb-a360-c7e9e8e6e19e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:11.664199 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-2bb5eb3a-7e6e-41b9-bbb6-a9b95c781082 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:11.664765 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2bb5eb3a-7e6e-41b9-bbb6-a9b95c781082 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:11.666377 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7458e770-61ed-48eb-a360-c7e9e8e6e19e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.165313 Jul 26 07:44:11.666962 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 777/1596] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:11 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:11.671538 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2bb5eb3a-7e6e-41b9-bbb6-a9b95c781082 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:11.671971 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2bb5eb3a-7e6e-41b9-bbb6-a9b95c781082 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:11.672741 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2bb5eb3a-7e6e-41b9-bbb6-a9b95c781082 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:11.673171 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2bb5eb3a-7e6e-41b9-bbb6-a9b95c781082 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:11.811786 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2bb5eb3a-7e6e-41b9-bbb6-a9b95c781082 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:11.824452 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-2bb5eb3a-7e6e-41b9-bbb6-a9b95c781082 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.163393 Jul 26 07:44:11.825253 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 820/1597] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:11 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:44:12.320156 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6796c77d-525e-4af2-94ae-190c428b3ff9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:12.320761 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6796c77d-525e-4af2-94ae-190c428b3ff9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:12.327594 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6796c77d-525e-4af2-94ae-190c428b3ff9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:12.328009 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6796c77d-525e-4af2-94ae-190c428b3ff9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:12.328766 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6796c77d-525e-4af2-94ae-190c428b3ff9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:12.329549 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6796c77d-525e-4af2-94ae-190c428b3ff9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:12.393682 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6796c77d-525e-4af2-94ae-190c428b3ff9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:12.402771 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6796c77d-525e-4af2-94ae-190c428b3ff9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:12.404253 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6796c77d-525e-4af2-94ae-190c428b3ff9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:12.405392 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6796c77d-525e-4af2-94ae-190c428b3ff9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.089335 Jul 26 07:44:12.406235 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 778/1598] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:12 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:12.688853 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-71398fc1-8e38-4dac-a035-d215ad4065fc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:12.689462 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-71398fc1-8e38-4dac-a035-d215ad4065fc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:12.696139 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-71398fc1-8e38-4dac-a035-d215ad4065fc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:12.696583 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-71398fc1-8e38-4dac-a035-d215ad4065fc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:12.697341 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-71398fc1-8e38-4dac-a035-d215ad4065fc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:12.697776 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-71398fc1-8e38-4dac-a035-d215ad4065fc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:12.843674 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-71398fc1-8e38-4dac-a035-d215ad4065fc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:12.846049 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8950c11a-f71f-4db0-a59b-a213cf4f5e76 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:12.846766 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8950c11a-f71f-4db0-a59b-a213cf4f5e76 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:12.853391 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8950c11a-f71f-4db0-a59b-a213cf4f5e76 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:12.854695 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8950c11a-f71f-4db0-a59b-a213cf4f5e76 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:12.854856 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-71398fc1-8e38-4dac-a035-d215ad4065fc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.170421 Jul 26 07:44:12.854972 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8950c11a-f71f-4db0-a59b-a213cf4f5e76 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:12.855252 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 821/1599] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:12 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:12.855403 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8950c11a-f71f-4db0-a59b-a213cf4f5e76 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:12.984737 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8950c11a-f71f-4db0-a59b-a213cf4f5e76 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:12.992815 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8950c11a-f71f-4db0-a59b-a213cf4f5e76 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.150714 Jul 26 07:44:12.993387 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 779/1600] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:12 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:13.435381 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7e0720c4-0099-495e-a42b-d15a57f29c76 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:13.436023 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7e0720c4-0099-495e-a42b-d15a57f29c76 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:13.442975 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7e0720c4-0099-495e-a42b-d15a57f29c76 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:13.443416 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7e0720c4-0099-495e-a42b-d15a57f29c76 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:13.444185 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7e0720c4-0099-495e-a42b-d15a57f29c76 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:13.444610 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7e0720c4-0099-495e-a42b-d15a57f29c76 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:13.506297 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7e0720c4-0099-495e-a42b-d15a57f29c76 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:13.515137 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7e0720c4-0099-495e-a42b-d15a57f29c76 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:13.516625 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7e0720c4-0099-495e-a42b-d15a57f29c76 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:13.517766 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7e0720c4-0099-495e-a42b-d15a57f29c76 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.087333 Jul 26 07:44:13.518306 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 822/1601] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:13 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:13.878670 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-1202aa54-b367-41cd-b204-dc06db410ff7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:13.879420 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-1202aa54-b367-41cd-b204-dc06db410ff7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:13.888709 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1202aa54-b367-41cd-b204-dc06db410ff7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:13.889319 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1202aa54-b367-41cd-b204-dc06db410ff7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:13.890567 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1202aa54-b367-41cd-b204-dc06db410ff7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:13.890994 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1202aa54-b367-41cd-b204-dc06db410ff7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:14.014187 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-2c0ad695-b53a-44b6-837a-98676eb08924 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:14.014842 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2c0ad695-b53a-44b6-837a-98676eb08924 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:14.022226 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2c0ad695-b53a-44b6-837a-98676eb08924 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:14.022688 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2c0ad695-b53a-44b6-837a-98676eb08924 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:14.023418 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2c0ad695-b53a-44b6-837a-98676eb08924 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:14.024834 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2c0ad695-b53a-44b6-837a-98676eb08924 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:14.030841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-1202aa54-b367-41cd-b204-dc06db410ff7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:14.039002 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-1202aa54-b367-41cd-b204-dc06db410ff7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.165619 Jul 26 07:44:14.039539 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 780/1602] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:13 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:14.162678 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2c0ad695-b53a-44b6-837a-98676eb08924 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:14.171155 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-2c0ad695-b53a-44b6-837a-98676eb08924 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.160976 Jul 26 07:44:14.171743 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 823/1603] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:14 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:44:14.542673 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d3adaca9-4fa4-4c76-b39e-47ee675727f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:14.543499 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d3adaca9-4fa4-4c76-b39e-47ee675727f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:14.550989 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d3adaca9-4fa4-4c76-b39e-47ee675727f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:14.551431 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d3adaca9-4fa4-4c76-b39e-47ee675727f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:14.552218 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d3adaca9-4fa4-4c76-b39e-47ee675727f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:14.552646 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d3adaca9-4fa4-4c76-b39e-47ee675727f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:14.627245 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d3adaca9-4fa4-4c76-b39e-47ee675727f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:14.636139 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d3adaca9-4fa4-4c76-b39e-47ee675727f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:14.637617 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d3adaca9-4fa4-4c76-b39e-47ee675727f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:14.638794 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d3adaca9-4fa4-4c76-b39e-47ee675727f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.101411 Jul 26 07:44:14.639358 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 781/1604] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:14 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:15.061530 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-522e34c6-434c-4fb3-b314-60787bd4b2f6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:15.062175 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-522e34c6-434c-4fb3-b314-60787bd4b2f6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:15.069168 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-522e34c6-434c-4fb3-b314-60787bd4b2f6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:15.069613 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-522e34c6-434c-4fb3-b314-60787bd4b2f6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:15.070408 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-522e34c6-434c-4fb3-b314-60787bd4b2f6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:15.070837 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-522e34c6-434c-4fb3-b314-60787bd4b2f6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:15.192175 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-5f3bb322-c690-49a4-ae55-8862f1734418 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:15.192765 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-5f3bb322-c690-49a4-ae55-8862f1734418 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:15.199814 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5f3bb322-c690-49a4-ae55-8862f1734418 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:15.200275 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5f3bb322-c690-49a4-ae55-8862f1734418 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:15.201043 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5f3bb322-c690-49a4-ae55-8862f1734418 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:15.201476 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5f3bb322-c690-49a4-ae55-8862f1734418 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:15.211904 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-522e34c6-434c-4fb3-b314-60787bd4b2f6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:15.220352 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-522e34c6-434c-4fb3-b314-60787bd4b2f6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.163390 Jul 26 07:44:15.220981 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 824/1605] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:15 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:15.336282 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-5f3bb322-c690-49a4-ae55-8862f1734418 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:15.344440 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-5f3bb322-c690-49a4-ae55-8862f1734418 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.156291 Jul 26 07:44:15.345017 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 782/1606] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:15 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:15.668833 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ab1db734-e1d8-43e2-9f07-721f29edaba9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:15.669548 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ab1db734-e1d8-43e2-9f07-721f29edaba9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:15.678588 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ab1db734-e1d8-43e2-9f07-721f29edaba9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:15.679121 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ab1db734-e1d8-43e2-9f07-721f29edaba9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:15.680191 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ab1db734-e1d8-43e2-9f07-721f29edaba9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:15.680769 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ab1db734-e1d8-43e2-9f07-721f29edaba9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:15.744990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ab1db734-e1d8-43e2-9f07-721f29edaba9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:15.754117 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ab1db734-e1d8-43e2-9f07-721f29edaba9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:15.755607 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ab1db734-e1d8-43e2-9f07-721f29edaba9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:15.756755 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ab1db734-e1d8-43e2-9f07-721f29edaba9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.093983 Jul 26 07:44:15.757313 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 825/1607] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:15 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:16.242232 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-84b7c147-c15e-46a4-a644-d56ffd348c95 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:16.242854 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-84b7c147-c15e-46a4-a644-d56ffd348c95 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:16.249585 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-84b7c147-c15e-46a4-a644-d56ffd348c95 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:16.250069 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-84b7c147-c15e-46a4-a644-d56ffd348c95 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:16.250825 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-84b7c147-c15e-46a4-a644-d56ffd348c95 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:16.251259 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-84b7c147-c15e-46a4-a644-d56ffd348c95 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:16.367167 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-145084f4-9846-41e1-a8ae-a514ec79ce37 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:16.367997 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-145084f4-9846-41e1-a8ae-a514ec79ce37 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:16.375341 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-145084f4-9846-41e1-a8ae-a514ec79ce37 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:16.376098 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-145084f4-9846-41e1-a8ae-a514ec79ce37 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:16.376903 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-145084f4-9846-41e1-a8ae-a514ec79ce37 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:16.377333 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-145084f4-9846-41e1-a8ae-a514ec79ce37 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:16.386896 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-84b7c147-c15e-46a4-a644-d56ffd348c95 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:16.395089 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-84b7c147-c15e-46a4-a644-d56ffd348c95 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.156856 Jul 26 07:44:16.395758 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 783/1608] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:16 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:16.511515 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-145084f4-9846-41e1-a8ae-a514ec79ce37 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:16.523952 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-145084f4-9846-41e1-a8ae-a514ec79ce37 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.160781 Jul 26 07:44:16.524508 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 826/1609] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:16 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:16.784685 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-3a2ea97e-3558-4f84-a3c7-6af1429e5f30 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:16.785524 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-3a2ea97e-3558-4f84-a3c7-6af1429e5f30 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:16.795737 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3a2ea97e-3558-4f84-a3c7-6af1429e5f30 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:16.796473 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3a2ea97e-3558-4f84-a3c7-6af1429e5f30 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:16.797703 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3a2ea97e-3558-4f84-a3c7-6af1429e5f30 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:16.798459 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3a2ea97e-3558-4f84-a3c7-6af1429e5f30 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:16.865281 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-3a2ea97e-3558-4f84-a3c7-6af1429e5f30 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:16.878026 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-3a2ea97e-3558-4f84-a3c7-6af1429e5f30 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:16.880298 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-3a2ea97e-3558-4f84-a3c7-6af1429e5f30 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:16.882110 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-3a2ea97e-3558-4f84-a3c7-6af1429e5f30 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.104309 Jul 26 07:44:16.882841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 784/1610] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:16 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:17.418477 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f632feff-d4ef-4a6a-be56-c163e33c6d05 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:17.419109 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f632feff-d4ef-4a6a-be56-c163e33c6d05 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:17.427027 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f632feff-d4ef-4a6a-be56-c163e33c6d05 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:17.427506 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f632feff-d4ef-4a6a-be56-c163e33c6d05 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:17.428282 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f632feff-d4ef-4a6a-be56-c163e33c6d05 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:17.428732 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f632feff-d4ef-4a6a-be56-c163e33c6d05 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:17.544644 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f8a6fa2b-a01c-444d-b046-988747ee00f3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:17.545231 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-f8a6fa2b-a01c-444d-b046-988747ee00f3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:17.551920 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f8a6fa2b-a01c-444d-b046-988747ee00f3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:17.552363 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f8a6fa2b-a01c-444d-b046-988747ee00f3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:17.553147 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f8a6fa2b-a01c-444d-b046-988747ee00f3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:17.553569 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f8a6fa2b-a01c-444d-b046-988747ee00f3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:17.560190 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f632feff-d4ef-4a6a-be56-c163e33c6d05 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:17.568430 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f632feff-d4ef-4a6a-be56-c163e33c6d05 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.155286 Jul 26 07:44:17.569000 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 827/1611] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:17 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:17.573582 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:17.688319 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-f8a6fa2b-a01c-444d-b046-988747ee00f3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:17.700646 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f8a6fa2b-a01c-444d-b046-988747ee00f3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.159641 Jul 26 07:44:17.701421 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 785/1612] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:17 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:44:17.908361 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9c406a56-fdc6-40a5-8cbe-025a95f17a3d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:17.908988 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-9c406a56-fdc6-40a5-8cbe-025a95f17a3d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:17.915613 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9c406a56-fdc6-40a5-8cbe-025a95f17a3d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:17.916079 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9c406a56-fdc6-40a5-8cbe-025a95f17a3d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:17.916806 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9c406a56-fdc6-40a5-8cbe-025a95f17a3d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:17.917233 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9c406a56-fdc6-40a5-8cbe-025a95f17a3d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:17.987719 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-9c406a56-fdc6-40a5-8cbe-025a95f17a3d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:17.996669 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-9c406a56-fdc6-40a5-8cbe-025a95f17a3d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:17.998212 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-9c406a56-fdc6-40a5-8cbe-025a95f17a3d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:17.999403 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-9c406a56-fdc6-40a5-8cbe-025a95f17a3d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.096852 Jul 26 07:44:17.999978 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 828/1613] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:17 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:18.590422 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6310c726-186c-4b40-8b2e-89b394e22ab8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:18.591037 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6310c726-186c-4b40-8b2e-89b394e22ab8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:18.598127 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6310c726-186c-4b40-8b2e-89b394e22ab8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:18.598587 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6310c726-186c-4b40-8b2e-89b394e22ab8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:18.599345 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6310c726-186c-4b40-8b2e-89b394e22ab8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:18.599778 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6310c726-186c-4b40-8b2e-89b394e22ab8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:18.723939 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-06ddf71e-5e99-4513-a595-41f579ea4c8f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:18.724515 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-06ddf71e-5e99-4513-a595-41f579ea4c8f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:18.731883 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-06ddf71e-5e99-4513-a595-41f579ea4c8f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:18.732338 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-06ddf71e-5e99-4513-a595-41f579ea4c8f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:18.733072 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-06ddf71e-5e99-4513-a595-41f579ea4c8f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:18.733498 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-06ddf71e-5e99-4513-a595-41f579ea4c8f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:18.735832 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6310c726-186c-4b40-8b2e-89b394e22ab8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:18.744118 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6310c726-186c-4b40-8b2e-89b394e22ab8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.157675 Jul 26 07:44:18.744688 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 786/1614] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:18 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:18.867914 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-06ddf71e-5e99-4513-a595-41f579ea4c8f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:18.876616 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-06ddf71e-5e99-4513-a595-41f579ea4c8f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.156830 Jul 26 07:44:18.877189 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 829/1615] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:18 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:19.022830 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f675bea9-2d62-4520-8e06-c8f00c0fed50 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:19.023461 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-f675bea9-2d62-4520-8e06-c8f00c0fed50 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:19.030123 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f675bea9-2d62-4520-8e06-c8f00c0fed50 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:19.030566 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f675bea9-2d62-4520-8e06-c8f00c0fed50 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:19.031319 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f675bea9-2d62-4520-8e06-c8f00c0fed50 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:19.031744 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f675bea9-2d62-4520-8e06-c8f00c0fed50 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:19.107139 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-f675bea9-2d62-4520-8e06-c8f00c0fed50 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:19.117335 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-f675bea9-2d62-4520-8e06-c8f00c0fed50 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:19.118989 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-f675bea9-2d62-4520-8e06-c8f00c0fed50 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:19.120134 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f675bea9-2d62-4520-8e06-c8f00c0fed50 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.101326 Jul 26 07:44:19.120683 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 787/1616] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:19 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:19.769777 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b342c976-e061-4ffd-a435-1adf80789c61 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:19.770414 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b342c976-e061-4ffd-a435-1adf80789c61 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:19.777333 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b342c976-e061-4ffd-a435-1adf80789c61 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:19.777793 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b342c976-e061-4ffd-a435-1adf80789c61 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:19.778550 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b342c976-e061-4ffd-a435-1adf80789c61 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:19.778986 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b342c976-e061-4ffd-a435-1adf80789c61 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:19.898223 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ad227e6a-69d2-482d-9fb5-b8aca8ede666 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:19.898867 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ad227e6a-69d2-482d-9fb5-b8aca8ede666 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:19.905864 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ad227e6a-69d2-482d-9fb5-b8aca8ede666 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:19.906313 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ad227e6a-69d2-482d-9fb5-b8aca8ede666 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:19.907071 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ad227e6a-69d2-482d-9fb5-b8aca8ede666 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:19.907507 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ad227e6a-69d2-482d-9fb5-b8aca8ede666 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:19.907646 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-b342c976-e061-4ffd-a435-1adf80789c61 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:19.915945 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b342c976-e061-4ffd-a435-1adf80789c61 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.152255 Jul 26 07:44:19.916511 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 830/1617] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:19 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:20.034811 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ad227e6a-69d2-482d-9fb5-b8aca8ede666 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:20.043083 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ad227e6a-69d2-482d-9fb5-b8aca8ede666 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.148913 Jul 26 07:44:20.043695 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 788/1618] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:19 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:20.146089 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-dd9fcb17-3c46-42bd-b190-ebeb007afbea tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:20.146972 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-dd9fcb17-3c46-42bd-b190-ebeb007afbea tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:20.156304 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dd9fcb17-3c46-42bd-b190-ebeb007afbea tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:20.156898 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dd9fcb17-3c46-42bd-b190-ebeb007afbea tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:20.158067 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dd9fcb17-3c46-42bd-b190-ebeb007afbea tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:20.158685 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dd9fcb17-3c46-42bd-b190-ebeb007afbea tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:20.226437 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-dd9fcb17-3c46-42bd-b190-ebeb007afbea tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:20.235103 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-dd9fcb17-3c46-42bd-b190-ebeb007afbea tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:20.236567 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-dd9fcb17-3c46-42bd-b190-ebeb007afbea tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:20.237766 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-dd9fcb17-3c46-42bd-b190-ebeb007afbea tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.097462 Jul 26 07:44:20.238358 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 831/1619] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:20 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:20.939444 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-da4f6f35-2f77-4add-8a42-7e87da73ce12 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:20.940192 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-da4f6f35-2f77-4add-8a42-7e87da73ce12 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:20.947643 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-da4f6f35-2f77-4add-8a42-7e87da73ce12 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:20.948091 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-da4f6f35-2f77-4add-8a42-7e87da73ce12 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:20.948857 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-da4f6f35-2f77-4add-8a42-7e87da73ce12 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:20.949296 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-da4f6f35-2f77-4add-8a42-7e87da73ce12 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:21.071448 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f29bb254-04be-45b1-955d-8bddabf3d4b4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:21.072192 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f29bb254-04be-45b1-955d-8bddabf3d4b4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:21.078890 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f29bb254-04be-45b1-955d-8bddabf3d4b4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:21.079736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f29bb254-04be-45b1-955d-8bddabf3d4b4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:21.080681 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f29bb254-04be-45b1-955d-8bddabf3d4b4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:21.081128 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f29bb254-04be-45b1-955d-8bddabf3d4b4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:21.092480 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-da4f6f35-2f77-4add-8a42-7e87da73ce12 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:21.101751 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-da4f6f35-2f77-4add-8a42-7e87da73ce12 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.167914 Jul 26 07:44:21.114135 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 789/1620] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:20 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:21.159671 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7fa36446-29af-4739-9ff4-87e51bbdb5a2 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:21.160360 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7fa36446-29af-4739-9ff4-87e51bbdb5a2 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: f7e43c4a-c38a-4da6-9687-d675f7c28f9a] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:21.166721 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7fa36446-29af-4739-9ff4-87e51bbdb5a2 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:21.167168 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7fa36446-29af-4739-9ff4-87e51bbdb5a2 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:21.167936 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7fa36446-29af-4739-9ff4-87e51bbdb5a2 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:21.168365 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7fa36446-29af-4739-9ff4-87e51bbdb5a2 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:21.196516 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7fa36446-29af-4739-9ff4-87e51bbdb5a2 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: f7e43c4a-c38a-4da6-9687-d675f7c28f9a] Going to try to terminate instance {{(pid=117716) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 07:44:21.217814 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f29bb254-04be-45b1-955d-8bddabf3d4b4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:21.225873 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f29bb254-04be-45b1-955d-8bddabf3d4b4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.158668 Jul 26 07:44:21.226503 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 832/1621] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:21 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:21.260514 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a5811b76-7866-4f3b-bc8c-7594cb3fd886 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:21.261132 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a5811b76-7866-4f3b-bc8c-7594cb3fd886 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:21.273498 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a5811b76-7866-4f3b-bc8c-7594cb3fd886 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:21.273979 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a5811b76-7866-4f3b-bc8c-7594cb3fd886 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:21.274767 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a5811b76-7866-4f3b-bc8c-7594cb3fd886 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:21.274920 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7fa36446-29af-4739-9ff4-87e51bbdb5a2 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f7e43c4a-c38a-4da6-9687-d675f7c28f9a" status: 204 len: 0 microversion: 2.1 time: 0.118757 Jul 26 07:44:21.275214 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a5811b76-7866-4f3b-bc8c-7594cb3fd886 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:21.275678 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 790/1622] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Jul 26 07:44:21 2022] DELETE /compute/v2.1/servers/f7e43c4a-c38a-4da6-9687-d675f7c28f9a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 07:44:21.285864 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-475ea300-0541-4de6-8cb3-e8afbd006342 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:21.286566 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-475ea300-0541-4de6-8cb3-e8afbd006342 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: f7e43c4a-c38a-4da6-9687-d675f7c28f9a] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:21.292740 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-475ea300-0541-4de6-8cb3-e8afbd006342 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:21.293188 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-475ea300-0541-4de6-8cb3-e8afbd006342 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:21.293987 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-475ea300-0541-4de6-8cb3-e8afbd006342 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:21.294426 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-475ea300-0541-4de6-8cb3-e8afbd006342 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:21.340720 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-a5811b76-7866-4f3b-bc8c-7594cb3fd886 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:21.349292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-a5811b76-7866-4f3b-bc8c-7594cb3fd886 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:21.350798 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-a5811b76-7866-4f3b-bc8c-7594cb3fd886 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:21.351941 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a5811b76-7866-4f3b-bc8c-7594cb3fd886 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.095612 Jul 26 07:44:21.352496 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 833/1623] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:21 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:21.432855 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-475ea300-0541-4de6-8cb3-e8afbd006342 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:21.440637 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-475ea300-0541-4de6-8cb3-e8afbd006342 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/f7e43c4a-c38a-4da6-9687-d675f7c28f9a" status: 200 len: 1679 microversion: 2.1 time: 0.160184 Jul 26 07:44:21.441202 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 791/1624] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:21 2022] GET /compute/v2.1/servers/f7e43c4a-c38a-4da6-9687-d675f7c28f9a => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:22.123194 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a378b91f-d5e1-446e-a655-9ca52f7dc9b2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:22.123841 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a378b91f-d5e1-446e-a655-9ca52f7dc9b2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:22.130994 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a378b91f-d5e1-446e-a655-9ca52f7dc9b2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:22.131441 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a378b91f-d5e1-446e-a655-9ca52f7dc9b2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:22.132224 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a378b91f-d5e1-446e-a655-9ca52f7dc9b2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:22.132659 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a378b91f-d5e1-446e-a655-9ca52f7dc9b2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:22.247660 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-80c68629-af5f-422f-b4e6-bec5f2eba61b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:22.248233 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-80c68629-af5f-422f-b4e6-bec5f2eba61b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:22.255173 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-80c68629-af5f-422f-b4e6-bec5f2eba61b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:22.255587 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-80c68629-af5f-422f-b4e6-bec5f2eba61b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:22.256384 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-80c68629-af5f-422f-b4e6-bec5f2eba61b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:22.256804 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-80c68629-af5f-422f-b4e6-bec5f2eba61b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:22.273541 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-a378b91f-d5e1-446e-a655-9ca52f7dc9b2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:22.281830 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a378b91f-d5e1-446e-a655-9ca52f7dc9b2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.162468 Jul 26 07:44:22.285788 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 834/1625] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:22 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:22.375220 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-642a2385-8a8a-4f3e-a997-d276ae60d3c4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:22.375764 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-642a2385-8a8a-4f3e-a997-d276ae60d3c4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:22.387788 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-642a2385-8a8a-4f3e-a997-d276ae60d3c4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:22.388236 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-642a2385-8a8a-4f3e-a997-d276ae60d3c4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:22.389018 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-642a2385-8a8a-4f3e-a997-d276ae60d3c4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:22.389449 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-642a2385-8a8a-4f3e-a997-d276ae60d3c4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:22.393813 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:22.453151 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-642a2385-8a8a-4f3e-a997-d276ae60d3c4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:22.462798 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-642a2385-8a8a-4f3e-a997-d276ae60d3c4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:22.464323 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-642a2385-8a8a-4f3e-a997-d276ae60d3c4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:22.465462 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-642a2385-8a8a-4f3e-a997-d276ae60d3c4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.094712 Jul 26 07:44:22.466070 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 835/1626] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:22 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:22.470803 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-cd34f45d-4a56-4263-bed9-213dba8f8622 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:22.471433 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-cd34f45d-4a56-4263-bed9-213dba8f8622 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: f7e43c4a-c38a-4da6-9687-d675f7c28f9a] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:22.477890 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cd34f45d-4a56-4263-bed9-213dba8f8622 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:22.478528 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cd34f45d-4a56-4263-bed9-213dba8f8622 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:22.478777 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-80c68629-af5f-422f-b4e6-bec5f2eba61b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:22.479484 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cd34f45d-4a56-4263-bed9-213dba8f8622 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:22.479919 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cd34f45d-4a56-4263-bed9-213dba8f8622 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:22.493440 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-80c68629-af5f-422f-b4e6-bec5f2eba61b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.249088 Jul 26 07:44:22.498585 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 792/1627] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:22 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:44:22.631803 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-cd34f45d-4a56-4263-bed9-213dba8f8622 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57029844165f4d83892176fe82594685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa0c5574ef9497ebe29658f8164764c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:22.639693 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-cd34f45d-4a56-4263-bed9-213dba8f8622 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/f7e43c4a-c38a-4da6-9687-d675f7c28f9a" status: 200 len: 1679 microversion: 2.1 time: 0.172607 Jul 26 07:44:22.640338 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 836/1628] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:22 2022] GET /compute/v2.1/servers/f7e43c4a-c38a-4da6-9687-d675f7c28f9a => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:22.957416 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-2e1abc14-04b5-4f9b-b29d-19f9c39a70be req-db90872c-99e0-48cc-88f6-01cbe149438e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7e43c4a-c38a-4da6-9687-d675f7c28f9a", "name": "network-vif-deleted", "tag": "042cbb20-2361-409a-8c16-d2f29d1938f1"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:44:22.970631 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-2e1abc14-04b5-4f9b-b29d-19f9c39a70be req-db90872c-99e0-48cc-88f6-01cbe149438e service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:22.971475 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-2e1abc14-04b5-4f9b-b29d-19f9c39a70be req-db90872c-99e0-48cc-88f6-01cbe149438e service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:22.988733 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-2e1abc14-04b5-4f9b-b29d-19f9c39a70be req-db90872c-99e0-48cc-88f6-01cbe149438e service nova] Creating event network-vif-deleted:042cbb20-2361-409a-8c16-d2f29d1938f1 for instance f7e43c4a-c38a-4da6-9687-d675f7c28f9a on hv-cinder-85083 Jul 26 07:44:22.995254 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-2e1abc14-04b5-4f9b-b29d-19f9c39a70be req-db90872c-99e0-48cc-88f6-01cbe149438e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111524 Jul 26 07:44:22.996167 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 793/1629] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:44:23.303227 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8a44c11a-8cf7-4919-a4c5-9aa51ed313cc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:23.304678 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8a44c11a-8cf7-4919-a4c5-9aa51ed313cc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:23.311653 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8a44c11a-8cf7-4919-a4c5-9aa51ed313cc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:23.312125 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8a44c11a-8cf7-4919-a4c5-9aa51ed313cc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:23.312891 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8a44c11a-8cf7-4919-a4c5-9aa51ed313cc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:23.313346 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8a44c11a-8cf7-4919-a4c5-9aa51ed313cc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:23.468114 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8a44c11a-8cf7-4919-a4c5-9aa51ed313cc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:23.476637 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8a44c11a-8cf7-4919-a4c5-9aa51ed313cc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.177576 Jul 26 07:44:23.483292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 837/1630] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:23 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:23.491583 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f4f9f302-016d-4d08-85a7-02d49cfc4be1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:23.492325 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-f4f9f302-016d-4d08-85a7-02d49cfc4be1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:23.500697 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f4f9f302-016d-4d08-85a7-02d49cfc4be1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:23.501145 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f4f9f302-016d-4d08-85a7-02d49cfc4be1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:23.502049 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f4f9f302-016d-4d08-85a7-02d49cfc4be1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:23.502564 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f4f9f302-016d-4d08-85a7-02d49cfc4be1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:23.515312 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-5503697f-e4e1-4145-ab2c-046abc13ba92 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:23.515921 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-5503697f-e4e1-4145-ab2c-046abc13ba92 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:23.529353 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5503697f-e4e1-4145-ab2c-046abc13ba92 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:23.529814 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5503697f-e4e1-4145-ab2c-046abc13ba92 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:23.530589 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5503697f-e4e1-4145-ab2c-046abc13ba92 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:23.531024 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5503697f-e4e1-4145-ab2c-046abc13ba92 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:23.575758 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-f4f9f302-016d-4d08-85a7-02d49cfc4be1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:23.588115 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-f4f9f302-016d-4d08-85a7-02d49cfc4be1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:23.590016 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-f4f9f302-016d-4d08-85a7-02d49cfc4be1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:23.591415 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f4f9f302-016d-4d08-85a7-02d49cfc4be1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.106077 Jul 26 07:44:23.606284 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 794/1631] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:23 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:23.662934 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-e9b1dace-7257-4f12-8d45-00ef60c7fa1f tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:23.663455 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-e9b1dace-7257-4f12-8d45-00ef60c7fa1f tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: f7e43c4a-c38a-4da6-9687-d675f7c28f9a] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:23.673647 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e9b1dace-7257-4f12-8d45-00ef60c7fa1f tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:23.676556 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e9b1dace-7257-4f12-8d45-00ef60c7fa1f tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:23.677622 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e9b1dace-7257-4f12-8d45-00ef60c7fa1f tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:23.678255 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e9b1dace-7257-4f12-8d45-00ef60c7fa1f tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:23.695515 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.wsgi [None req-e9b1dace-7257-4f12-8d45-00ef60c7fa1f tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] HTTP exception thrown: Instance f7e43c4a-c38a-4da6-9687-d675f7c28f9a could not be found. Jul 26 07:44:23.697283 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-e9b1dace-7257-4f12-8d45-00ef60c7fa1f tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Request method failure captured: Jul 26 07:44:23.697283 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: request: GET /compute/v2.1/servers/f7e43c4a-c38a-4da6-9687-d675f7c28f9a HTTP/1.1 Jul 26 07:44:23.697283 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept: application/json Jul 26 07:44:23.697283 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept-Encoding: identity Jul 26 07:44:23.697283 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Connection: close Jul 26 07:44:23.697283 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Length: 0 Jul 26 07:44:23.697283 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Type: application/json Jul 26 07:44:23.697283 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Host: 10.222.0.39 Jul 26 07:44:23.697283 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Openstack-System-Scope: None Jul 26 07:44:23.697283 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: User-Agent: python-urllib3/1.26.10 Jul 26 07:44:23.697283 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Auth-Token: gAAAAABi35bp-6MDlHFX6PqBP1JfjI-kDaErGZ8tS4CYMVgobtb4Gv-rSD0l-rBJa-iOQtbMEcv7gnFG6FuqSpAXwRcnDvooOo8YQBTuYFKMeWkJlsSVbvRshSqswhfLq3PM2Jh4Afd8RHIhCtF_ajjZyUKtQPL35KmYg8DZArwcVpy_HW9N5Qc Jul 26 07:44:23.697283 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Id: None Jul 26 07:44:23.697283 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Name: None Jul 26 07:44:23.697283 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Identity-Status: Confirmed Jul 26 07:44:23.697283 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Is-Admin-Project: True Jul 26 07:44:23.697283 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Id: default Jul 26 07:44:23.697283 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Name: Default Jul 26 07:44:23.697283 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Id: 4fa0c5574ef9497ebe29658f8164764c Jul 26 07:44:23.697283 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Name: tempest-AttachVolumeNegativeTest-1485570437 Jul 26 07:44:23.697283 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Role: member,reader Jul 26 07:44:23.697283 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Roles: member,reader Jul 26 07:44:23.698956 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:44:23.698956 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant: tempest-AttachVolumeNegativeTest-1485570437 Jul 26 07:44:23.698956 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Id: 4fa0c5574ef9497ebe29658f8164764c Jul 26 07:44:23.698956 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1485570437 Jul 26 07:44:23.698956 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User: tempest-AttachVolumeNegativeTest-1485570437-project Jul 26 07:44:23.698956 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Id: default Jul 26 07:44:23.698956 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Name: Default Jul 26 07:44:23.698956 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Id: 57029844165f4d83892176fe82594685 Jul 26 07:44:23.698956 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Name: tempest-AttachVolumeNegativeTest-1485570437-project Jul 26 07:44:23.698956 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: method: > Jul 26 07:44:23.698956 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: exception: Instance f7e43c4a-c38a-4da6-9687-d675f7c28f9a could not be found. Jul 26 07:44:23.698956 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: action_args: {'id': 'f7e43c4a-c38a-4da6-9687-d675f7c28f9a'} Jul 26 07:44:23.699945 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:44:23.699945 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:44:23.699945 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 07:44:23.699945 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 07:44:23.699945 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 07:44:23.699945 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 07:44:23.699945 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 07:44:23.699945 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 07:44:23.699945 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 07:44:23.699945 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 07:44:23.699945 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7e43c4a-c38a-4da6-9687-d675f7c28f9a could not be found. Jul 26 07:44:23.699945 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:44:23.699945 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:44:23.699945 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:44:23.699945 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:44:23.699945 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:44:23.699945 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:44:23.699945 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:44:23.699945 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:44:23.699945 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:44:23.701635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:44:23.701635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 07:44:23.701635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 07:44:23.701635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 07:44:23.701635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 07:44:23.701635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 07:44:23.701635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:44:23.701635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7e43c4a-c38a-4da6-9687-d675f7c28f9a could not be found. Jul 26 07:44:23.701635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:44:23.701635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:44:23.701635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:44:23.701635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:44:23.701635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:44:23.701635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:44:23.701635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:44:23.701635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:44:23.701635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7e43c4a-c38a-4da6-9687-d675f7c28f9a could not be found. Jul 26 07:44:23.701635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:44:23.703085 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-e9b1dace-7257-4f12-8d45-00ef60c7fa1f tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Returning 404 to user: Instance f7e43c4a-c38a-4da6-9687-d675f7c28f9a could not be found. {{(pid=117716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:44:23.703085 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-e9b1dace-7257-4f12-8d45-00ef60c7fa1f tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/f7e43c4a-c38a-4da6-9687-d675f7c28f9a" status: 404 len: 111 microversion: 2.1 time: 0.041060 Jul 26 07:44:23.703085 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 795/1632] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:23 2022] GET /compute/v2.1/servers/f7e43c4a-c38a-4da6-9687-d675f7c28f9a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 07:44:23.703940 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-5503697f-e4e1-4145-ab2c-046abc13ba92 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:23.708398 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c9362261-6e0b-4a0b-83b2-3b349f17b22b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '.version_select at 0x7f7f06f4a0d0>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:23.714824 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-5503697f-e4e1-4145-ab2c-046abc13ba92 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.203288 Jul 26 07:44:23.715749 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 838/1633] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:23 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:44:23.737640 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c9362261-6e0b-4a0b-83b2-3b349f17b22b tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-419877874" status: 202 len: 0 microversion: 2.1 time: 0.033376 Jul 26 07:44:23.738796 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 796/1634] 10.222.0.39 () {58 vars in 1218 bytes} [Tue Jul 26 07:44:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-419877874 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 07:44:24.499482 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ba9800f1-a223-40c8-a830-69510515f87a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:24.500098 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ba9800f1-a223-40c8-a830-69510515f87a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:24.506929 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ba9800f1-a223-40c8-a830-69510515f87a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:24.507393 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ba9800f1-a223-40c8-a830-69510515f87a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:24.508125 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ba9800f1-a223-40c8-a830-69510515f87a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:24.508555 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ba9800f1-a223-40c8-a830-69510515f87a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:24.614681 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-71a6c5b9-bc41-49c5-bf2e-d596d26c39d3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:24.615377 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-71a6c5b9-bc41-49c5-bf2e-d596d26c39d3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:24.622356 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-71a6c5b9-bc41-49c5-bf2e-d596d26c39d3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:24.622792 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-71a6c5b9-bc41-49c5-bf2e-d596d26c39d3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:24.623544 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-71a6c5b9-bc41-49c5-bf2e-d596d26c39d3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:24.623995 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-71a6c5b9-bc41-49c5-bf2e-d596d26c39d3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:24.641510 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ba9800f1-a223-40c8-a830-69510515f87a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:24.649828 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ba9800f1-a223-40c8-a830-69510515f87a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.154389 Jul 26 07:44:24.650696 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 839/1635] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:24 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:24.686631 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-71a6c5b9-bc41-49c5-bf2e-d596d26c39d3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:24.695567 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-71a6c5b9-bc41-49c5-bf2e-d596d26c39d3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:24.697058 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-71a6c5b9-bc41-49c5-bf2e-d596d26c39d3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:24.698249 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-71a6c5b9-bc41-49c5-bf2e-d596d26c39d3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.088085 Jul 26 07:44:24.698803 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 797/1636] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:24 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 07:44:24.736683 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-28b40900-ee2f-4714-b283-b236b0dc74a0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:24.737289 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-28b40900-ee2f-4714-b283-b236b0dc74a0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:24.743991 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-28b40900-ee2f-4714-b283-b236b0dc74a0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:24.744442 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-28b40900-ee2f-4714-b283-b236b0dc74a0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:24.745201 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-28b40900-ee2f-4714-b283-b236b0dc74a0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:24.745663 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-28b40900-ee2f-4714-b283-b236b0dc74a0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:24.881556 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-28b40900-ee2f-4714-b283-b236b0dc74a0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:24.893522 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-28b40900-ee2f-4714-b283-b236b0dc74a0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.160406 Jul 26 07:44:24.894491 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 840/1637] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:24 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:25.672287 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7020a0f3-eab4-4b1e-afc0-382ba16c4ee4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:25.672998 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7020a0f3-eab4-4b1e-afc0-382ba16c4ee4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:25.675334 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:25.681098 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7020a0f3-eab4-4b1e-afc0-382ba16c4ee4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:25.681539 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7020a0f3-eab4-4b1e-afc0-382ba16c4ee4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:25.682438 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7020a0f3-eab4-4b1e-afc0-382ba16c4ee4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:25.682866 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7020a0f3-eab4-4b1e-afc0-382ba16c4ee4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:25.722156 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-4693373c-3228-4056-b9d5-72b6ed8c6a9d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:25.722798 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-4693373c-3228-4056-b9d5-72b6ed8c6a9d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:25.725247 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=78 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:25.731108 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4693373c-3228-4056-b9d5-72b6ed8c6a9d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:25.731556 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4693373c-3228-4056-b9d5-72b6ed8c6a9d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:25.732333 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4693373c-3228-4056-b9d5-72b6ed8c6a9d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:25.732747 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4693373c-3228-4056-b9d5-72b6ed8c6a9d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:25.796306 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-4693373c-3228-4056-b9d5-72b6ed8c6a9d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:25.805353 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-4693373c-3228-4056-b9d5-72b6ed8c6a9d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:25.806847 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-4693373c-3228-4056-b9d5-72b6ed8c6a9d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:25.808000 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-4693373c-3228-4056-b9d5-72b6ed8c6a9d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.089887 Jul 26 07:44:25.808589 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 841/1638] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:25 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:25.823156 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7020a0f3-eab4-4b1e-afc0-382ba16c4ee4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:25.831964 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7020a0f3-eab4-4b1e-afc0-382ba16c4ee4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.164123 Jul 26 07:44:25.832582 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 798/1639] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:25 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:25.919012 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-162b310e-2aac-4568-93d7-49864982445c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:25.919951 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-162b310e-2aac-4568-93d7-49864982445c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:25.929018 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-162b310e-2aac-4568-93d7-49864982445c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:25.929387 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-162b310e-2aac-4568-93d7-49864982445c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:25.930202 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-162b310e-2aac-4568-93d7-49864982445c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:25.930626 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-162b310e-2aac-4568-93d7-49864982445c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:26.081692 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-162b310e-2aac-4568-93d7-49864982445c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:26.090507 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-162b310e-2aac-4568-93d7-49864982445c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.178121 Jul 26 07:44:26.091079 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 842/1640] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:25 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:26.832595 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-103f1114-4cff-4873-8842-8266e711c3e6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:26.833226 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-103f1114-4cff-4873-8842-8266e711c3e6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:26.840331 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-103f1114-4cff-4873-8842-8266e711c3e6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:26.840773 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-103f1114-4cff-4873-8842-8266e711c3e6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:26.841521 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-103f1114-4cff-4873-8842-8266e711c3e6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:26.841989 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-103f1114-4cff-4873-8842-8266e711c3e6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:26.852818 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-bbe400b4-ab16-40a1-8cf7-742fe3dcbf68 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:26.853385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-bbe400b4-ab16-40a1-8cf7-742fe3dcbf68 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:26.860439 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bbe400b4-ab16-40a1-8cf7-742fe3dcbf68 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:26.860892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bbe400b4-ab16-40a1-8cf7-742fe3dcbf68 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:26.861660 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bbe400b4-ab16-40a1-8cf7-742fe3dcbf68 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:26.862116 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bbe400b4-ab16-40a1-8cf7-742fe3dcbf68 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:26.920645 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-103f1114-4cff-4873-8842-8266e711c3e6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:26.929367 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-103f1114-4cff-4873-8842-8266e711c3e6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:26.930898 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-103f1114-4cff-4873-8842-8266e711c3e6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:26.932020 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-103f1114-4cff-4873-8842-8266e711c3e6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.103891 Jul 26 07:44:26.932576 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 799/1641] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:26 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:27.000950 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-bbe400b4-ab16-40a1-8cf7-742fe3dcbf68 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:27.010571 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-bbe400b4-ab16-40a1-8cf7-742fe3dcbf68 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.161716 Jul 26 07:44:27.011166 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 843/1642] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:26 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:27.112197 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-1111c035-7a9c-4b49-a035-198a4bc5f9f5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:27.112725 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-1111c035-7a9c-4b49-a035-198a4bc5f9f5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:27.119539 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1111c035-7a9c-4b49-a035-198a4bc5f9f5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:27.119987 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1111c035-7a9c-4b49-a035-198a4bc5f9f5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:27.120737 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1111c035-7a9c-4b49-a035-198a4bc5f9f5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:27.121167 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1111c035-7a9c-4b49-a035-198a4bc5f9f5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:27.266876 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-1111c035-7a9c-4b49-a035-198a4bc5f9f5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:27.275538 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-1111c035-7a9c-4b49-a035-198a4bc5f9f5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.167370 Jul 26 07:44:27.276107 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 800/1643] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:27 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:27.959116 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6055f70a-bad8-4de6-90a7-b58a41c76474 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:27.959741 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-6055f70a-bad8-4de6-90a7-b58a41c76474 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:27.966690 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6055f70a-bad8-4de6-90a7-b58a41c76474 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:27.967112 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6055f70a-bad8-4de6-90a7-b58a41c76474 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:27.967892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6055f70a-bad8-4de6-90a7-b58a41c76474 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:27.968290 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6055f70a-bad8-4de6-90a7-b58a41c76474 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:28.033604 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-dc6c7e5a-f9ec-42e2-b11b-e2c01d313efe tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:28.034088 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-6055f70a-bad8-4de6-90a7-b58a41c76474 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:28.034287 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-dc6c7e5a-f9ec-42e2-b11b-e2c01d313efe tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:28.041532 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dc6c7e5a-f9ec-42e2-b11b-e2c01d313efe tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:28.042077 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dc6c7e5a-f9ec-42e2-b11b-e2c01d313efe tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:28.042971 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dc6c7e5a-f9ec-42e2-b11b-e2c01d313efe tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:28.043137 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-6055f70a-bad8-4de6-90a7-b58a41c76474 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:28.043551 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dc6c7e5a-f9ec-42e2-b11b-e2c01d313efe tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:28.044591 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-6055f70a-bad8-4de6-90a7-b58a41c76474 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:28.045715 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6055f70a-bad8-4de6-90a7-b58a41c76474 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.092813 Jul 26 07:44:28.046298 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 844/1644] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:27 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:28.180408 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-dc6c7e5a-f9ec-42e2-b11b-e2c01d313efe tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:28.188953 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-dc6c7e5a-f9ec-42e2-b11b-e2c01d313efe tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.159470 Jul 26 07:44:28.189542 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 801/1645] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:28 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:28.297173 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3532e6d6-a6f0-490d-aac4-bbe3b85fb0a9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:28.297779 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3532e6d6-a6f0-490d-aac4-bbe3b85fb0a9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:28.304391 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3532e6d6-a6f0-490d-aac4-bbe3b85fb0a9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:28.304830 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3532e6d6-a6f0-490d-aac4-bbe3b85fb0a9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:28.305591 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3532e6d6-a6f0-490d-aac4-bbe3b85fb0a9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:28.306052 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3532e6d6-a6f0-490d-aac4-bbe3b85fb0a9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:28.448599 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3532e6d6-a6f0-490d-aac4-bbe3b85fb0a9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:28.457588 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3532e6d6-a6f0-490d-aac4-bbe3b85fb0a9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.164414 Jul 26 07:44:28.458210 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 845/1646] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:28 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:29.069070 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-fd5ccc33-c161-4aa8-a821-b6812ea797ca tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:29.069700 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-fd5ccc33-c161-4aa8-a821-b6812ea797ca tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:29.076953 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fd5ccc33-c161-4aa8-a821-b6812ea797ca tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:29.077400 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fd5ccc33-c161-4aa8-a821-b6812ea797ca tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:29.078205 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fd5ccc33-c161-4aa8-a821-b6812ea797ca tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:29.078635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fd5ccc33-c161-4aa8-a821-b6812ea797ca tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:29.140821 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-fd5ccc33-c161-4aa8-a821-b6812ea797ca tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:29.144220 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:29.149682 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-fd5ccc33-c161-4aa8-a821-b6812ea797ca tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:29.151204 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-fd5ccc33-c161-4aa8-a821-b6812ea797ca tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:29.152362 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-fd5ccc33-c161-4aa8-a821-b6812ea797ca tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.087640 Jul 26 07:44:29.152925 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 802/1647] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:29 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:29.216078 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c50b497e-05c1-4bfe-bb35-be49d06132f0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:29.216672 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c50b497e-05c1-4bfe-bb35-be49d06132f0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:29.223963 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c50b497e-05c1-4bfe-bb35-be49d06132f0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:29.224412 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c50b497e-05c1-4bfe-bb35-be49d06132f0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:29.225196 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c50b497e-05c1-4bfe-bb35-be49d06132f0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:29.225787 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c50b497e-05c1-4bfe-bb35-be49d06132f0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:29.380485 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c50b497e-05c1-4bfe-bb35-be49d06132f0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:29.392499 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c50b497e-05c1-4bfe-bb35-be49d06132f0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.180118 Jul 26 07:44:29.393115 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 846/1648] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:29 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:29.479232 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c2e5deed-c1c2-4a60-b518-0ee85a53a833 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:29.479862 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c2e5deed-c1c2-4a60-b518-0ee85a53a833 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:29.487264 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c2e5deed-c1c2-4a60-b518-0ee85a53a833 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:29.487704 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c2e5deed-c1c2-4a60-b518-0ee85a53a833 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:29.488558 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c2e5deed-c1c2-4a60-b518-0ee85a53a833 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:29.488986 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c2e5deed-c1c2-4a60-b518-0ee85a53a833 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:29.632490 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-c2e5deed-c1c2-4a60-b518-0ee85a53a833 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:29.644774 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c2e5deed-c1c2-4a60-b518-0ee85a53a833 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.169169 Jul 26 07:44:29.645384 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 803/1649] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:29 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:30.175448 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ed08a91d-0f13-46f7-8613-dde79be501fe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:30.176091 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ed08a91d-0f13-46f7-8613-dde79be501fe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:30.182784 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ed08a91d-0f13-46f7-8613-dde79be501fe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:30.183231 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ed08a91d-0f13-46f7-8613-dde79be501fe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:30.183978 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ed08a91d-0f13-46f7-8613-dde79be501fe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:30.184403 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ed08a91d-0f13-46f7-8613-dde79be501fe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:30.254193 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ed08a91d-0f13-46f7-8613-dde79be501fe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:30.266599 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ed08a91d-0f13-46f7-8613-dde79be501fe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:30.268861 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ed08a91d-0f13-46f7-8613-dde79be501fe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:30.270352 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ed08a91d-0f13-46f7-8613-dde79be501fe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.098927 Jul 26 07:44:30.270917 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 847/1650] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:30 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:30.415448 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-90e9c48c-3714-4c9c-9cc4-19b937a2e388 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:30.416064 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-90e9c48c-3714-4c9c-9cc4-19b937a2e388 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:30.423819 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-90e9c48c-3714-4c9c-9cc4-19b937a2e388 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:30.424320 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-90e9c48c-3714-4c9c-9cc4-19b937a2e388 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:30.425203 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-90e9c48c-3714-4c9c-9cc4-19b937a2e388 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:30.425644 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-90e9c48c-3714-4c9c-9cc4-19b937a2e388 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:30.561523 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-90e9c48c-3714-4c9c-9cc4-19b937a2e388 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:30.570254 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-90e9c48c-3714-4c9c-9cc4-19b937a2e388 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.160336 Jul 26 07:44:30.570820 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 804/1651] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:30 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:30.676986 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-243e02ad-d0c3-4bb4-82cf-04ef305a125d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:30.677620 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-243e02ad-d0c3-4bb4-82cf-04ef305a125d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:30.686906 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-243e02ad-d0c3-4bb4-82cf-04ef305a125d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:30.687498 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-243e02ad-d0c3-4bb4-82cf-04ef305a125d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:30.688726 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-243e02ad-d0c3-4bb4-82cf-04ef305a125d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:30.689365 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-243e02ad-d0c3-4bb4-82cf-04ef305a125d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:30.837297 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-243e02ad-d0c3-4bb4-82cf-04ef305a125d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:30.849614 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-243e02ad-d0c3-4bb4-82cf-04ef305a125d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.178892 Jul 26 07:44:30.850223 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 848/1652] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:30 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:31.294442 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-402a845e-bca0-4155-abc1-4197970006ed tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:31.295064 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-402a845e-bca0-4155-abc1-4197970006ed tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:31.302443 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-402a845e-bca0-4155-abc1-4197970006ed tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:31.302975 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-402a845e-bca0-4155-abc1-4197970006ed tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:31.303889 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-402a845e-bca0-4155-abc1-4197970006ed tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:31.304424 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-402a845e-bca0-4155-abc1-4197970006ed tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:31.380067 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-402a845e-bca0-4155-abc1-4197970006ed tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:31.388954 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-402a845e-bca0-4155-abc1-4197970006ed tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:31.390474 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-402a845e-bca0-4155-abc1-4197970006ed tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:31.391626 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-402a845e-bca0-4155-abc1-4197970006ed tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.101842 Jul 26 07:44:31.392178 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 805/1653] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:31 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:31.594649 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c8b67eb7-39a4-4358-a06c-23bfbfb2824f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:31.595266 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c8b67eb7-39a4-4358-a06c-23bfbfb2824f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:31.603134 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c8b67eb7-39a4-4358-a06c-23bfbfb2824f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:31.603570 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c8b67eb7-39a4-4358-a06c-23bfbfb2824f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:31.604324 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c8b67eb7-39a4-4358-a06c-23bfbfb2824f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:31.604752 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c8b67eb7-39a4-4358-a06c-23bfbfb2824f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:31.745400 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c8b67eb7-39a4-4358-a06c-23bfbfb2824f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:31.757687 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c8b67eb7-39a4-4358-a06c-23bfbfb2824f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.168704 Jul 26 07:44:31.758334 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 849/1654] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:31 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:31.874655 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b781373a-de68-494b-8ab2-92583cb763b1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:31.875409 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-b781373a-de68-494b-8ab2-92583cb763b1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:31.885996 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b781373a-de68-494b-8ab2-92583cb763b1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:31.886675 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b781373a-de68-494b-8ab2-92583cb763b1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:31.887887 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b781373a-de68-494b-8ab2-92583cb763b1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:31.888533 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b781373a-de68-494b-8ab2-92583cb763b1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:32.035860 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-b781373a-de68-494b-8ab2-92583cb763b1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:32.051421 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b781373a-de68-494b-8ab2-92583cb763b1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.182599 Jul 26 07:44:32.052668 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 806/1655] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:31 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:32.418140 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-662fc1d6-a64c-4f3a-92f7-d45e735fb0cb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:32.419102 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-662fc1d6-a64c-4f3a-92f7-d45e735fb0cb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:32.427207 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-662fc1d6-a64c-4f3a-92f7-d45e735fb0cb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:32.427650 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-662fc1d6-a64c-4f3a-92f7-d45e735fb0cb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:32.428411 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-662fc1d6-a64c-4f3a-92f7-d45e735fb0cb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:32.428839 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-662fc1d6-a64c-4f3a-92f7-d45e735fb0cb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:32.496142 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-662fc1d6-a64c-4f3a-92f7-d45e735fb0cb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:32.505091 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-662fc1d6-a64c-4f3a-92f7-d45e735fb0cb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:32.506615 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-662fc1d6-a64c-4f3a-92f7-d45e735fb0cb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:32.507786 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-662fc1d6-a64c-4f3a-92f7-d45e735fb0cb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.095847 Jul 26 07:44:32.508339 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 850/1656] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:32 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:32.783611 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7951a7e0-ddc0-4d48-8efa-b613fee8580d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:32.784204 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7951a7e0-ddc0-4d48-8efa-b613fee8580d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:32.790969 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7951a7e0-ddc0-4d48-8efa-b613fee8580d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:32.791413 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7951a7e0-ddc0-4d48-8efa-b613fee8580d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:32.792159 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7951a7e0-ddc0-4d48-8efa-b613fee8580d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:32.792584 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7951a7e0-ddc0-4d48-8efa-b613fee8580d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:32.925525 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7951a7e0-ddc0-4d48-8efa-b613fee8580d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:32.933867 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7951a7e0-ddc0-4d48-8efa-b613fee8580d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.154182 Jul 26 07:44:32.934445 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 807/1657] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:32 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:33.077380 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f85b8aed-0d58-4688-a35f-1a2257a0a412 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:33.078305 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f85b8aed-0d58-4688-a35f-1a2257a0a412 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:33.089173 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f85b8aed-0d58-4688-a35f-1a2257a0a412 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:33.089909 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f85b8aed-0d58-4688-a35f-1a2257a0a412 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:33.091097 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f85b8aed-0d58-4688-a35f-1a2257a0a412 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:33.091751 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f85b8aed-0d58-4688-a35f-1a2257a0a412 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:33.231580 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f85b8aed-0d58-4688-a35f-1a2257a0a412 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:33.235093 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:33.240456 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f85b8aed-0d58-4688-a35f-1a2257a0a412 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.169183 Jul 26 07:44:33.241073 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 851/1658] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:33 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:33.530851 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b8d2f4b3-0ca8-47dd-b18c-a6db1b4d48a6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:33.531463 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-b8d2f4b3-0ca8-47dd-b18c-a6db1b4d48a6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:33.538125 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b8d2f4b3-0ca8-47dd-b18c-a6db1b4d48a6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:33.538566 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b8d2f4b3-0ca8-47dd-b18c-a6db1b4d48a6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:33.539323 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b8d2f4b3-0ca8-47dd-b18c-a6db1b4d48a6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:33.539756 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b8d2f4b3-0ca8-47dd-b18c-a6db1b4d48a6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:33.609890 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-b8d2f4b3-0ca8-47dd-b18c-a6db1b4d48a6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:33.618640 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-b8d2f4b3-0ca8-47dd-b18c-a6db1b4d48a6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:33.620085 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-b8d2f4b3-0ca8-47dd-b18c-a6db1b4d48a6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:33.621280 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b8d2f4b3-0ca8-47dd-b18c-a6db1b4d48a6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.094453 Jul 26 07:44:33.621851 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 808/1659] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:33 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:33.957399 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ef044a87-367e-4814-a6bb-f47999bd237b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:33.958254 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ef044a87-367e-4814-a6bb-f47999bd237b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:33.965000 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef044a87-367e-4814-a6bb-f47999bd237b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:33.965446 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef044a87-367e-4814-a6bb-f47999bd237b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:33.966231 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef044a87-367e-4814-a6bb-f47999bd237b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:33.966659 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef044a87-367e-4814-a6bb-f47999bd237b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:34.099638 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ef044a87-367e-4814-a6bb-f47999bd237b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:34.111794 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ef044a87-367e-4814-a6bb-f47999bd237b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.160322 Jul 26 07:44:34.112644 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 852/1660] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:33 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:34.262574 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7bc21dc8-fc39-4f8d-be2b-0bbb614c78a5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:34.263175 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7bc21dc8-fc39-4f8d-be2b-0bbb614c78a5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:34.270367 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7bc21dc8-fc39-4f8d-be2b-0bbb614c78a5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:34.270938 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7bc21dc8-fc39-4f8d-be2b-0bbb614c78a5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:34.271695 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7bc21dc8-fc39-4f8d-be2b-0bbb614c78a5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:34.272121 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7bc21dc8-fc39-4f8d-be2b-0bbb614c78a5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:34.408980 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7bc21dc8-fc39-4f8d-be2b-0bbb614c78a5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:34.417282 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7bc21dc8-fc39-4f8d-be2b-0bbb614c78a5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.158608 Jul 26 07:44:34.417873 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 809/1661] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:34 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:34.647594 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-474bb967-5c3e-4400-b6fa-0fee82716de9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:34.648122 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-474bb967-5c3e-4400-b6fa-0fee82716de9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:34.654770 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-474bb967-5c3e-4400-b6fa-0fee82716de9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:34.655209 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-474bb967-5c3e-4400-b6fa-0fee82716de9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:34.655966 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-474bb967-5c3e-4400-b6fa-0fee82716de9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:34.656395 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-474bb967-5c3e-4400-b6fa-0fee82716de9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:34.722579 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-474bb967-5c3e-4400-b6fa-0fee82716de9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:34.731767 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-474bb967-5c3e-4400-b6fa-0fee82716de9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:34.733250 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-474bb967-5c3e-4400-b6fa-0fee82716de9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:34.734422 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-474bb967-5c3e-4400-b6fa-0fee82716de9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.093174 Jul 26 07:44:34.734990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 853/1662] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:34 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:35.136287 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-326b0a78-f023-417c-956e-0d3861764ebf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:35.136889 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-326b0a78-f023-417c-956e-0d3861764ebf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:35.143340 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-326b0a78-f023-417c-956e-0d3861764ebf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:35.143790 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-326b0a78-f023-417c-956e-0d3861764ebf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:35.144540 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-326b0a78-f023-417c-956e-0d3861764ebf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:35.144965 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-326b0a78-f023-417c-956e-0d3861764ebf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:35.286304 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-326b0a78-f023-417c-956e-0d3861764ebf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:35.295051 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-326b0a78-f023-417c-956e-0d3861764ebf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.163595 Jul 26 07:44:35.295621 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 810/1663] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:35 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:35.438766 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a4515ae8-f19f-4f8c-aefb-49ce04b630af tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:35.439355 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a4515ae8-f19f-4f8c-aefb-49ce04b630af tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:35.446418 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a4515ae8-f19f-4f8c-aefb-49ce04b630af tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:35.446869 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a4515ae8-f19f-4f8c-aefb-49ce04b630af tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:35.447629 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a4515ae8-f19f-4f8c-aefb-49ce04b630af tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:35.448057 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a4515ae8-f19f-4f8c-aefb-49ce04b630af tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:35.583589 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-a4515ae8-f19f-4f8c-aefb-49ce04b630af tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:35.592236 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a4515ae8-f19f-4f8c-aefb-49ce04b630af tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.157419 Jul 26 07:44:35.592806 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 854/1664] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:35 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:35.762726 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-21a2d59a-bd80-461b-badf-9b7938eda070 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:35.763326 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-21a2d59a-bd80-461b-badf-9b7938eda070 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:35.769967 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-21a2d59a-bd80-461b-badf-9b7938eda070 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:35.770411 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-21a2d59a-bd80-461b-badf-9b7938eda070 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:35.771172 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-21a2d59a-bd80-461b-badf-9b7938eda070 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:35.771582 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-21a2d59a-bd80-461b-badf-9b7938eda070 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:35.839438 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-21a2d59a-bd80-461b-badf-9b7938eda070 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:35.848387 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-21a2d59a-bd80-461b-badf-9b7938eda070 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:35.849902 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-21a2d59a-bd80-461b-badf-9b7938eda070 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:35.851054 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-21a2d59a-bd80-461b-badf-9b7938eda070 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.092325 Jul 26 07:44:35.851618 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 811/1665] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:35 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:36.319672 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-fd291911-67ec-40d9-80d0-185c263f1659 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:36.320347 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-fd291911-67ec-40d9-80d0-185c263f1659 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:36.327693 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fd291911-67ec-40d9-80d0-185c263f1659 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:36.328192 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fd291911-67ec-40d9-80d0-185c263f1659 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:36.329404 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fd291911-67ec-40d9-80d0-185c263f1659 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:36.329927 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fd291911-67ec-40d9-80d0-185c263f1659 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:36.463288 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-fd291911-67ec-40d9-80d0-185c263f1659 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:36.471693 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-fd291911-67ec-40d9-80d0-185c263f1659 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.156412 Jul 26 07:44:36.472271 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 855/1666] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:36 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:36.614325 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7e9ed58c-df59-416c-9cca-b6a04c0ec89a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:36.614948 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7e9ed58c-df59-416c-9cca-b6a04c0ec89a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:36.622229 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7e9ed58c-df59-416c-9cca-b6a04c0ec89a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:36.622676 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7e9ed58c-df59-416c-9cca-b6a04c0ec89a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:36.623443 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7e9ed58c-df59-416c-9cca-b6a04c0ec89a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:36.623870 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7e9ed58c-df59-416c-9cca-b6a04c0ec89a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:36.761991 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7e9ed58c-df59-416c-9cca-b6a04c0ec89a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:36.774842 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7e9ed58c-df59-416c-9cca-b6a04c0ec89a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.165081 Jul 26 07:44:36.775444 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 812/1667] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:36 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:36.883860 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f2df6d43-8eb7-4451-b103-a871c1417f97 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:36.884534 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f2df6d43-8eb7-4451-b103-a871c1417f97 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:36.893256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f2df6d43-8eb7-4451-b103-a871c1417f97 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:36.894021 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f2df6d43-8eb7-4451-b103-a871c1417f97 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:36.895199 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f2df6d43-8eb7-4451-b103-a871c1417f97 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:36.895889 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f2df6d43-8eb7-4451-b103-a871c1417f97 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:36.966837 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f2df6d43-8eb7-4451-b103-a871c1417f97 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:36.978396 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f2df6d43-8eb7-4451-b103-a871c1417f97 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:36.980535 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f2df6d43-8eb7-4451-b103-a871c1417f97 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:36.982487 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f2df6d43-8eb7-4451-b103-a871c1417f97 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.103372 Jul 26 07:44:36.983346 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 856/1668] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:36 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:37.494851 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d17ccb1a-0355-4e6e-b2e5-7f61dde69910 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:37.495457 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d17ccb1a-0355-4e6e-b2e5-7f61dde69910 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:37.502225 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d17ccb1a-0355-4e6e-b2e5-7f61dde69910 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:37.502678 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d17ccb1a-0355-4e6e-b2e5-7f61dde69910 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:37.503436 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d17ccb1a-0355-4e6e-b2e5-7f61dde69910 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:37.503873 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d17ccb1a-0355-4e6e-b2e5-7f61dde69910 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:37.642742 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d17ccb1a-0355-4e6e-b2e5-7f61dde69910 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:37.653512 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d17ccb1a-0355-4e6e-b2e5-7f61dde69910 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.162543 Jul 26 07:44:37.654139 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 813/1669] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:37 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:37.803316 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-328cdc93-910b-40a0-a60f-6412ee9e461f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:37.803888 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-328cdc93-910b-40a0-a60f-6412ee9e461f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:37.810912 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-328cdc93-910b-40a0-a60f-6412ee9e461f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:37.811357 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-328cdc93-910b-40a0-a60f-6412ee9e461f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:37.812113 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-328cdc93-910b-40a0-a60f-6412ee9e461f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:37.812595 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-328cdc93-910b-40a0-a60f-6412ee9e461f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:37.946304 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-328cdc93-910b-40a0-a60f-6412ee9e461f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:37.954997 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-328cdc93-910b-40a0-a60f-6412ee9e461f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.155513 Jul 26 07:44:37.955579 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 857/1670] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:37 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:38.009106 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a6dfa0e3-2077-4653-838c-0053855b1293 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:38.009713 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a6dfa0e3-2077-4653-838c-0053855b1293 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:38.016442 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a6dfa0e3-2077-4653-838c-0053855b1293 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:38.016866 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a6dfa0e3-2077-4653-838c-0053855b1293 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:38.017681 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a6dfa0e3-2077-4653-838c-0053855b1293 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:38.018151 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a6dfa0e3-2077-4653-838c-0053855b1293 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:38.084762 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a6dfa0e3-2077-4653-838c-0053855b1293 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:38.093697 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a6dfa0e3-2077-4653-838c-0053855b1293 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:38.095209 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a6dfa0e3-2077-4653-838c-0053855b1293 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:38.096367 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a6dfa0e3-2077-4653-838c-0053855b1293 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.093461 Jul 26 07:44:38.096888 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 814/1671] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:38 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:38.678964 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b5213627-5c53-4231-9f08-d22fb4af7dd0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:38.679541 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b5213627-5c53-4231-9f08-d22fb4af7dd0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:38.687824 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b5213627-5c53-4231-9f08-d22fb4af7dd0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:38.688441 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b5213627-5c53-4231-9f08-d22fb4af7dd0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:38.689504 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b5213627-5c53-4231-9f08-d22fb4af7dd0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:38.690080 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b5213627-5c53-4231-9f08-d22fb4af7dd0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:38.831641 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-b5213627-5c53-4231-9f08-d22fb4af7dd0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:38.839920 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b5213627-5c53-4231-9f08-d22fb4af7dd0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.167116 Jul 26 07:44:38.840494 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 858/1672] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:38 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:38.979466 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c9c22231-9a57-4b0d-8a0f-eedc45e6f0cb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:38.980080 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c9c22231-9a57-4b0d-8a0f-eedc45e6f0cb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:38.987398 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c9c22231-9a57-4b0d-8a0f-eedc45e6f0cb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:38.987841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c9c22231-9a57-4b0d-8a0f-eedc45e6f0cb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:38.988607 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c9c22231-9a57-4b0d-8a0f-eedc45e6f0cb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:38.989032 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c9c22231-9a57-4b0d-8a0f-eedc45e6f0cb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:39.120397 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-16c4a8ae-3f00-4fff-8fe4-9ebbc16a5bf7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:39.121012 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-16c4a8ae-3f00-4fff-8fe4-9ebbc16a5bf7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:39.127009 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-c9c22231-9a57-4b0d-8a0f-eedc45e6f0cb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:39.127664 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-16c4a8ae-3f00-4fff-8fe4-9ebbc16a5bf7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:39.128108 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-16c4a8ae-3f00-4fff-8fe4-9ebbc16a5bf7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:39.128846 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-16c4a8ae-3f00-4fff-8fe4-9ebbc16a5bf7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:39.129271 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-16c4a8ae-3f00-4fff-8fe4-9ebbc16a5bf7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:39.135118 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c9c22231-9a57-4b0d-8a0f-eedc45e6f0cb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.160113 Jul 26 07:44:39.135690 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 815/1673] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:38 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:39.194176 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-16c4a8ae-3f00-4fff-8fe4-9ebbc16a5bf7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:39.203105 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-16c4a8ae-3f00-4fff-8fe4-9ebbc16a5bf7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:39.204965 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-16c4a8ae-3f00-4fff-8fe4-9ebbc16a5bf7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:39.206586 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-16c4a8ae-3f00-4fff-8fe4-9ebbc16a5bf7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.090049 Jul 26 07:44:39.206760 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 859/1674] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:39 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:39.860917 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c2045aee-0687-470f-ad49-bd69a14b8c1e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:39.861528 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c2045aee-0687-470f-ad49-bd69a14b8c1e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:39.868172 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c2045aee-0687-470f-ad49-bd69a14b8c1e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:39.868631 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c2045aee-0687-470f-ad49-bd69a14b8c1e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:39.869388 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c2045aee-0687-470f-ad49-bd69a14b8c1e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:39.869861 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c2045aee-0687-470f-ad49-bd69a14b8c1e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:40.019179 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-c2045aee-0687-470f-ad49-bd69a14b8c1e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:40.029674 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c2045aee-0687-470f-ad49-bd69a14b8c1e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.172691 Jul 26 07:44:40.030293 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 816/1675] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:39 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:40.159437 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-1c581a90-e89f-41fd-936b-202758c2400d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:40.160011 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-1c581a90-e89f-41fd-936b-202758c2400d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:40.168457 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1c581a90-e89f-41fd-936b-202758c2400d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:40.168891 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1c581a90-e89f-41fd-936b-202758c2400d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:40.169647 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1c581a90-e89f-41fd-936b-202758c2400d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:40.170086 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1c581a90-e89f-41fd-936b-202758c2400d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:40.229156 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6a119b65-df02-4419-b0a2-624c78ba4f6b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:40.229761 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6a119b65-df02-4419-b0a2-624c78ba4f6b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:40.236739 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6a119b65-df02-4419-b0a2-624c78ba4f6b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:40.237531 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6a119b65-df02-4419-b0a2-624c78ba4f6b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:40.238535 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6a119b65-df02-4419-b0a2-624c78ba4f6b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:40.238968 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6a119b65-df02-4419-b0a2-624c78ba4f6b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:40.300434 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6a119b65-df02-4419-b0a2-624c78ba4f6b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:40.302762 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-1c581a90-e89f-41fd-936b-202758c2400d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:40.309245 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6a119b65-df02-4419-b0a2-624c78ba4f6b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:40.310770 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6a119b65-df02-4419-b0a2-624c78ba4f6b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:40.310931 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-1c581a90-e89f-41fd-936b-202758c2400d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.157500 Jul 26 07:44:40.311490 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 860/1676] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:40 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:40.311949 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6a119b65-df02-4419-b0a2-624c78ba4f6b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.087201 Jul 26 07:44:40.312485 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 817/1677] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:40 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:41.051844 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7e4728f6-e62e-47ad-b545-51244051e1d8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:41.052467 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7e4728f6-e62e-47ad-b545-51244051e1d8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:41.059348 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7e4728f6-e62e-47ad-b545-51244051e1d8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:41.059795 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7e4728f6-e62e-47ad-b545-51244051e1d8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:41.060550 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7e4728f6-e62e-47ad-b545-51244051e1d8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:41.060983 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7e4728f6-e62e-47ad-b545-51244051e1d8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:41.202064 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7e4728f6-e62e-47ad-b545-51244051e1d8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:41.214772 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7e4728f6-e62e-47ad-b545-51244051e1d8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.166659 Jul 26 07:44:41.215527 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 861/1678] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:41 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:41.334466 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-1b97efdc-a575-4bc6-a8a6-a7516088cc10 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:41.335126 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-1b97efdc-a575-4bc6-a8a6-a7516088cc10 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:41.335236 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d4d4467a-38e4-43cf-a4dc-f84d6004356d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:41.335781 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d4d4467a-38e4-43cf-a4dc-f84d6004356d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:41.341800 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1b97efdc-a575-4bc6-a8a6-a7516088cc10 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:41.342230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d4d4467a-38e4-43cf-a4dc-f84d6004356d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:41.342408 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1b97efdc-a575-4bc6-a8a6-a7516088cc10 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:41.342668 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d4d4467a-38e4-43cf-a4dc-f84d6004356d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:41.343004 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1b97efdc-a575-4bc6-a8a6-a7516088cc10 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:41.343422 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d4d4467a-38e4-43cf-a4dc-f84d6004356d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:41.343569 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1b97efdc-a575-4bc6-a8a6-a7516088cc10 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:41.343847 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d4d4467a-38e4-43cf-a4dc-f84d6004356d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:41.409925 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d4d4467a-38e4-43cf-a4dc-f84d6004356d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:41.418479 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d4d4467a-38e4-43cf-a4dc-f84d6004356d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:41.419960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d4d4467a-38e4-43cf-a4dc-f84d6004356d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:41.421166 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d4d4467a-38e4-43cf-a4dc-f84d6004356d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.089892 Jul 26 07:44:41.421728 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 862/1679] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:41 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:41.479288 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-1b97efdc-a575-4bc6-a8a6-a7516088cc10 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:41.487286 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-1b97efdc-a575-4bc6-a8a6-a7516088cc10 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.158149 Jul 26 07:44:41.487857 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 818/1680] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:41 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:42.245004 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-66a4e493-f815-4a9c-8868-b5d3e151ec44 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:42.245601 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-66a4e493-f815-4a9c-8868-b5d3e151ec44 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:42.252821 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-66a4e493-f815-4a9c-8868-b5d3e151ec44 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:42.252821 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-66a4e493-f815-4a9c-8868-b5d3e151ec44 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:42.253118 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-66a4e493-f815-4a9c-8868-b5d3e151ec44 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:42.253571 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-66a4e493-f815-4a9c-8868-b5d3e151ec44 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:42.387456 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-66a4e493-f815-4a9c-8868-b5d3e151ec44 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:42.395910 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-66a4e493-f815-4a9c-8868-b5d3e151ec44 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.157543 Jul 26 07:44:42.396460 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 863/1681] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:42 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:42.444083 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0b78d9d8-193f-4764-b12f-b3edc263b770 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:42.444697 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0b78d9d8-193f-4764-b12f-b3edc263b770 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:42.451896 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0b78d9d8-193f-4764-b12f-b3edc263b770 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:42.452337 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0b78d9d8-193f-4764-b12f-b3edc263b770 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:42.453087 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0b78d9d8-193f-4764-b12f-b3edc263b770 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:42.453511 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0b78d9d8-193f-4764-b12f-b3edc263b770 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:42.472339 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:42.508751 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-cba478d4-f2a5-447c-b3d1-2a3870072b51 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:42.509513 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-cba478d4-f2a5-447c-b3d1-2a3870072b51 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:42.517333 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cba478d4-f2a5-447c-b3d1-2a3870072b51 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:42.517886 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cba478d4-f2a5-447c-b3d1-2a3870072b51 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:42.518646 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cba478d4-f2a5-447c-b3d1-2a3870072b51 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:42.519071 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cba478d4-f2a5-447c-b3d1-2a3870072b51 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:42.528396 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0b78d9d8-193f-4764-b12f-b3edc263b770 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:42.537315 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0b78d9d8-193f-4764-b12f-b3edc263b770 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:42.538853 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0b78d9d8-193f-4764-b12f-b3edc263b770 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:42.540152 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0b78d9d8-193f-4764-b12f-b3edc263b770 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.100054 Jul 26 07:44:42.540926 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 819/1682] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:42 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:42.649360 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-cba478d4-f2a5-447c-b3d1-2a3870072b51 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:42.660637 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-cba478d4-f2a5-447c-b3d1-2a3870072b51 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.155681 Jul 26 07:44:42.661487 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 864/1683] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:42 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:43.418331 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-82640675-5756-481b-a2e9-73c4ff9fc61d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:43.418936 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-82640675-5756-481b-a2e9-73c4ff9fc61d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:43.425423 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-82640675-5756-481b-a2e9-73c4ff9fc61d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:43.425913 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-82640675-5756-481b-a2e9-73c4ff9fc61d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:43.426680 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-82640675-5756-481b-a2e9-73c4ff9fc61d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:43.427104 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-82640675-5756-481b-a2e9-73c4ff9fc61d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:43.563009 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-bf71b489-55eb-43fb-846e-7463921ee976 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:43.563645 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-bf71b489-55eb-43fb-846e-7463921ee976 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:43.570765 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bf71b489-55eb-43fb-846e-7463921ee976 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:43.571324 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bf71b489-55eb-43fb-846e-7463921ee976 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:43.571955 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bf71b489-55eb-43fb-846e-7463921ee976 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:43.572386 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bf71b489-55eb-43fb-846e-7463921ee976 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:43.584936 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-82640675-5756-481b-a2e9-73c4ff9fc61d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:43.593403 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-82640675-5756-481b-a2e9-73c4ff9fc61d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.179054 Jul 26 07:44:43.594021 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 820/1684] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:43 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:43.644596 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-bf71b489-55eb-43fb-846e-7463921ee976 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:43.653980 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-bf71b489-55eb-43fb-846e-7463921ee976 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:43.656354 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-bf71b489-55eb-43fb-846e-7463921ee976 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:43.658203 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-bf71b489-55eb-43fb-846e-7463921ee976 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.099000 Jul 26 07:44:43.658943 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 865/1685] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:43 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:43.684164 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-fc17489a-848d-467e-b8dc-3d059cbcb506 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:43.684698 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-fc17489a-848d-467e-b8dc-3d059cbcb506 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:43.691100 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fc17489a-848d-467e-b8dc-3d059cbcb506 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:43.691572 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fc17489a-848d-467e-b8dc-3d059cbcb506 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:43.692328 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fc17489a-848d-467e-b8dc-3d059cbcb506 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:43.692758 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fc17489a-848d-467e-b8dc-3d059cbcb506 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:43.835599 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-fc17489a-848d-467e-b8dc-3d059cbcb506 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:43.844169 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-fc17489a-848d-467e-b8dc-3d059cbcb506 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.164085 Jul 26 07:44:43.844713 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 821/1686] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:43 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:44.614989 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9215d685-6417-4796-ab71-2ff0e1735820 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:44.615627 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-9215d685-6417-4796-ab71-2ff0e1735820 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:44.622782 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9215d685-6417-4796-ab71-2ff0e1735820 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:44.623225 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9215d685-6417-4796-ab71-2ff0e1735820 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:44.623996 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9215d685-6417-4796-ab71-2ff0e1735820 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:44.624419 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9215d685-6417-4796-ab71-2ff0e1735820 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:44.680878 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-dc7f04a0-4560-4752-b36c-47d378f6f07a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:44.681481 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-dc7f04a0-4560-4752-b36c-47d378f6f07a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:44.688812 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dc7f04a0-4560-4752-b36c-47d378f6f07a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:44.689418 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dc7f04a0-4560-4752-b36c-47d378f6f07a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:44.690227 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dc7f04a0-4560-4752-b36c-47d378f6f07a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:44.690847 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dc7f04a0-4560-4752-b36c-47d378f6f07a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:44.761557 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-dc7f04a0-4560-4752-b36c-47d378f6f07a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:44.762674 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-9215d685-6417-4796-ab71-2ff0e1735820 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:44.770516 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-dc7f04a0-4560-4752-b36c-47d378f6f07a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:44.772015 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-dc7f04a0-4560-4752-b36c-47d378f6f07a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:44.773181 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-dc7f04a0-4560-4752-b36c-47d378f6f07a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.096390 Jul 26 07:44:44.773964 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 822/1687] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:44 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:44.776734 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-9215d685-6417-4796-ab71-2ff0e1735820 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.165580 Jul 26 07:44:44.777345 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 866/1688] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:44 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:44.867553 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-cfe5e8a8-d021-498b-a6c3-cde024d42cbb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:44.868119 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-cfe5e8a8-d021-498b-a6c3-cde024d42cbb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:44.875164 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cfe5e8a8-d021-498b-a6c3-cde024d42cbb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:44.875650 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cfe5e8a8-d021-498b-a6c3-cde024d42cbb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:44.876469 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cfe5e8a8-d021-498b-a6c3-cde024d42cbb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:44.876878 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cfe5e8a8-d021-498b-a6c3-cde024d42cbb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:45.026266 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-cfe5e8a8-d021-498b-a6c3-cde024d42cbb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:45.034481 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-cfe5e8a8-d021-498b-a6c3-cde024d42cbb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.171955 Jul 26 07:44:45.035083 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 823/1689] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:44 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:45.796534 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-5abfd229-8e55-4058-8c03-6fe009f953c5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:45.797181 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-5abfd229-8e55-4058-8c03-6fe009f953c5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:45.798311 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f26d7024-fff3-42bc-9413-2478fbe6cd6c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:45.798926 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-f26d7024-fff3-42bc-9413-2478fbe6cd6c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:45.804236 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5abfd229-8e55-4058-8c03-6fe009f953c5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:45.804703 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5abfd229-8e55-4058-8c03-6fe009f953c5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:45.805653 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5abfd229-8e55-4058-8c03-6fe009f953c5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:45.806102 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5abfd229-8e55-4058-8c03-6fe009f953c5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:45.806283 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f26d7024-fff3-42bc-9413-2478fbe6cd6c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:45.806752 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f26d7024-fff3-42bc-9413-2478fbe6cd6c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:45.807596 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f26d7024-fff3-42bc-9413-2478fbe6cd6c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:45.807934 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f26d7024-fff3-42bc-9413-2478fbe6cd6c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:45.869485 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-5abfd229-8e55-4058-8c03-6fe009f953c5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:45.878444 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-5abfd229-8e55-4058-8c03-6fe009f953c5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:45.879946 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-5abfd229-8e55-4058-8c03-6fe009f953c5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:45.881134 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-5abfd229-8e55-4058-8c03-6fe009f953c5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.088788 Jul 26 07:44:45.882010 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 867/1690] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:45 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:45.939301 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-f26d7024-fff3-42bc-9413-2478fbe6cd6c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:45.947709 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f26d7024-fff3-42bc-9413-2478fbe6cd6c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.153620 Jul 26 07:44:45.948272 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 824/1691] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:45 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:46.057669 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-4ebb2994-cb6b-4d24-afa3-54da618fe497 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:46.058213 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-4ebb2994-cb6b-4d24-afa3-54da618fe497 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:46.064783 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4ebb2994-cb6b-4d24-afa3-54da618fe497 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:46.065240 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4ebb2994-cb6b-4d24-afa3-54da618fe497 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:46.066039 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4ebb2994-cb6b-4d24-afa3-54da618fe497 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:46.066475 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4ebb2994-cb6b-4d24-afa3-54da618fe497 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:46.085925 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:46.208134 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-4ebb2994-cb6b-4d24-afa3-54da618fe497 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:46.216459 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-4ebb2994-cb6b-4d24-afa3-54da618fe497 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.164231 Jul 26 07:44:46.217060 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 868/1692] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:46 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:46.906718 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c0b56fda-7bd8-443e-b06e-e0d3ca842ee5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:46.907562 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c0b56fda-7bd8-443e-b06e-e0d3ca842ee5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:46.917130 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c0b56fda-7bd8-443e-b06e-e0d3ca842ee5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:46.917594 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c0b56fda-7bd8-443e-b06e-e0d3ca842ee5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:46.918400 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c0b56fda-7bd8-443e-b06e-e0d3ca842ee5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:46.918841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c0b56fda-7bd8-443e-b06e-e0d3ca842ee5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:46.970004 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c0079810-487d-4b33-96c2-a087dbd22b5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:46.970644 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c0079810-487d-4b33-96c2-a087dbd22b5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:46.978540 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c0079810-487d-4b33-96c2-a087dbd22b5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:46.978964 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c0079810-487d-4b33-96c2-a087dbd22b5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:46.979844 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c0079810-487d-4b33-96c2-a087dbd22b5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:46.980832 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c0079810-487d-4b33-96c2-a087dbd22b5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:46.985307 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-c0b56fda-7bd8-443e-b06e-e0d3ca842ee5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:46.993731 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-c0b56fda-7bd8-443e-b06e-e0d3ca842ee5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:46.995300 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-c0b56fda-7bd8-443e-b06e-e0d3ca842ee5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:46.996432 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c0b56fda-7bd8-443e-b06e-e0d3ca842ee5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.095454 Jul 26 07:44:46.996974 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 825/1693] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:46 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:47.110462 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c0079810-487d-4b33-96c2-a087dbd22b5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:47.119816 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c0079810-487d-4b33-96c2-a087dbd22b5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.153506 Jul 26 07:44:47.120397 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 869/1694] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:46 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:47.242709 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-17430403-1056-4cf8-a7d4-7a151ba17f33 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:47.243410 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-17430403-1056-4cf8-a7d4-7a151ba17f33 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:47.252100 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-17430403-1056-4cf8-a7d4-7a151ba17f33 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:47.252817 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-17430403-1056-4cf8-a7d4-7a151ba17f33 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:47.253773 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-17430403-1056-4cf8-a7d4-7a151ba17f33 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:47.254398 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-17430403-1056-4cf8-a7d4-7a151ba17f33 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:47.401872 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-17430403-1056-4cf8-a7d4-7a151ba17f33 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:47.410138 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-17430403-1056-4cf8-a7d4-7a151ba17f33 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.172834 Jul 26 07:44:47.410712 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 826/1695] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:47 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:48.023688 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d6706c0a-0649-4853-be54-6881e615f724 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:48.024546 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d6706c0a-0649-4853-be54-6881e615f724 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:48.031523 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d6706c0a-0649-4853-be54-6881e615f724 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:48.031976 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d6706c0a-0649-4853-be54-6881e615f724 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:48.032731 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d6706c0a-0649-4853-be54-6881e615f724 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:48.033166 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d6706c0a-0649-4853-be54-6881e615f724 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:48.099118 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d6706c0a-0649-4853-be54-6881e615f724 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:48.111774 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d6706c0a-0649-4853-be54-6881e615f724 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:48.114734 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d6706c0a-0649-4853-be54-6881e615f724 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:48.115941 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d6706c0a-0649-4853-be54-6881e615f724 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.098756 Jul 26 07:44:48.116503 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 870/1696] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:48 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:48.141909 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-86b579b9-487b-4050-9fd9-6ace2fd96c14 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:48.142587 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-86b579b9-487b-4050-9fd9-6ace2fd96c14 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:48.149410 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-86b579b9-487b-4050-9fd9-6ace2fd96c14 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:48.149845 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-86b579b9-487b-4050-9fd9-6ace2fd96c14 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:48.150607 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-86b579b9-487b-4050-9fd9-6ace2fd96c14 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:48.151042 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-86b579b9-487b-4050-9fd9-6ace2fd96c14 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:48.291639 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-86b579b9-487b-4050-9fd9-6ace2fd96c14 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:48.304483 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-86b579b9-487b-4050-9fd9-6ace2fd96c14 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.166443 Jul 26 07:44:48.305664 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 827/1697] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:48 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:48.438838 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-5fba1568-23a4-486d-8597-5ebf1dcdb81e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:48.439453 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-5fba1568-23a4-486d-8597-5ebf1dcdb81e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:48.446160 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5fba1568-23a4-486d-8597-5ebf1dcdb81e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:48.446609 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5fba1568-23a4-486d-8597-5ebf1dcdb81e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:48.447376 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5fba1568-23a4-486d-8597-5ebf1dcdb81e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:48.447805 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5fba1568-23a4-486d-8597-5ebf1dcdb81e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:48.590486 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-5fba1568-23a4-486d-8597-5ebf1dcdb81e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:48.598655 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-5fba1568-23a4-486d-8597-5ebf1dcdb81e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.163777 Jul 26 07:44:48.599645 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 871/1698] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:48 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:49.141323 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-5ce66459-84f7-447b-80f9-f290d25b22ee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:49.141961 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-5ce66459-84f7-447b-80f9-f290d25b22ee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:49.148536 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5ce66459-84f7-447b-80f9-f290d25b22ee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:49.148980 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5ce66459-84f7-447b-80f9-f290d25b22ee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:49.149759 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5ce66459-84f7-447b-80f9-f290d25b22ee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:49.150224 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5ce66459-84f7-447b-80f9-f290d25b22ee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:49.213462 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-5ce66459-84f7-447b-80f9-f290d25b22ee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:49.222600 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-5ce66459-84f7-447b-80f9-f290d25b22ee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:49.224080 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-5ce66459-84f7-447b-80f9-f290d25b22ee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:49.225214 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-5ce66459-84f7-447b-80f9-f290d25b22ee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.087975 Jul 26 07:44:49.225763 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 828/1699] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:49 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:49.326779 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-5504cd23-373a-46ed-92b8-6e960e833ad7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:49.327404 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-5504cd23-373a-46ed-92b8-6e960e833ad7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:49.335628 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5504cd23-373a-46ed-92b8-6e960e833ad7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:49.336215 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5504cd23-373a-46ed-92b8-6e960e833ad7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:49.337329 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5504cd23-373a-46ed-92b8-6e960e833ad7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:49.337930 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5504cd23-373a-46ed-92b8-6e960e833ad7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:49.484305 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-5504cd23-373a-46ed-92b8-6e960e833ad7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:49.496655 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-5504cd23-373a-46ed-92b8-6e960e833ad7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.173593 Jul 26 07:44:49.497481 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 872/1700] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:49 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:49.620592 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-bbbe5dcc-2d4c-4711-b287-2b267cc243b0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:49.621221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-bbbe5dcc-2d4c-4711-b287-2b267cc243b0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:49.627815 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bbbe5dcc-2d4c-4711-b287-2b267cc243b0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:49.628316 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bbbe5dcc-2d4c-4711-b287-2b267cc243b0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:49.629117 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bbbe5dcc-2d4c-4711-b287-2b267cc243b0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:49.629554 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bbbe5dcc-2d4c-4711-b287-2b267cc243b0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:49.781819 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-bbbe5dcc-2d4c-4711-b287-2b267cc243b0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:49.790240 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-bbbe5dcc-2d4c-4711-b287-2b267cc243b0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.173697 Jul 26 07:44:49.790820 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 829/1701] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:49 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:50.259687 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-009b415e-0c22-4ced-b7bf-13d072a9840c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:50.260288 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-009b415e-0c22-4ced-b7bf-13d072a9840c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:50.266710 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-009b415e-0c22-4ced-b7bf-13d072a9840c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:50.267153 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-009b415e-0c22-4ced-b7bf-13d072a9840c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:50.267912 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-009b415e-0c22-4ced-b7bf-13d072a9840c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:50.268341 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-009b415e-0c22-4ced-b7bf-13d072a9840c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:50.332205 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-009b415e-0c22-4ced-b7bf-13d072a9840c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:50.341209 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-009b415e-0c22-4ced-b7bf-13d072a9840c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:50.342722 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-009b415e-0c22-4ced-b7bf-13d072a9840c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:50.343861 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-009b415e-0c22-4ced-b7bf-13d072a9840c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.089813 Jul 26 07:44:50.344409 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 873/1702] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:50 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:50.519267 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-5cb7539f-a154-4961-a74d-f48007d9f490 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:50.519850 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-5cb7539f-a154-4961-a74d-f48007d9f490 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:50.526888 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5cb7539f-a154-4961-a74d-f48007d9f490 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:50.527331 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5cb7539f-a154-4961-a74d-f48007d9f490 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:50.528080 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5cb7539f-a154-4961-a74d-f48007d9f490 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:50.528508 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5cb7539f-a154-4961-a74d-f48007d9f490 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:50.676499 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-5cb7539f-a154-4961-a74d-f48007d9f490 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:50.687727 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-5cb7539f-a154-4961-a74d-f48007d9f490 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.172225 Jul 26 07:44:50.688512 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 830/1703] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:50 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:50.814703 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3547ce47-4f8c-4e3d-a5c0-86be9261532e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:50.815462 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3547ce47-4f8c-4e3d-a5c0-86be9261532e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:50.823953 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3547ce47-4f8c-4e3d-a5c0-86be9261532e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:50.824394 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3547ce47-4f8c-4e3d-a5c0-86be9261532e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:50.825159 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3547ce47-4f8c-4e3d-a5c0-86be9261532e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:50.825588 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3547ce47-4f8c-4e3d-a5c0-86be9261532e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:50.969542 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3547ce47-4f8c-4e3d-a5c0-86be9261532e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:50.979470 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3547ce47-4f8c-4e3d-a5c0-86be9261532e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.171277 Jul 26 07:44:50.980040 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 874/1704] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:50 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:51.368998 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a90202bd-74bb-40f5-a6cd-df18689bdc65 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:51.369598 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a90202bd-74bb-40f5-a6cd-df18689bdc65 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:51.376226 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a90202bd-74bb-40f5-a6cd-df18689bdc65 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:51.376667 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a90202bd-74bb-40f5-a6cd-df18689bdc65 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:51.377419 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a90202bd-74bb-40f5-a6cd-df18689bdc65 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:51.377958 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a90202bd-74bb-40f5-a6cd-df18689bdc65 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:51.451871 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a90202bd-74bb-40f5-a6cd-df18689bdc65 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:51.464295 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a90202bd-74bb-40f5-a6cd-df18689bdc65 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:51.466183 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a90202bd-74bb-40f5-a6cd-df18689bdc65 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:51.467908 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a90202bd-74bb-40f5-a6cd-df18689bdc65 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.103967 Jul 26 07:44:51.468608 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 831/1705] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:51 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:51.715886 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-434b98b3-d292-45dd-a875-c44f06881ff0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:51.716607 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-434b98b3-d292-45dd-a875-c44f06881ff0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:51.726056 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-434b98b3-d292-45dd-a875-c44f06881ff0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:51.726655 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-434b98b3-d292-45dd-a875-c44f06881ff0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:51.727696 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-434b98b3-d292-45dd-a875-c44f06881ff0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:51.728133 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-434b98b3-d292-45dd-a875-c44f06881ff0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:51.865431 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-434b98b3-d292-45dd-a875-c44f06881ff0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:51.874655 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-434b98b3-d292-45dd-a875-c44f06881ff0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.164028 Jul 26 07:44:51.875229 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 875/1706] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:51 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:52.000714 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-74c46991-13fd-408d-be8d-e89f9c050bdd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:52.001318 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-74c46991-13fd-408d-be8d-e89f9c050bdd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:52.008616 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-74c46991-13fd-408d-be8d-e89f9c050bdd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:52.009064 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-74c46991-13fd-408d-be8d-e89f9c050bdd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:52.009870 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-74c46991-13fd-408d-be8d-e89f9c050bdd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:52.010313 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-74c46991-13fd-408d-be8d-e89f9c050bdd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:52.150667 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-74c46991-13fd-408d-be8d-e89f9c050bdd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:52.162903 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-74c46991-13fd-408d-be8d-e89f9c050bdd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.165882 Jul 26 07:44:52.163653 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 832/1707] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:51 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:52.493723 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-bbcabcd3-8064-452a-a714-6cd5798c7039 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:52.494571 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-bbcabcd3-8064-452a-a714-6cd5798c7039 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:52.503669 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bbcabcd3-8064-452a-a714-6cd5798c7039 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:52.504267 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bbcabcd3-8064-452a-a714-6cd5798c7039 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:52.505313 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bbcabcd3-8064-452a-a714-6cd5798c7039 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:52.506150 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bbcabcd3-8064-452a-a714-6cd5798c7039 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:52.575481 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-bbcabcd3-8064-452a-a714-6cd5798c7039 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:52.587964 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-bbcabcd3-8064-452a-a714-6cd5798c7039 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:52.589453 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-bbcabcd3-8064-452a-a714-6cd5798c7039 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:52.590633 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-bbcabcd3-8064-452a-a714-6cd5798c7039 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.102300 Jul 26 07:44:52.591197 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 876/1708] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:52 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:52.899040 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8da9a506-88bc-4e44-8987-dbcbb7661c94 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:52.899662 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8da9a506-88bc-4e44-8987-dbcbb7661c94 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:52.906903 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8da9a506-88bc-4e44-8987-dbcbb7661c94 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:52.907388 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8da9a506-88bc-4e44-8987-dbcbb7661c94 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:52.908205 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8da9a506-88bc-4e44-8987-dbcbb7661c94 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:52.908682 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8da9a506-88bc-4e44-8987-dbcbb7661c94 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:53.043869 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8da9a506-88bc-4e44-8987-dbcbb7661c94 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:53.051872 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8da9a506-88bc-4e44-8987-dbcbb7661c94 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.157247 Jul 26 07:44:53.052410 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 833/1709] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:52 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:53.185071 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-5efaf8de-f958-40a8-b488-8f40ee783a31 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:53.185618 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-5efaf8de-f958-40a8-b488-8f40ee783a31 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:53.192741 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5efaf8de-f958-40a8-b488-8f40ee783a31 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:53.193184 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5efaf8de-f958-40a8-b488-8f40ee783a31 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:53.193981 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5efaf8de-f958-40a8-b488-8f40ee783a31 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:53.194421 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5efaf8de-f958-40a8-b488-8f40ee783a31 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:53.339215 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-5efaf8de-f958-40a8-b488-8f40ee783a31 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:53.347642 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-5efaf8de-f958-40a8-b488-8f40ee783a31 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.166725 Jul 26 07:44:53.348210 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 877/1710] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:53 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:53.626808 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6c3c05ce-7483-4c1c-8691-e4b7b4ade835 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:53.627504 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6c3c05ce-7483-4c1c-8691-e4b7b4ade835 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:53.635445 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6c3c05ce-7483-4c1c-8691-e4b7b4ade835 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:53.635898 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6c3c05ce-7483-4c1c-8691-e4b7b4ade835 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:53.636667 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6c3c05ce-7483-4c1c-8691-e4b7b4ade835 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:53.637101 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6c3c05ce-7483-4c1c-8691-e4b7b4ade835 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:53.708668 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6c3c05ce-7483-4c1c-8691-e4b7b4ade835 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:53.717518 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6c3c05ce-7483-4c1c-8691-e4b7b4ade835 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:53.719066 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6c3c05ce-7483-4c1c-8691-e4b7b4ade835 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:53.720226 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6c3c05ce-7483-4c1c-8691-e4b7b4ade835 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.099643 Jul 26 07:44:53.720788 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 834/1711] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:53 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:54.074693 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f6aba0c2-013c-4dd0-bc03-a22e1cf9cce2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:54.075402 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f6aba0c2-013c-4dd0-bc03-a22e1cf9cce2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:54.082881 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f6aba0c2-013c-4dd0-bc03-a22e1cf9cce2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:54.083385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f6aba0c2-013c-4dd0-bc03-a22e1cf9cce2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:54.084222 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f6aba0c2-013c-4dd0-bc03-a22e1cf9cce2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:54.084694 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f6aba0c2-013c-4dd0-bc03-a22e1cf9cce2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:54.214041 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f6aba0c2-013c-4dd0-bc03-a22e1cf9cce2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:54.226007 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f6aba0c2-013c-4dd0-bc03-a22e1cf9cce2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.155333 Jul 26 07:44:54.226834 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 878/1712] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:54 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:54.369638 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-4ff64fb0-3a53-4748-96ee-03425ce83a57 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:54.370211 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-4ff64fb0-3a53-4748-96ee-03425ce83a57 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:54.377058 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4ff64fb0-3a53-4748-96ee-03425ce83a57 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:54.377493 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4ff64fb0-3a53-4748-96ee-03425ce83a57 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:54.378284 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4ff64fb0-3a53-4748-96ee-03425ce83a57 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:54.378822 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4ff64fb0-3a53-4748-96ee-03425ce83a57 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:54.515362 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-4ff64fb0-3a53-4748-96ee-03425ce83a57 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:54.527986 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-4ff64fb0-3a53-4748-96ee-03425ce83a57 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.162194 Jul 26 07:44:54.528870 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 835/1713] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:54 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:54.743906 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-457b32fc-c650-439c-9b21-3e3a7252b085 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:54.744394 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-457b32fc-c650-439c-9b21-3e3a7252b085 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:54.751119 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-457b32fc-c650-439c-9b21-3e3a7252b085 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:54.751568 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-457b32fc-c650-439c-9b21-3e3a7252b085 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:54.752339 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-457b32fc-c650-439c-9b21-3e3a7252b085 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:54.752767 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-457b32fc-c650-439c-9b21-3e3a7252b085 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:54.819611 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-457b32fc-c650-439c-9b21-3e3a7252b085 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:54.828487 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-457b32fc-c650-439c-9b21-3e3a7252b085 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:54.830370 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-457b32fc-c650-439c-9b21-3e3a7252b085 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:54.831510 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-457b32fc-c650-439c-9b21-3e3a7252b085 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.091945 Jul 26 07:44:54.832065 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 879/1714] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:54 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:55.251073 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ebfc49b7-dc2c-43c3-8784-dbbdbf14cb5c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:55.251969 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ebfc49b7-dc2c-43c3-8784-dbbdbf14cb5c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:55.260677 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ebfc49b7-dc2c-43c3-8784-dbbdbf14cb5c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:55.261114 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ebfc49b7-dc2c-43c3-8784-dbbdbf14cb5c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:55.262068 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ebfc49b7-dc2c-43c3-8784-dbbdbf14cb5c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:55.262501 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ebfc49b7-dc2c-43c3-8784-dbbdbf14cb5c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:55.266447 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:55.399870 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ebfc49b7-dc2c-43c3-8784-dbbdbf14cb5c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:55.408589 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ebfc49b7-dc2c-43c3-8784-dbbdbf14cb5c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.163851 Jul 26 07:44:55.409143 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 836/1715] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:55 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:55.556150 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-55623a02-cfa9-4d26-b13d-f377669ac342 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:55.556757 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-55623a02-cfa9-4d26-b13d-f377669ac342 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:55.563702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-55623a02-cfa9-4d26-b13d-f377669ac342 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:55.564022 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-55623a02-cfa9-4d26-b13d-f377669ac342 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:55.564768 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-55623a02-cfa9-4d26-b13d-f377669ac342 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:55.565193 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-55623a02-cfa9-4d26-b13d-f377669ac342 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:55.703945 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-55623a02-cfa9-4d26-b13d-f377669ac342 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:55.712370 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-55623a02-cfa9-4d26-b13d-f377669ac342 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.162264 Jul 26 07:44:55.712944 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 880/1716] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:55 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:55.857916 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0f2e870f-cf7d-42a8-a82b-040dbfa79045 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:55.858572 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0f2e870f-cf7d-42a8-a82b-040dbfa79045 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:55.861149 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=78 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:55.867971 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0f2e870f-cf7d-42a8-a82b-040dbfa79045 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:55.868418 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0f2e870f-cf7d-42a8-a82b-040dbfa79045 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:55.869212 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0f2e870f-cf7d-42a8-a82b-040dbfa79045 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:55.869636 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0f2e870f-cf7d-42a8-a82b-040dbfa79045 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:55.940781 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0f2e870f-cf7d-42a8-a82b-040dbfa79045 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:55.949813 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0f2e870f-cf7d-42a8-a82b-040dbfa79045 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:55.951322 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0f2e870f-cf7d-42a8-a82b-040dbfa79045 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:55.952468 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0f2e870f-cf7d-42a8-a82b-040dbfa79045 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.100638 Jul 26 07:44:55.953013 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 837/1717] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:55 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:56.430591 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-18e0881e-3868-4cdc-96e6-738b7d7b4ead tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:56.431190 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-18e0881e-3868-4cdc-96e6-738b7d7b4ead tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:56.433607 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=80 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:56.439451 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-18e0881e-3868-4cdc-96e6-738b7d7b4ead tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:56.439827 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-18e0881e-3868-4cdc-96e6-738b7d7b4ead tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:56.440599 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-18e0881e-3868-4cdc-96e6-738b7d7b4ead tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:56.441024 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-18e0881e-3868-4cdc-96e6-738b7d7b4ead tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:56.569248 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-18e0881e-3868-4cdc-96e6-738b7d7b4ead tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:56.577312 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-18e0881e-3868-4cdc-96e6-738b7d7b4ead tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.150971 Jul 26 07:44:56.577893 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 881/1718] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:56 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:56.735379 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-67954dd7-177c-4056-a01d-cff90b1e951d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:56.736414 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-67954dd7-177c-4056-a01d-cff90b1e951d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:56.745809 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-67954dd7-177c-4056-a01d-cff90b1e951d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:56.746572 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-67954dd7-177c-4056-a01d-cff90b1e951d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:56.747652 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-67954dd7-177c-4056-a01d-cff90b1e951d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:56.748349 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-67954dd7-177c-4056-a01d-cff90b1e951d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:56.889624 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-67954dd7-177c-4056-a01d-cff90b1e951d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:56.898077 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-67954dd7-177c-4056-a01d-cff90b1e951d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.168318 Jul 26 07:44:56.898651 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 838/1719] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:56 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:56.975642 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-05420e22-674f-484a-b0e2-77e266520886 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:56.976250 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-05420e22-674f-484a-b0e2-77e266520886 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:56.986400 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-05420e22-674f-484a-b0e2-77e266520886 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:56.986400 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-05420e22-674f-484a-b0e2-77e266520886 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:56.987173 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-05420e22-674f-484a-b0e2-77e266520886 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:56.987591 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-05420e22-674f-484a-b0e2-77e266520886 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:57.057013 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-05420e22-674f-484a-b0e2-77e266520886 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:57.065661 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-05420e22-674f-484a-b0e2-77e266520886 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:57.067209 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-05420e22-674f-484a-b0e2-77e266520886 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:57.068364 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-05420e22-674f-484a-b0e2-77e266520886 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.096786 Jul 26 07:44:57.068944 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 882/1720] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:56 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:57.604633 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-3d92e82c-e591-4fac-b3af-a09c26028be2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:57.605519 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-3d92e82c-e591-4fac-b3af-a09c26028be2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:57.615236 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3d92e82c-e591-4fac-b3af-a09c26028be2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:57.615870 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3d92e82c-e591-4fac-b3af-a09c26028be2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:57.616976 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3d92e82c-e591-4fac-b3af-a09c26028be2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:57.617582 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3d92e82c-e591-4fac-b3af-a09c26028be2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:57.755456 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-3d92e82c-e591-4fac-b3af-a09c26028be2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:57.766796 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-3d92e82c-e591-4fac-b3af-a09c26028be2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.168069 Jul 26 07:44:57.767509 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 839/1721] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:57 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:57.921377 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7c78f2a5-1187-4764-8ad9-25429ddaab33 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:57.922144 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7c78f2a5-1187-4764-8ad9-25429ddaab33 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:57.931341 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7c78f2a5-1187-4764-8ad9-25429ddaab33 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:57.931944 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7c78f2a5-1187-4764-8ad9-25429ddaab33 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:57.932957 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7c78f2a5-1187-4764-8ad9-25429ddaab33 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:57.933552 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7c78f2a5-1187-4764-8ad9-25429ddaab33 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:58.074695 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7c78f2a5-1187-4764-8ad9-25429ddaab33 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:58.085947 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7c78f2a5-1187-4764-8ad9-25429ddaab33 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.169740 Jul 26 07:44:58.086654 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 883/1722] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:57 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:58.093865 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ae517ea4-66db-455b-ac19-554f8d51e255 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:58.094689 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ae517ea4-66db-455b-ac19-554f8d51e255 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:58.103418 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ae517ea4-66db-455b-ac19-554f8d51e255 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:58.103858 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ae517ea4-66db-455b-ac19-554f8d51e255 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:58.104673 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ae517ea4-66db-455b-ac19-554f8d51e255 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:58.105108 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ae517ea4-66db-455b-ac19-554f8d51e255 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:58.175067 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ae517ea4-66db-455b-ac19-554f8d51e255 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:58.183929 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ae517ea4-66db-455b-ac19-554f8d51e255 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:58.185421 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ae517ea4-66db-455b-ac19-554f8d51e255 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:58.186615 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ae517ea4-66db-455b-ac19-554f8d51e255 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.098643 Jul 26 07:44:58.187183 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 840/1723] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:58 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:58.790952 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-2207ce47-c0bb-4df4-90f2-137ef812ed15 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:58.791587 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2207ce47-c0bb-4df4-90f2-137ef812ed15 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:58.798114 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2207ce47-c0bb-4df4-90f2-137ef812ed15 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:58.798562 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2207ce47-c0bb-4df4-90f2-137ef812ed15 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:58.799315 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2207ce47-c0bb-4df4-90f2-137ef812ed15 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:58.799835 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2207ce47-c0bb-4df4-90f2-137ef812ed15 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:58.944327 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2207ce47-c0bb-4df4-90f2-137ef812ed15 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:58.958152 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-2207ce47-c0bb-4df4-90f2-137ef812ed15 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.170958 Jul 26 07:44:58.959178 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 884/1724] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:58 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:59.115190 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-e2ba8f1d-8e15-4cb8-bc17-9042e0e87802 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:59.115783 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-e2ba8f1d-8e15-4cb8-bc17-9042e0e87802 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:59.123471 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e2ba8f1d-8e15-4cb8-bc17-9042e0e87802 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:59.123919 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e2ba8f1d-8e15-4cb8-bc17-9042e0e87802 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:59.124677 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e2ba8f1d-8e15-4cb8-bc17-9042e0e87802 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:59.125109 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e2ba8f1d-8e15-4cb8-bc17-9042e0e87802 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:59.211936 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b05a6a39-cc71-43ba-8ffa-74a57175557c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:59.212560 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b05a6a39-cc71-43ba-8ffa-74a57175557c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:59.219582 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b05a6a39-cc71-43ba-8ffa-74a57175557c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:59.220140 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b05a6a39-cc71-43ba-8ffa-74a57175557c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:59.221419 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b05a6a39-cc71-43ba-8ffa-74a57175557c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:59.222194 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b05a6a39-cc71-43ba-8ffa-74a57175557c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:59.226708 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:59.263023 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-e2ba8f1d-8e15-4cb8-bc17-9042e0e87802 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:59.271159 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-e2ba8f1d-8e15-4cb8-bc17-9042e0e87802 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.162114 Jul 26 07:44:59.271754 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 841/1725] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:59 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:44:59.295588 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-b05a6a39-cc71-43ba-8ffa-74a57175557c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:59.305900 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-b05a6a39-cc71-43ba-8ffa-74a57175557c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:59.307426 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-b05a6a39-cc71-43ba-8ffa-74a57175557c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:44:59.308574 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b05a6a39-cc71-43ba-8ffa-74a57175557c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.102765 Jul 26 07:44:59.309129 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 885/1726] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:44:59 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:44:59.984898 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-19fda35c-c18c-4880-a32a-cc544507b7a3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:44:59.985941 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-19fda35c-c18c-4880-a32a-cc544507b7a3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:44:59.995071 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-19fda35c-c18c-4880-a32a-cc544507b7a3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:59.995521 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-19fda35c-c18c-4880-a32a-cc544507b7a3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:44:59.996283 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-19fda35c-c18c-4880-a32a-cc544507b7a3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:44:59.996714 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-19fda35c-c18c-4880-a32a-cc544507b7a3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:00.127191 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-19fda35c-c18c-4880-a32a-cc544507b7a3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:00.135399 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-19fda35c-c18c-4880-a32a-cc544507b7a3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.157031 Jul 26 07:45:00.135976 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 842/1727] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:44:59 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:00.292958 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-163ff0e3-51d1-4eaa-b4b2-95a986843a84 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:00.293563 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-163ff0e3-51d1-4eaa-b4b2-95a986843a84 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:00.300819 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-163ff0e3-51d1-4eaa-b4b2-95a986843a84 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:00.301268 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-163ff0e3-51d1-4eaa-b4b2-95a986843a84 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:00.302072 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-163ff0e3-51d1-4eaa-b4b2-95a986843a84 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:00.302502 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-163ff0e3-51d1-4eaa-b4b2-95a986843a84 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:00.331835 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7dd81a04-2162-4b01-91f5-8c3fcc81e828 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:00.332527 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7dd81a04-2162-4b01-91f5-8c3fcc81e828 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:00.339236 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7dd81a04-2162-4b01-91f5-8c3fcc81e828 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:00.339769 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7dd81a04-2162-4b01-91f5-8c3fcc81e828 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:00.340442 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7dd81a04-2162-4b01-91f5-8c3fcc81e828 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:00.340865 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7dd81a04-2162-4b01-91f5-8c3fcc81e828 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:00.406018 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7dd81a04-2162-4b01-91f5-8c3fcc81e828 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:00.415868 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7dd81a04-2162-4b01-91f5-8c3fcc81e828 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:00.417333 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7dd81a04-2162-4b01-91f5-8c3fcc81e828 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:00.418666 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7dd81a04-2162-4b01-91f5-8c3fcc81e828 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.091375 Jul 26 07:45:00.419404 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 843/1728] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:00 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:00.437937 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-163ff0e3-51d1-4eaa-b4b2-95a986843a84 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:00.446730 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-163ff0e3-51d1-4eaa-b4b2-95a986843a84 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.157771 Jul 26 07:45:00.447317 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 886/1729] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:00 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:01.157307 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-26d0cc76-8bec-41c7-9a7b-187f2cf6524e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:01.157947 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-26d0cc76-8bec-41c7-9a7b-187f2cf6524e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:01.165581 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-26d0cc76-8bec-41c7-9a7b-187f2cf6524e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:01.166065 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-26d0cc76-8bec-41c7-9a7b-187f2cf6524e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:01.166815 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-26d0cc76-8bec-41c7-9a7b-187f2cf6524e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:01.167245 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-26d0cc76-8bec-41c7-9a7b-187f2cf6524e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:01.314437 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-26d0cc76-8bec-41c7-9a7b-187f2cf6524e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:01.326825 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-26d0cc76-8bec-41c7-9a7b-187f2cf6524e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.173227 Jul 26 07:45:01.327592 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 844/1730] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:01 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:01.442275 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-0c908abf-a43c-459c-95e0-0d27db612c7a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:01.442760 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-0c908abf-a43c-459c-95e0-0d27db612c7a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:01.449673 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0c908abf-a43c-459c-95e0-0d27db612c7a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:01.450159 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0c908abf-a43c-459c-95e0-0d27db612c7a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:01.450917 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0c908abf-a43c-459c-95e0-0d27db612c7a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:01.451344 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0c908abf-a43c-459c-95e0-0d27db612c7a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:01.468472 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-3777b4b6-8c8b-4617-aded-3f060649dccc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:01.469076 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-3777b4b6-8c8b-4617-aded-3f060649dccc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:01.475533 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3777b4b6-8c8b-4617-aded-3f060649dccc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:01.475976 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3777b4b6-8c8b-4617-aded-3f060649dccc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:01.476738 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3777b4b6-8c8b-4617-aded-3f060649dccc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:01.477160 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3777b4b6-8c8b-4617-aded-3f060649dccc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:01.516059 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-0c908abf-a43c-459c-95e0-0d27db612c7a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:01.526674 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-0c908abf-a43c-459c-95e0-0d27db612c7a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:01.528143 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-0c908abf-a43c-459c-95e0-0d27db612c7a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:01.529515 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-0c908abf-a43c-459c-95e0-0d27db612c7a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.091466 Jul 26 07:45:01.530101 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 887/1731] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:01 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:01.609732 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-3777b4b6-8c8b-4617-aded-3f060649dccc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:01.617772 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-3777b4b6-8c8b-4617-aded-3f060649dccc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.153244 Jul 26 07:45:01.618366 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 845/1732] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:01 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:02.353987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-61db27b4-75fa-4fc8-b8e5-bcbad6b0dd59 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:02.354593 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-61db27b4-75fa-4fc8-b8e5-bcbad6b0dd59 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:02.361644 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-61db27b4-75fa-4fc8-b8e5-bcbad6b0dd59 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:02.362110 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-61db27b4-75fa-4fc8-b8e5-bcbad6b0dd59 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:02.362861 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-61db27b4-75fa-4fc8-b8e5-bcbad6b0dd59 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:02.363290 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-61db27b4-75fa-4fc8-b8e5-bcbad6b0dd59 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:02.499630 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-61db27b4-75fa-4fc8-b8e5-bcbad6b0dd59 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:02.507943 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-61db27b4-75fa-4fc8-b8e5-bcbad6b0dd59 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.158742 Jul 26 07:45:02.508487 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 888/1733] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:02 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:02.554377 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0883a929-f7e7-4e9e-8a43-02761a9ad14a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:02.555013 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0883a929-f7e7-4e9e-8a43-02761a9ad14a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:02.564782 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0883a929-f7e7-4e9e-8a43-02761a9ad14a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:02.565293 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0883a929-f7e7-4e9e-8a43-02761a9ad14a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:02.566458 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0883a929-f7e7-4e9e-8a43-02761a9ad14a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:02.567044 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0883a929-f7e7-4e9e-8a43-02761a9ad14a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:02.634993 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0883a929-f7e7-4e9e-8a43-02761a9ad14a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:02.639386 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-13087be9-b559-4015-9984-deb4000067f8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:02.639996 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-13087be9-b559-4015-9984-deb4000067f8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:02.643655 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0883a929-f7e7-4e9e-8a43-02761a9ad14a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:02.646229 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0883a929-f7e7-4e9e-8a43-02761a9ad14a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:02.646424 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0883a929-f7e7-4e9e-8a43-02761a9ad14a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.097848 Jul 26 07:45:02.646956 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 846/1734] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:02 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:02.647082 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-13087be9-b559-4015-9984-deb4000067f8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:02.647614 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-13087be9-b559-4015-9984-deb4000067f8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:02.648478 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-13087be9-b559-4015-9984-deb4000067f8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:02.648935 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-13087be9-b559-4015-9984-deb4000067f8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:02.786580 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-13087be9-b559-4015-9984-deb4000067f8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:02.794785 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-13087be9-b559-4015-9984-deb4000067f8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.159642 Jul 26 07:45:02.795318 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 889/1735] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:02 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:45:03.530959 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-4c8993d9-d71c-4b50-bcfe-333b8518dc4f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:03.531701 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-4c8993d9-d71c-4b50-bcfe-333b8518dc4f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:03.539949 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4c8993d9-d71c-4b50-bcfe-333b8518dc4f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:03.540521 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4c8993d9-d71c-4b50-bcfe-333b8518dc4f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:03.541476 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4c8993d9-d71c-4b50-bcfe-333b8518dc4f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:03.542062 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4c8993d9-d71c-4b50-bcfe-333b8518dc4f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:03.668685 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-284be5c3-bf82-4da8-8b2d-6ee84d03eaad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:03.669304 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-284be5c3-bf82-4da8-8b2d-6ee84d03eaad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:03.675867 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-284be5c3-bf82-4da8-8b2d-6ee84d03eaad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:03.676316 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-284be5c3-bf82-4da8-8b2d-6ee84d03eaad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:03.677093 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-284be5c3-bf82-4da8-8b2d-6ee84d03eaad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:03.677525 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-284be5c3-bf82-4da8-8b2d-6ee84d03eaad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:03.682390 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-4c8993d9-d71c-4b50-bcfe-333b8518dc4f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:03.690771 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-4c8993d9-d71c-4b50-bcfe-333b8518dc4f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.165078 Jul 26 07:45:03.691489 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 847/1736] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:03 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:03.747847 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-284be5c3-bf82-4da8-8b2d-6ee84d03eaad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:03.756498 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-284be5c3-bf82-4da8-8b2d-6ee84d03eaad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:03.758049 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-284be5c3-bf82-4da8-8b2d-6ee84d03eaad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:03.759368 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-284be5c3-bf82-4da8-8b2d-6ee84d03eaad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.094716 Jul 26 07:45:03.759922 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 890/1737] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:03 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:03.819408 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-44179b7f-8d84-4a8b-b7c7-34c966f7cfb9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:03.820352 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-44179b7f-8d84-4a8b-b7c7-34c966f7cfb9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:03.827320 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-44179b7f-8d84-4a8b-b7c7-34c966f7cfb9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:03.827765 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-44179b7f-8d84-4a8b-b7c7-34c966f7cfb9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:03.828835 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-44179b7f-8d84-4a8b-b7c7-34c966f7cfb9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:03.829296 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-44179b7f-8d84-4a8b-b7c7-34c966f7cfb9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:03.962442 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-44179b7f-8d84-4a8b-b7c7-34c966f7cfb9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:03.971195 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-44179b7f-8d84-4a8b-b7c7-34c966f7cfb9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.158280 Jul 26 07:45:03.971776 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 848/1738] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:03 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:04.713463 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b60fe442-1553-4bed-b624-3d3e4fb96d67 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:04.714055 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b60fe442-1553-4bed-b624-3d3e4fb96d67 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:04.721050 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b60fe442-1553-4bed-b624-3d3e4fb96d67 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:04.721500 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b60fe442-1553-4bed-b624-3d3e4fb96d67 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:04.722305 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b60fe442-1553-4bed-b624-3d3e4fb96d67 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:04.722751 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b60fe442-1553-4bed-b624-3d3e4fb96d67 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:04.781947 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-65eff3d6-8b9d-4c84-8b33-81e2934be108 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:04.782581 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-65eff3d6-8b9d-4c84-8b33-81e2934be108 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:04.790525 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-65eff3d6-8b9d-4c84-8b33-81e2934be108 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:04.791629 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-65eff3d6-8b9d-4c84-8b33-81e2934be108 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:04.792466 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-65eff3d6-8b9d-4c84-8b33-81e2934be108 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:04.792900 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-65eff3d6-8b9d-4c84-8b33-81e2934be108 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:04.859611 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-65eff3d6-8b9d-4c84-8b33-81e2934be108 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:04.860307 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-b60fe442-1553-4bed-b624-3d3e4fb96d67 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:04.868086 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b60fe442-1553-4bed-b624-3d3e4fb96d67 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.158696 Jul 26 07:45:04.868419 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-65eff3d6-8b9d-4c84-8b33-81e2934be108 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:04.868714 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 891/1739] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:04 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:04.869948 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-65eff3d6-8b9d-4c84-8b33-81e2934be108 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:04.871104 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-65eff3d6-8b9d-4c84-8b33-81e2934be108 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.093327 Jul 26 07:45:04.871656 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 849/1740] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:04 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 07:45:04.993668 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ff92c3e8-5194-4079-b384-606b8413d75f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:04.994352 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ff92c3e8-5194-4079-b384-606b8413d75f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:05.000904 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ff92c3e8-5194-4079-b384-606b8413d75f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:05.001352 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ff92c3e8-5194-4079-b384-606b8413d75f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:05.002157 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ff92c3e8-5194-4079-b384-606b8413d75f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:05.002591 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ff92c3e8-5194-4079-b384-606b8413d75f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:05.138832 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ff92c3e8-5194-4079-b384-606b8413d75f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:05.147955 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ff92c3e8-5194-4079-b384-606b8413d75f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.158954 Jul 26 07:45:05.148529 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 892/1741] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:04 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:05.890432 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-904f12fe-8f38-4ea5-b52c-9ee843ea18c2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:05.891172 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-904f12fe-8f38-4ea5-b52c-9ee843ea18c2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:05.893971 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f91aca22-6dc4-4d8f-a74a-85349aa9f90d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:05.894696 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f91aca22-6dc4-4d8f-a74a-85349aa9f90d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:05.898230 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-904f12fe-8f38-4ea5-b52c-9ee843ea18c2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:05.898678 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-904f12fe-8f38-4ea5-b52c-9ee843ea18c2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:05.899449 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-904f12fe-8f38-4ea5-b52c-9ee843ea18c2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:05.899925 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-904f12fe-8f38-4ea5-b52c-9ee843ea18c2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:05.901604 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f91aca22-6dc4-4d8f-a74a-85349aa9f90d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:05.902084 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f91aca22-6dc4-4d8f-a74a-85349aa9f90d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:05.902822 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f91aca22-6dc4-4d8f-a74a-85349aa9f90d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:05.903247 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f91aca22-6dc4-4d8f-a74a-85349aa9f90d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:05.966127 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f91aca22-6dc4-4d8f-a74a-85349aa9f90d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:05.976040 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f91aca22-6dc4-4d8f-a74a-85349aa9f90d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:05.977527 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f91aca22-6dc4-4d8f-a74a-85349aa9f90d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:05.978709 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f91aca22-6dc4-4d8f-a74a-85349aa9f90d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.088727 Jul 26 07:45:05.979266 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 893/1742] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:05 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:06.037991 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-904f12fe-8f38-4ea5-b52c-9ee843ea18c2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:06.047307 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-904f12fe-8f38-4ea5-b52c-9ee843ea18c2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.160905 Jul 26 07:45:06.047880 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 850/1743] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:05 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:06.169873 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-28dacd66-80f9-45e9-9698-41313f7c4438 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:06.170596 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-28dacd66-80f9-45e9-9698-41313f7c4438 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:06.177149 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-28dacd66-80f9-45e9-9698-41313f7c4438 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:06.177590 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-28dacd66-80f9-45e9-9698-41313f7c4438 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:06.178375 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-28dacd66-80f9-45e9-9698-41313f7c4438 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:06.178794 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-28dacd66-80f9-45e9-9698-41313f7c4438 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:06.324641 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-28dacd66-80f9-45e9-9698-41313f7c4438 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:06.336790 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-28dacd66-80f9-45e9-9698-41313f7c4438 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.170664 Jul 26 07:45:06.337598 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 894/1744] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:06 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:07.006750 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-acff0600-013c-446f-976e-cb74fbce3bfa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:07.007681 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-acff0600-013c-446f-976e-cb74fbce3bfa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:07.015070 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-acff0600-013c-446f-976e-cb74fbce3bfa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:07.015512 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-acff0600-013c-446f-976e-cb74fbce3bfa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:07.016266 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-acff0600-013c-446f-976e-cb74fbce3bfa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:07.016693 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-acff0600-013c-446f-976e-cb74fbce3bfa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:07.068643 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6d91be33-3d4b-4444-9c7c-554892570082 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:07.069338 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-6d91be33-3d4b-4444-9c7c-554892570082 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:07.076368 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6d91be33-3d4b-4444-9c7c-554892570082 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:07.076895 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6d91be33-3d4b-4444-9c7c-554892570082 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:07.077696 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6d91be33-3d4b-4444-9c7c-554892570082 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:07.078304 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6d91be33-3d4b-4444-9c7c-554892570082 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:07.081022 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-acff0600-013c-446f-976e-cb74fbce3bfa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:07.089772 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-acff0600-013c-446f-976e-cb74fbce3bfa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:07.091259 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-acff0600-013c-446f-976e-cb74fbce3bfa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:07.092424 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-acff0600-013c-446f-976e-cb74fbce3bfa tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.091523 Jul 26 07:45:07.092964 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 851/1745] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:06 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:07.216590 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-6d91be33-3d4b-4444-9c7c-554892570082 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:07.229007 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6d91be33-3d4b-4444-9c7c-554892570082 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.164027 Jul 26 07:45:07.229812 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 895/1746] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:07 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:07.365926 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c266fa71-8db6-443a-9b23-804c9c36fbd5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:07.366544 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c266fa71-8db6-443a-9b23-804c9c36fbd5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:07.373482 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c266fa71-8db6-443a-9b23-804c9c36fbd5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:07.373967 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c266fa71-8db6-443a-9b23-804c9c36fbd5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:07.374725 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c266fa71-8db6-443a-9b23-804c9c36fbd5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:07.375151 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c266fa71-8db6-443a-9b23-804c9c36fbd5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:07.517519 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-c266fa71-8db6-443a-9b23-804c9c36fbd5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:07.522463 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:07.529505 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c266fa71-8db6-443a-9b23-804c9c36fbd5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.168795 Jul 26 07:45:07.530351 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 852/1747] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:07 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:08.116033 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-43034234-5a69-4de9-9ddd-373cbf4ab093 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:08.116678 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-43034234-5a69-4de9-9ddd-373cbf4ab093 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:08.124800 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-43034234-5a69-4de9-9ddd-373cbf4ab093 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:08.125241 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-43034234-5a69-4de9-9ddd-373cbf4ab093 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:08.126025 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-43034234-5a69-4de9-9ddd-373cbf4ab093 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:08.126453 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-43034234-5a69-4de9-9ddd-373cbf4ab093 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:08.188903 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-43034234-5a69-4de9-9ddd-373cbf4ab093 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:08.200787 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-43034234-5a69-4de9-9ddd-373cbf4ab093 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:08.203027 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-43034234-5a69-4de9-9ddd-373cbf4ab093 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:08.205164 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-43034234-5a69-4de9-9ddd-373cbf4ab093 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.093141 Jul 26 07:45:08.206079 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 896/1748] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:08 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:08.252633 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f96778e7-a796-4140-b9fa-046e5ec4f213 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:08.253249 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-f96778e7-a796-4140-b9fa-046e5ec4f213 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:08.260436 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f96778e7-a796-4140-b9fa-046e5ec4f213 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:08.260884 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f96778e7-a796-4140-b9fa-046e5ec4f213 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:08.261643 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f96778e7-a796-4140-b9fa-046e5ec4f213 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:08.262111 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f96778e7-a796-4140-b9fa-046e5ec4f213 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:08.403552 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-f96778e7-a796-4140-b9fa-046e5ec4f213 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:08.415561 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f96778e7-a796-4140-b9fa-046e5ec4f213 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.166540 Jul 26 07:45:08.416184 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 853/1749] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:08 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:08.553544 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-98292e84-eaa5-4402-acb3-f14f5b4b0e9e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:08.554437 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-98292e84-eaa5-4402-acb3-f14f5b4b0e9e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:08.562939 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-98292e84-eaa5-4402-acb3-f14f5b4b0e9e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:08.563525 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-98292e84-eaa5-4402-acb3-f14f5b4b0e9e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:08.564566 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-98292e84-eaa5-4402-acb3-f14f5b4b0e9e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:08.565204 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-98292e84-eaa5-4402-acb3-f14f5b4b0e9e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:08.711856 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-98292e84-eaa5-4402-acb3-f14f5b4b0e9e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:08.720115 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-98292e84-eaa5-4402-acb3-f14f5b4b0e9e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.171859 Jul 26 07:45:08.720696 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 897/1750] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:08 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:09.231367 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-cb914355-3825-470c-b645-8b43833512b8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:09.232028 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-cb914355-3825-470c-b645-8b43833512b8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:09.238986 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cb914355-3825-470c-b645-8b43833512b8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:09.239480 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cb914355-3825-470c-b645-8b43833512b8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:09.240195 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cb914355-3825-470c-b645-8b43833512b8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:09.240624 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cb914355-3825-470c-b645-8b43833512b8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:09.303759 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-cb914355-3825-470c-b645-8b43833512b8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:09.312418 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-cb914355-3825-470c-b645-8b43833512b8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:09.313944 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-cb914355-3825-470c-b645-8b43833512b8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:09.315094 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-cb914355-3825-470c-b645-8b43833512b8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.088076 Jul 26 07:45:09.315678 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 854/1751] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:09 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:09.438188 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-bddd67f2-449d-4fb0-a4da-261a200245bc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:09.438788 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-bddd67f2-449d-4fb0-a4da-261a200245bc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:09.447862 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bddd67f2-449d-4fb0-a4da-261a200245bc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:09.448437 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bddd67f2-449d-4fb0-a4da-261a200245bc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:09.449460 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bddd67f2-449d-4fb0-a4da-261a200245bc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:09.449945 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bddd67f2-449d-4fb0-a4da-261a200245bc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:09.590534 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-bddd67f2-449d-4fb0-a4da-261a200245bc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:09.602772 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-bddd67f2-449d-4fb0-a4da-261a200245bc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.169042 Jul 26 07:45:09.603509 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 898/1752] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:09 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:09.742842 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-54efa3be-995b-4920-88fd-5fafb7529928 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:09.743693 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-54efa3be-995b-4920-88fd-5fafb7529928 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:09.750399 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-54efa3be-995b-4920-88fd-5fafb7529928 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:09.750845 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-54efa3be-995b-4920-88fd-5fafb7529928 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:09.751594 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-54efa3be-995b-4920-88fd-5fafb7529928 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:09.752015 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-54efa3be-995b-4920-88fd-5fafb7529928 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:09.896238 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-54efa3be-995b-4920-88fd-5fafb7529928 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:09.908917 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-54efa3be-995b-4920-88fd-5fafb7529928 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.170245 Jul 26 07:45:09.909579 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 855/1753] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:09 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:10.338561 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ca24edad-a0e3-4535-acdc-b338fe9d1c1f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:10.339165 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ca24edad-a0e3-4535-acdc-b338fe9d1c1f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:10.345681 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ca24edad-a0e3-4535-acdc-b338fe9d1c1f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:10.346150 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ca24edad-a0e3-4535-acdc-b338fe9d1c1f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:10.346914 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ca24edad-a0e3-4535-acdc-b338fe9d1c1f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:10.347332 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ca24edad-a0e3-4535-acdc-b338fe9d1c1f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:10.416576 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ca24edad-a0e3-4535-acdc-b338fe9d1c1f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:10.426160 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ca24edad-a0e3-4535-acdc-b338fe9d1c1f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:10.427771 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ca24edad-a0e3-4535-acdc-b338fe9d1c1f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:10.428969 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ca24edad-a0e3-4535-acdc-b338fe9d1c1f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.094531 Jul 26 07:45:10.429872 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 899/1754] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:10 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:10.630133 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f314a085-b8c8-4602-89e9-3a7345b1e4a3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:10.630701 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-f314a085-b8c8-4602-89e9-3a7345b1e4a3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:10.637922 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f314a085-b8c8-4602-89e9-3a7345b1e4a3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:10.638376 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f314a085-b8c8-4602-89e9-3a7345b1e4a3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:10.639161 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f314a085-b8c8-4602-89e9-3a7345b1e4a3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:10.639600 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f314a085-b8c8-4602-89e9-3a7345b1e4a3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:10.786102 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-f314a085-b8c8-4602-89e9-3a7345b1e4a3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:10.794618 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f314a085-b8c8-4602-89e9-3a7345b1e4a3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.168615 Jul 26 07:45:10.795197 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 856/1755] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:10 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:10.930890 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-39e5f8e8-ecf4-41db-978d-4987bcd5a6f9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:10.931508 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-39e5f8e8-ecf4-41db-978d-4987bcd5a6f9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:10.938562 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-39e5f8e8-ecf4-41db-978d-4987bcd5a6f9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:10.939071 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-39e5f8e8-ecf4-41db-978d-4987bcd5a6f9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:10.940143 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-39e5f8e8-ecf4-41db-978d-4987bcd5a6f9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:10.940637 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-39e5f8e8-ecf4-41db-978d-4987bcd5a6f9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:11.075444 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-39e5f8e8-ecf4-41db-978d-4987bcd5a6f9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:11.088069 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-39e5f8e8-ecf4-41db-978d-4987bcd5a6f9 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.160952 Jul 26 07:45:11.088638 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 900/1756] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:10 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:11.452884 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-800bba9b-4146-4f70-bd6d-5637b791ba74 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:11.453889 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-800bba9b-4146-4f70-bd6d-5637b791ba74 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:11.460473 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-800bba9b-4146-4f70-bd6d-5637b791ba74 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:11.460921 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-800bba9b-4146-4f70-bd6d-5637b791ba74 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:11.461683 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-800bba9b-4146-4f70-bd6d-5637b791ba74 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:11.462156 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-800bba9b-4146-4f70-bd6d-5637b791ba74 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:11.524516 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-800bba9b-4146-4f70-bd6d-5637b791ba74 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:11.533409 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-800bba9b-4146-4f70-bd6d-5637b791ba74 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:11.534942 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-800bba9b-4146-4f70-bd6d-5637b791ba74 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:11.536094 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-800bba9b-4146-4f70-bd6d-5637b791ba74 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.087235 Jul 26 07:45:11.536660 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 857/1757] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:11 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:11.816372 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f7edca07-2df8-4dd7-9441-47f3fffb8a8c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:11.817002 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f7edca07-2df8-4dd7-9441-47f3fffb8a8c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:11.823926 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f7edca07-2df8-4dd7-9441-47f3fffb8a8c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:11.824392 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f7edca07-2df8-4dd7-9441-47f3fffb8a8c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:11.825195 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f7edca07-2df8-4dd7-9441-47f3fffb8a8c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:11.825635 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f7edca07-2df8-4dd7-9441-47f3fffb8a8c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:11.956009 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f7edca07-2df8-4dd7-9441-47f3fffb8a8c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:11.959548 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:11.964523 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f7edca07-2df8-4dd7-9441-47f3fffb8a8c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.152317 Jul 26 07:45:11.965065 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 901/1758] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:11 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:12.111123 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7dff2e45-eb82-43fe-87bd-282870e9844c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:12.111855 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7dff2e45-eb82-43fe-87bd-282870e9844c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:12.120548 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7dff2e45-eb82-43fe-87bd-282870e9844c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:12.121139 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7dff2e45-eb82-43fe-87bd-282870e9844c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:12.122165 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7dff2e45-eb82-43fe-87bd-282870e9844c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:12.122736 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7dff2e45-eb82-43fe-87bd-282870e9844c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:12.262466 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7dff2e45-eb82-43fe-87bd-282870e9844c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:12.271102 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7dff2e45-eb82-43fe-87bd-282870e9844c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.165364 Jul 26 07:45:12.271674 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 858/1759] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:12 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:12.560480 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3902f622-6e6c-44a0-b1d5-f1885981045b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:12.561080 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3902f622-6e6c-44a0-b1d5-f1885981045b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:12.567894 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3902f622-6e6c-44a0-b1d5-f1885981045b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:12.568329 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3902f622-6e6c-44a0-b1d5-f1885981045b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:12.569099 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3902f622-6e6c-44a0-b1d5-f1885981045b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:12.569525 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3902f622-6e6c-44a0-b1d5-f1885981045b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:12.635884 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3902f622-6e6c-44a0-b1d5-f1885981045b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:12.644835 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3902f622-6e6c-44a0-b1d5-f1885981045b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:12.646360 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3902f622-6e6c-44a0-b1d5-f1885981045b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:12.647509 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3902f622-6e6c-44a0-b1d5-f1885981045b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.091205 Jul 26 07:45:12.648389 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 902/1760] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:12 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:12.990458 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a47d24fd-9fe1-404a-aa43-b216135dd43c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:12.991482 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a47d24fd-9fe1-404a-aa43-b216135dd43c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:13.001827 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a47d24fd-9fe1-404a-aa43-b216135dd43c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:13.002697 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a47d24fd-9fe1-404a-aa43-b216135dd43c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:13.004035 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a47d24fd-9fe1-404a-aa43-b216135dd43c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:13.004792 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a47d24fd-9fe1-404a-aa43-b216135dd43c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:13.140114 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a47d24fd-9fe1-404a-aa43-b216135dd43c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:13.151706 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a47d24fd-9fe1-404a-aa43-b216135dd43c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.167944 Jul 26 07:45:13.152374 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 859/1761] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:12 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:13.295360 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a496ad5c-de18-4bd2-a9db-f6ed932c4bd5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:13.295931 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a496ad5c-de18-4bd2-a9db-f6ed932c4bd5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:13.306438 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a496ad5c-de18-4bd2-a9db-f6ed932c4bd5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:13.307013 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a496ad5c-de18-4bd2-a9db-f6ed932c4bd5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:13.307778 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a496ad5c-de18-4bd2-a9db-f6ed932c4bd5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:13.308212 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a496ad5c-de18-4bd2-a9db-f6ed932c4bd5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:13.446405 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-a496ad5c-de18-4bd2-a9db-f6ed932c4bd5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:13.463670 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a496ad5c-de18-4bd2-a9db-f6ed932c4bd5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.174468 Jul 26 07:45:13.464252 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 903/1762] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:13 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:13.671101 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-e0ffb517-1168-4608-acc8-70de67e1f544 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:13.671636 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-e0ffb517-1168-4608-acc8-70de67e1f544 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:13.678157 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e0ffb517-1168-4608-acc8-70de67e1f544 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:13.678611 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e0ffb517-1168-4608-acc8-70de67e1f544 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:13.679360 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e0ffb517-1168-4608-acc8-70de67e1f544 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:13.679771 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e0ffb517-1168-4608-acc8-70de67e1f544 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:13.744593 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-e0ffb517-1168-4608-acc8-70de67e1f544 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:13.755189 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-e0ffb517-1168-4608-acc8-70de67e1f544 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:13.756681 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-e0ffb517-1168-4608-acc8-70de67e1f544 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:13.757882 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-e0ffb517-1168-4608-acc8-70de67e1f544 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.090955 Jul 26 07:45:13.758439 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 860/1763] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:13 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:14.174837 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8f894bfc-d259-45e5-bb1a-787a4975af39 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:14.175635 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8f894bfc-d259-45e5-bb1a-787a4975af39 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:14.183496 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8f894bfc-d259-45e5-bb1a-787a4975af39 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:14.183941 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8f894bfc-d259-45e5-bb1a-787a4975af39 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:14.184690 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8f894bfc-d259-45e5-bb1a-787a4975af39 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:14.185118 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8f894bfc-d259-45e5-bb1a-787a4975af39 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:14.325767 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8f894bfc-d259-45e5-bb1a-787a4975af39 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:14.334547 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8f894bfc-d259-45e5-bb1a-787a4975af39 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.165042 Jul 26 07:45:14.335094 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 904/1764] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:14 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:14.487360 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-714b4d8b-1f2f-4151-8e20-d4bd5d3df6d1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:14.488133 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-714b4d8b-1f2f-4151-8e20-d4bd5d3df6d1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:14.498698 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-714b4d8b-1f2f-4151-8e20-d4bd5d3df6d1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:14.499447 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-714b4d8b-1f2f-4151-8e20-d4bd5d3df6d1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:14.500726 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-714b4d8b-1f2f-4151-8e20-d4bd5d3df6d1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:14.501534 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-714b4d8b-1f2f-4151-8e20-d4bd5d3df6d1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:14.658245 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-714b4d8b-1f2f-4151-8e20-d4bd5d3df6d1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:14.671583 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-714b4d8b-1f2f-4151-8e20-d4bd5d3df6d1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.189898 Jul 26 07:45:14.672480 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 861/1765] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:14 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:14.783987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-022d6b3e-f163-467d-a836-521d2b2cb3c3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:14.785186 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-022d6b3e-f163-467d-a836-521d2b2cb3c3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:14.792396 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-022d6b3e-f163-467d-a836-521d2b2cb3c3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:14.792872 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-022d6b3e-f163-467d-a836-521d2b2cb3c3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:14.793779 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-022d6b3e-f163-467d-a836-521d2b2cb3c3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:14.794209 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-022d6b3e-f163-467d-a836-521d2b2cb3c3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:14.877296 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-022d6b3e-f163-467d-a836-521d2b2cb3c3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:14.887583 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-022d6b3e-f163-467d-a836-521d2b2cb3c3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:14.889190 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-022d6b3e-f163-467d-a836-521d2b2cb3c3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:14.890734 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-022d6b3e-f163-467d-a836-521d2b2cb3c3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.113170 Jul 26 07:45:14.891406 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 905/1766] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:14 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 07:45:15.356424 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7ab2d244-48d8-4222-9cef-e9abeadd524b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:15.357014 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7ab2d244-48d8-4222-9cef-e9abeadd524b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:15.363495 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7ab2d244-48d8-4222-9cef-e9abeadd524b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:15.363937 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7ab2d244-48d8-4222-9cef-e9abeadd524b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:15.364689 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7ab2d244-48d8-4222-9cef-e9abeadd524b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:15.365121 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7ab2d244-48d8-4222-9cef-e9abeadd524b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:15.496930 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7ab2d244-48d8-4222-9cef-e9abeadd524b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:15.505253 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7ab2d244-48d8-4222-9cef-e9abeadd524b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.152864 Jul 26 07:45:15.505833 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 862/1767] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:15 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:15.695020 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8f3efef9-3d49-4f17-ba01-7a270df3d030 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:15.695596 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8f3efef9-3d49-4f17-ba01-7a270df3d030 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:15.702735 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8f3efef9-3d49-4f17-ba01-7a270df3d030 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:15.703174 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8f3efef9-3d49-4f17-ba01-7a270df3d030 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:15.704272 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8f3efef9-3d49-4f17-ba01-7a270df3d030 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:15.704698 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8f3efef9-3d49-4f17-ba01-7a270df3d030 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:15.837993 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8f3efef9-3d49-4f17-ba01-7a270df3d030 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:15.850317 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8f3efef9-3d49-4f17-ba01-7a270df3d030 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.158963 Jul 26 07:45:15.851096 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 906/1768] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:15 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:15.917591 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0c03cb5a-b99d-47b5-ad19-12ae10cad932 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:15.918237 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0c03cb5a-b99d-47b5-ad19-12ae10cad932 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:15.924708 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0c03cb5a-b99d-47b5-ad19-12ae10cad932 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:15.925156 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0c03cb5a-b99d-47b5-ad19-12ae10cad932 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:15.925951 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0c03cb5a-b99d-47b5-ad19-12ae10cad932 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:15.926382 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0c03cb5a-b99d-47b5-ad19-12ae10cad932 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:15.997478 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0c03cb5a-b99d-47b5-ad19-12ae10cad932 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:16.006067 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0c03cb5a-b99d-47b5-ad19-12ae10cad932 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:16.007545 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0c03cb5a-b99d-47b5-ad19-12ae10cad932 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:16.008688 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0c03cb5a-b99d-47b5-ad19-12ae10cad932 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.095244 Jul 26 07:45:16.009252 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 863/1769] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:15 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:16.529577 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-71536f4b-fbc6-40a5-a7fe-6b7fa42c5a43 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:16.530528 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-71536f4b-fbc6-40a5-a7fe-6b7fa42c5a43 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:16.539812 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-71536f4b-fbc6-40a5-a7fe-6b7fa42c5a43 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:16.540508 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-71536f4b-fbc6-40a5-a7fe-6b7fa42c5a43 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:16.541599 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-71536f4b-fbc6-40a5-a7fe-6b7fa42c5a43 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:16.542055 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-71536f4b-fbc6-40a5-a7fe-6b7fa42c5a43 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:16.698788 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-71536f4b-fbc6-40a5-a7fe-6b7fa42c5a43 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:16.710998 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-71536f4b-fbc6-40a5-a7fe-6b7fa42c5a43 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.187589 Jul 26 07:45:16.711550 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 907/1770] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:16 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:16.873670 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d7c2188a-10a0-4494-95f1-ec385c4fc1bb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:16.874312 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d7c2188a-10a0-4494-95f1-ec385c4fc1bb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:16.881419 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d7c2188a-10a0-4494-95f1-ec385c4fc1bb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:16.881891 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d7c2188a-10a0-4494-95f1-ec385c4fc1bb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:16.882647 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d7c2188a-10a0-4494-95f1-ec385c4fc1bb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:16.883071 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d7c2188a-10a0-4494-95f1-ec385c4fc1bb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:17.032500 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7f388579-d802-4995-a5ab-69da97ec97f8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:17.033113 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7f388579-d802-4995-a5ab-69da97ec97f8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:17.037217 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d7c2188a-10a0-4494-95f1-ec385c4fc1bb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:17.039436 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7f388579-d802-4995-a5ab-69da97ec97f8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:17.040011 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7f388579-d802-4995-a5ab-69da97ec97f8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:17.040818 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7f388579-d802-4995-a5ab-69da97ec97f8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:17.041297 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7f388579-d802-4995-a5ab-69da97ec97f8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:17.045702 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d7c2188a-10a0-4494-95f1-ec385c4fc1bb tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.176018 Jul 26 07:45:17.046374 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 864/1771] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:16 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:17.110410 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7f388579-d802-4995-a5ab-69da97ec97f8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:17.119501 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7f388579-d802-4995-a5ab-69da97ec97f8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:17.121018 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7f388579-d802-4995-a5ab-69da97ec97f8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:17.122184 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7f388579-d802-4995-a5ab-69da97ec97f8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.094107 Jul 26 07:45:17.122762 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 908/1772] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:17 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:17.738274 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8678d8c4-49dc-454f-b719-fa3940d1c081 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:17.738926 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8678d8c4-49dc-454f-b719-fa3940d1c081 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:17.746449 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8678d8c4-49dc-454f-b719-fa3940d1c081 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:17.746895 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8678d8c4-49dc-454f-b719-fa3940d1c081 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:17.747646 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8678d8c4-49dc-454f-b719-fa3940d1c081 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:17.748066 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8678d8c4-49dc-454f-b719-fa3940d1c081 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:17.879013 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8678d8c4-49dc-454f-b719-fa3940d1c081 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:17.887482 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8678d8c4-49dc-454f-b719-fa3940d1c081 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.154440 Jul 26 07:45:17.888056 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 865/1773] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:17 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:18.067650 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-00b3487f-64fb-4bda-abe5-4abdddaa4782 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:18.068293 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-00b3487f-64fb-4bda-abe5-4abdddaa4782 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:18.075947 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-00b3487f-64fb-4bda-abe5-4abdddaa4782 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:18.076395 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-00b3487f-64fb-4bda-abe5-4abdddaa4782 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:18.077157 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-00b3487f-64fb-4bda-abe5-4abdddaa4782 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:18.077584 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-00b3487f-64fb-4bda-abe5-4abdddaa4782 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:18.145231 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-73bbb818-fdd7-4ee9-85ac-11521725e7e5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:18.145876 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-73bbb818-fdd7-4ee9-85ac-11521725e7e5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:18.152039 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-73bbb818-fdd7-4ee9-85ac-11521725e7e5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:18.152481 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-73bbb818-fdd7-4ee9-85ac-11521725e7e5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:18.153232 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-73bbb818-fdd7-4ee9-85ac-11521725e7e5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:18.153657 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-73bbb818-fdd7-4ee9-85ac-11521725e7e5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:18.214672 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-00b3487f-64fb-4bda-abe5-4abdddaa4782 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:18.218831 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-73bbb818-fdd7-4ee9-85ac-11521725e7e5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:18.222909 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-00b3487f-64fb-4bda-abe5-4abdddaa4782 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.159153 Jul 26 07:45:18.223510 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 909/1774] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:18 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:18.227768 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-73bbb818-fdd7-4ee9-85ac-11521725e7e5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:18.229770 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-73bbb818-fdd7-4ee9-85ac-11521725e7e5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:18.230932 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-73bbb818-fdd7-4ee9-85ac-11521725e7e5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.089794 Jul 26 07:45:18.231471 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 866/1775] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:18 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:18.909489 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a0113b5a-ef52-4943-8ea0-bb8efdb37c8c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:18.910221 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a0113b5a-ef52-4943-8ea0-bb8efdb37c8c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:18.917360 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a0113b5a-ef52-4943-8ea0-bb8efdb37c8c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:18.917835 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a0113b5a-ef52-4943-8ea0-bb8efdb37c8c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:18.918593 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a0113b5a-ef52-4943-8ea0-bb8efdb37c8c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:18.919024 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a0113b5a-ef52-4943-8ea0-bb8efdb37c8c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:19.065847 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-a0113b5a-ef52-4943-8ea0-bb8efdb37c8c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:19.074508 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a0113b5a-ef52-4943-8ea0-bb8efdb37c8c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.169394 Jul 26 07:45:19.075144 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 910/1776] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:18 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:19.246421 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-e12b1556-1850-43d9-9181-8ea685588a5d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:19.246970 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-e12b1556-1850-43d9-9181-8ea685588a5d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:19.253613 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-bdba7daf-9513-4be8-8156-7032bf9034ee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:19.254011 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e12b1556-1850-43d9-9181-8ea685588a5d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:19.254401 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-bdba7daf-9513-4be8-8156-7032bf9034ee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:19.254550 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e12b1556-1850-43d9-9181-8ea685588a5d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:19.255217 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e12b1556-1850-43d9-9181-8ea685588a5d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:19.255651 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e12b1556-1850-43d9-9181-8ea685588a5d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:19.260663 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bdba7daf-9513-4be8-8156-7032bf9034ee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:19.261130 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bdba7daf-9513-4be8-8156-7032bf9034ee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:19.261916 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bdba7daf-9513-4be8-8156-7032bf9034ee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:19.262348 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bdba7daf-9513-4be8-8156-7032bf9034ee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:19.326873 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-bdba7daf-9513-4be8-8156-7032bf9034ee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:19.335986 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-bdba7daf-9513-4be8-8156-7032bf9034ee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:19.337465 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-bdba7daf-9513-4be8-8156-7032bf9034ee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:19.338666 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-bdba7daf-9513-4be8-8156-7032bf9034ee tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.089115 Jul 26 07:45:19.339267 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 911/1777] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:19 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:19.398781 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-e12b1556-1850-43d9-9181-8ea685588a5d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:19.407195 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-e12b1556-1850-43d9-9181-8ea685588a5d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.165903 Jul 26 07:45:19.407783 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 867/1778] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:19 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:20.098576 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d1e9345b-ced8-4d96-a38e-595e05edbb54 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:20.099392 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d1e9345b-ced8-4d96-a38e-595e05edbb54 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:20.108611 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d1e9345b-ced8-4d96-a38e-595e05edbb54 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:20.109234 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d1e9345b-ced8-4d96-a38e-595e05edbb54 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:20.110300 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d1e9345b-ced8-4d96-a38e-595e05edbb54 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:20.110929 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d1e9345b-ced8-4d96-a38e-595e05edbb54 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:20.249847 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d1e9345b-ced8-4d96-a38e-595e05edbb54 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:20.257992 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d1e9345b-ced8-4d96-a38e-595e05edbb54 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.164708 Jul 26 07:45:20.258533 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 912/1779] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:20 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:20.362853 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8b7e32db-cd2d-4d0e-884e-ec8366c76fc1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:20.363430 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8b7e32db-cd2d-4d0e-884e-ec8366c76fc1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:20.370231 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8b7e32db-cd2d-4d0e-884e-ec8366c76fc1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:20.370682 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8b7e32db-cd2d-4d0e-884e-ec8366c76fc1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:20.371474 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8b7e32db-cd2d-4d0e-884e-ec8366c76fc1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:20.371912 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8b7e32db-cd2d-4d0e-884e-ec8366c76fc1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:20.432732 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-5a12ec0e-4664-4979-bd12-f8a556682eaa tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:20.433366 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-5a12ec0e-4664-4979-bd12-f8a556682eaa tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:20.439848 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5a12ec0e-4664-4979-bd12-f8a556682eaa tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:20.440298 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5a12ec0e-4664-4979-bd12-f8a556682eaa tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:20.441084 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5a12ec0e-4664-4979-bd12-f8a556682eaa tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:20.441510 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5a12ec0e-4664-4979-bd12-f8a556682eaa tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:20.442420 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8b7e32db-cd2d-4d0e-884e-ec8366c76fc1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:20.451422 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8b7e32db-cd2d-4d0e-884e-ec8366c76fc1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:20.452892 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8b7e32db-cd2d-4d0e-884e-ec8366c76fc1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:20.454441 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8b7e32db-cd2d-4d0e-884e-ec8366c76fc1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.095664 Jul 26 07:45:20.455003 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 868/1780] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:20 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:20.578990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-5a12ec0e-4664-4979-bd12-f8a556682eaa tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:20.587504 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-5a12ec0e-4664-4979-bd12-f8a556682eaa tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.158723 Jul 26 07:45:20.588073 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 913/1781] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:20 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:21.279907 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-5c5e24dc-e315-4c69-8289-dc795cfcea1a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:21.280514 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-5c5e24dc-e315-4c69-8289-dc795cfcea1a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:21.287090 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5c5e24dc-e315-4c69-8289-dc795cfcea1a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:21.287547 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5c5e24dc-e315-4c69-8289-dc795cfcea1a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:21.288280 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5c5e24dc-e315-4c69-8289-dc795cfcea1a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:21.288704 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5c5e24dc-e315-4c69-8289-dc795cfcea1a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:21.306771 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:21.442570 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-5c5e24dc-e315-4c69-8289-dc795cfcea1a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:21.451244 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-5c5e24dc-e315-4c69-8289-dc795cfcea1a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.175316 Jul 26 07:45:21.451891 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 869/1782] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:21 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:21.476849 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-647bcab0-e555-4bf2-bff8-5df9afb88106 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:21.477458 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-647bcab0-e555-4bf2-bff8-5df9afb88106 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:21.484487 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-647bcab0-e555-4bf2-bff8-5df9afb88106 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:21.484927 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-647bcab0-e555-4bf2-bff8-5df9afb88106 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:21.485684 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-647bcab0-e555-4bf2-bff8-5df9afb88106 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:21.486152 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-647bcab0-e555-4bf2-bff8-5df9afb88106 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:21.563253 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-647bcab0-e555-4bf2-bff8-5df9afb88106 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:21.575637 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-647bcab0-e555-4bf2-bff8-5df9afb88106 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:21.577928 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-647bcab0-e555-4bf2-bff8-5df9afb88106 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:21.579859 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-647bcab0-e555-4bf2-bff8-5df9afb88106 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.106793 Jul 26 07:45:21.580416 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 914/1783] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:21 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:21.612873 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2827f8ad-2dab-4ace-a4be-3496da26c0cd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:21.613796 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2827f8ad-2dab-4ace-a4be-3496da26c0cd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:21.622113 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2827f8ad-2dab-4ace-a4be-3496da26c0cd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:21.622567 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2827f8ad-2dab-4ace-a4be-3496da26c0cd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:21.623331 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2827f8ad-2dab-4ace-a4be-3496da26c0cd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:21.623767 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2827f8ad-2dab-4ace-a4be-3496da26c0cd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:21.767534 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2827f8ad-2dab-4ace-a4be-3496da26c0cd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:21.776245 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2827f8ad-2dab-4ace-a4be-3496da26c0cd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.169744 Jul 26 07:45:21.776796 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 870/1784] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:21 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:22.473960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d48fc2b3-5948-41af-9a3a-5db852a93503 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:22.474572 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d48fc2b3-5948-41af-9a3a-5db852a93503 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:22.481950 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d48fc2b3-5948-41af-9a3a-5db852a93503 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:22.482666 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d48fc2b3-5948-41af-9a3a-5db852a93503 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:22.483148 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d48fc2b3-5948-41af-9a3a-5db852a93503 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:22.483615 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d48fc2b3-5948-41af-9a3a-5db852a93503 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:22.601975 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-122f6ec9-8c90-454d-aab6-1f8fd1187e3a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:22.602537 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-122f6ec9-8c90-454d-aab6-1f8fd1187e3a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:22.609387 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-122f6ec9-8c90-454d-aab6-1f8fd1187e3a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:22.609931 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-122f6ec9-8c90-454d-aab6-1f8fd1187e3a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:22.610742 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-122f6ec9-8c90-454d-aab6-1f8fd1187e3a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:22.611137 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-122f6ec9-8c90-454d-aab6-1f8fd1187e3a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:22.623864 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d48fc2b3-5948-41af-9a3a-5db852a93503 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:22.632321 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d48fc2b3-5948-41af-9a3a-5db852a93503 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.162330 Jul 26 07:45:22.632917 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 915/1785] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:22 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:22.675597 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-122f6ec9-8c90-454d-aab6-1f8fd1187e3a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:22.684346 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-122f6ec9-8c90-454d-aab6-1f8fd1187e3a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:22.685868 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-122f6ec9-8c90-454d-aab6-1f8fd1187e3a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:22.686998 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-122f6ec9-8c90-454d-aab6-1f8fd1187e3a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.089037 Jul 26 07:45:22.687547 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 871/1786] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:22 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:22.803250 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-00746377-971e-4f50-9e6e-90c9768bdf82 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:22.803879 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-00746377-971e-4f50-9e6e-90c9768bdf82 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:22.811006 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-00746377-971e-4f50-9e6e-90c9768bdf82 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:22.811452 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-00746377-971e-4f50-9e6e-90c9768bdf82 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:22.812213 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-00746377-971e-4f50-9e6e-90c9768bdf82 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:22.812646 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-00746377-971e-4f50-9e6e-90c9768bdf82 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:22.953043 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-00746377-971e-4f50-9e6e-90c9768bdf82 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:22.961558 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-00746377-971e-4f50-9e6e-90c9768bdf82 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.162274 Jul 26 07:45:22.962169 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 916/1787] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:22 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:23.654222 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2660e5ea-c4cb-429c-b87b-6d30d4aa6825 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:23.654906 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2660e5ea-c4cb-429c-b87b-6d30d4aa6825 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:23.662045 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2660e5ea-c4cb-429c-b87b-6d30d4aa6825 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:23.662469 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2660e5ea-c4cb-429c-b87b-6d30d4aa6825 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:23.663287 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2660e5ea-c4cb-429c-b87b-6d30d4aa6825 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:23.663718 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2660e5ea-c4cb-429c-b87b-6d30d4aa6825 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:23.710559 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-efbc56e1-b861-45a1-83ce-283bca4c6eea tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:23.711158 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-efbc56e1-b861-45a1-83ce-283bca4c6eea tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:23.718246 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-efbc56e1-b861-45a1-83ce-283bca4c6eea tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:23.718608 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-efbc56e1-b861-45a1-83ce-283bca4c6eea tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:23.719379 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-efbc56e1-b861-45a1-83ce-283bca4c6eea tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:23.719804 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-efbc56e1-b861-45a1-83ce-283bca4c6eea tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:23.785809 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-efbc56e1-b861-45a1-83ce-283bca4c6eea tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:23.794893 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-efbc56e1-b861-45a1-83ce-283bca4c6eea tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:23.796493 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-efbc56e1-b861-45a1-83ce-283bca4c6eea tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:23.797320 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2660e5ea-c4cb-429c-b87b-6d30d4aa6825 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:23.797676 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-efbc56e1-b861-45a1-83ce-283bca4c6eea tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.091114 Jul 26 07:45:23.798270 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 917/1788] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:23 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:23.805574 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2660e5ea-c4cb-429c-b87b-6d30d4aa6825 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.155361 Jul 26 07:45:23.806353 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 872/1789] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:23 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:23.983489 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-4fdf8290-6497-4ca5-a1ea-3c714d8e9b83 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:23.984011 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-4fdf8290-6497-4ca5-a1ea-3c714d8e9b83 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:23.990582 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4fdf8290-6497-4ca5-a1ea-3c714d8e9b83 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:23.991026 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4fdf8290-6497-4ca5-a1ea-3c714d8e9b83 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:23.991791 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4fdf8290-6497-4ca5-a1ea-3c714d8e9b83 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:23.992223 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4fdf8290-6497-4ca5-a1ea-3c714d8e9b83 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:24.012610 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:24.123877 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-4fdf8290-6497-4ca5-a1ea-3c714d8e9b83 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:24.132337 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-4fdf8290-6497-4ca5-a1ea-3c714d8e9b83 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.152876 Jul 26 07:45:24.132906 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 918/1790] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:23 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:24.821662 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a5131082-1db9-4f1c-8bb1-fcc4bbcbe5e1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:24.822313 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a5131082-1db9-4f1c-8bb1-fcc4bbcbe5e1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:24.825946 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-852a8026-05ab-4b13-9b58-acd0dca85251 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:24.826560 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-852a8026-05ab-4b13-9b58-acd0dca85251 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:24.829631 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a5131082-1db9-4f1c-8bb1-fcc4bbcbe5e1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:24.830133 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a5131082-1db9-4f1c-8bb1-fcc4bbcbe5e1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:24.830904 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a5131082-1db9-4f1c-8bb1-fcc4bbcbe5e1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:24.831346 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a5131082-1db9-4f1c-8bb1-fcc4bbcbe5e1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:24.833400 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-852a8026-05ab-4b13-9b58-acd0dca85251 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:24.833875 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-852a8026-05ab-4b13-9b58-acd0dca85251 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:24.834641 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-852a8026-05ab-4b13-9b58-acd0dca85251 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:24.836452 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-852a8026-05ab-4b13-9b58-acd0dca85251 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:24.896822 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a5131082-1db9-4f1c-8bb1-fcc4bbcbe5e1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:24.905523 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a5131082-1db9-4f1c-8bb1-fcc4bbcbe5e1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:24.907058 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a5131082-1db9-4f1c-8bb1-fcc4bbcbe5e1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:24.908217 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a5131082-1db9-4f1c-8bb1-fcc4bbcbe5e1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.091264 Jul 26 07:45:24.908802 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 873/1791] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:24 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:24.965655 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-852a8026-05ab-4b13-9b58-acd0dca85251 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:24.977421 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-852a8026-05ab-4b13-9b58-acd0dca85251 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.155221 Jul 26 07:45:24.978318 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 919/1792] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:24 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:25.154961 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b5eb7e95-c231-41c8-9c79-c4ce2f1facf2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:25.155482 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-b5eb7e95-c231-41c8-9c79-c4ce2f1facf2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:25.162337 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b5eb7e95-c231-41c8-9c79-c4ce2f1facf2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:25.162787 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b5eb7e95-c231-41c8-9c79-c4ce2f1facf2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:25.163582 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b5eb7e95-c231-41c8-9c79-c4ce2f1facf2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:25.164013 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b5eb7e95-c231-41c8-9c79-c4ce2f1facf2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:25.295829 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-b5eb7e95-c231-41c8-9c79-c4ce2f1facf2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:25.304112 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b5eb7e95-c231-41c8-9c79-c4ce2f1facf2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.153492 Jul 26 07:45:25.304672 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 874/1793] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:25 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:45:25.933996 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3e2b3e3b-4526-4b22-aa80-ebbe7b8e6ab6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:25.934631 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3e2b3e3b-4526-4b22-aa80-ebbe7b8e6ab6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:25.941567 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3e2b3e3b-4526-4b22-aa80-ebbe7b8e6ab6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:25.942143 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3e2b3e3b-4526-4b22-aa80-ebbe7b8e6ab6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:25.942912 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3e2b3e3b-4526-4b22-aa80-ebbe7b8e6ab6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:25.943338 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3e2b3e3b-4526-4b22-aa80-ebbe7b8e6ab6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:25.999833 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-43a43821-f05d-49e0-8e5b-f188c331fcba tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:26.001109 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-43a43821-f05d-49e0-8e5b-f188c331fcba tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:26.003286 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=76 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:26.009032 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-43a43821-f05d-49e0-8e5b-f188c331fcba tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:26.009182 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-43a43821-f05d-49e0-8e5b-f188c331fcba tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:26.010000 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-43a43821-f05d-49e0-8e5b-f188c331fcba tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:26.010451 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-43a43821-f05d-49e0-8e5b-f188c331fcba tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:26.011112 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3e2b3e3b-4526-4b22-aa80-ebbe7b8e6ab6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:26.021666 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3e2b3e3b-4526-4b22-aa80-ebbe7b8e6ab6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:26.023239 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3e2b3e3b-4526-4b22-aa80-ebbe7b8e6ab6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:26.024470 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3e2b3e3b-4526-4b22-aa80-ebbe7b8e6ab6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.096220 Jul 26 07:45:26.025025 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 920/1794] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:25 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:26.150546 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-43a43821-f05d-49e0-8e5b-f188c331fcba tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:26.159237 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-43a43821-f05d-49e0-8e5b-f188c331fcba tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.163543 Jul 26 07:45:26.159811 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 875/1795] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:25 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:26.327076 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-2b68e4d1-8c5f-4886-a6b8-4e08df31c170 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:26.327678 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2b68e4d1-8c5f-4886-a6b8-4e08df31c170 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:26.334588 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2b68e4d1-8c5f-4886-a6b8-4e08df31c170 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:26.335031 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2b68e4d1-8c5f-4886-a6b8-4e08df31c170 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:26.335781 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2b68e4d1-8c5f-4886-a6b8-4e08df31c170 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:26.336204 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2b68e4d1-8c5f-4886-a6b8-4e08df31c170 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:26.475872 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2b68e4d1-8c5f-4886-a6b8-4e08df31c170 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:26.485223 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-2b68e4d1-8c5f-4886-a6b8-4e08df31c170 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.162536 Jul 26 07:45:26.485810 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 921/1796] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:26 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:27.048267 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-31db4d67-4b5b-443a-8dd2-1dd8d453e634 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:27.048856 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-31db4d67-4b5b-443a-8dd2-1dd8d453e634 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:27.057528 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-31db4d67-4b5b-443a-8dd2-1dd8d453e634 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:27.058176 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-31db4d67-4b5b-443a-8dd2-1dd8d453e634 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:27.059319 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-31db4d67-4b5b-443a-8dd2-1dd8d453e634 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:27.059983 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-31db4d67-4b5b-443a-8dd2-1dd8d453e634 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:27.144353 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-31db4d67-4b5b-443a-8dd2-1dd8d453e634 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:27.156626 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-31db4d67-4b5b-443a-8dd2-1dd8d453e634 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:27.158817 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-31db4d67-4b5b-443a-8dd2-1dd8d453e634 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:27.160573 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-31db4d67-4b5b-443a-8dd2-1dd8d453e634 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.116268 Jul 26 07:45:27.161382 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 876/1797] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:27 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:27.180571 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f35e9bd7-b61b-43d1-90a0-b54601bfc0d5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:27.181160 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f35e9bd7-b61b-43d1-90a0-b54601bfc0d5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:27.183573 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=82 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:27.189307 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f35e9bd7-b61b-43d1-90a0-b54601bfc0d5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:27.189757 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f35e9bd7-b61b-43d1-90a0-b54601bfc0d5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:27.190525 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f35e9bd7-b61b-43d1-90a0-b54601bfc0d5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:27.190952 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f35e9bd7-b61b-43d1-90a0-b54601bfc0d5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:27.329695 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f35e9bd7-b61b-43d1-90a0-b54601bfc0d5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:27.341522 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f35e9bd7-b61b-43d1-90a0-b54601bfc0d5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.164925 Jul 26 07:45:27.342162 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 922/1798] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:27 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:27.506763 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0c7287ec-8243-46ad-b4c5-aebcd2eef30a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:27.507368 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0c7287ec-8243-46ad-b4c5-aebcd2eef30a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:27.513781 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0c7287ec-8243-46ad-b4c5-aebcd2eef30a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:27.514273 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0c7287ec-8243-46ad-b4c5-aebcd2eef30a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:27.515029 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0c7287ec-8243-46ad-b4c5-aebcd2eef30a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:27.515921 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0c7287ec-8243-46ad-b4c5-aebcd2eef30a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:27.648663 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0c7287ec-8243-46ad-b4c5-aebcd2eef30a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:27.657430 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0c7287ec-8243-46ad-b4c5-aebcd2eef30a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.154640 Jul 26 07:45:27.658078 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 877/1799] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:27 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:28.184813 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-57d8f57e-6430-4e97-addc-fdc80b8e3dca tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:28.185406 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-57d8f57e-6430-4e97-addc-fdc80b8e3dca tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:28.192166 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-57d8f57e-6430-4e97-addc-fdc80b8e3dca tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:28.192607 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-57d8f57e-6430-4e97-addc-fdc80b8e3dca tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:28.193373 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-57d8f57e-6430-4e97-addc-fdc80b8e3dca tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:28.193827 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-57d8f57e-6430-4e97-addc-fdc80b8e3dca tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:28.259623 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-57d8f57e-6430-4e97-addc-fdc80b8e3dca tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:28.269020 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-57d8f57e-6430-4e97-addc-fdc80b8e3dca tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:28.270523 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-57d8f57e-6430-4e97-addc-fdc80b8e3dca tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:28.271670 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-57d8f57e-6430-4e97-addc-fdc80b8e3dca tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.090905 Jul 26 07:45:28.272208 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 923/1800] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:28 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:28.367354 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c92dec54-f06f-4a3a-8581-39f8b6671a06 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:28.368249 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c92dec54-f06f-4a3a-8581-39f8b6671a06 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:28.376229 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c92dec54-f06f-4a3a-8581-39f8b6671a06 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:28.376671 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c92dec54-f06f-4a3a-8581-39f8b6671a06 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:28.377442 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c92dec54-f06f-4a3a-8581-39f8b6671a06 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:28.377879 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c92dec54-f06f-4a3a-8581-39f8b6671a06 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:28.515597 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-c92dec54-f06f-4a3a-8581-39f8b6671a06 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:28.527463 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c92dec54-f06f-4a3a-8581-39f8b6671a06 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.166475 Jul 26 07:45:28.528042 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 878/1801] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:28 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:28.679335 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-34458722-fea0-4886-b321-47c98ade0b40 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:28.680157 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-34458722-fea0-4886-b321-47c98ade0b40 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:28.686508 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-34458722-fea0-4886-b321-47c98ade0b40 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:28.686958 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-34458722-fea0-4886-b321-47c98ade0b40 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:28.687708 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-34458722-fea0-4886-b321-47c98ade0b40 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:28.688134 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-34458722-fea0-4886-b321-47c98ade0b40 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:28.846708 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-34458722-fea0-4886-b321-47c98ade0b40 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:28.859016 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-34458722-fea0-4886-b321-47c98ade0b40 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.183467 Jul 26 07:45:28.859783 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 924/1802] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:28 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:29.295268 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-29563537-f59c-4530-8a36-a29c74f0599d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:29.295798 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-29563537-f59c-4530-8a36-a29c74f0599d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:29.302414 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-29563537-f59c-4530-8a36-a29c74f0599d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:29.302859 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-29563537-f59c-4530-8a36-a29c74f0599d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:29.303621 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-29563537-f59c-4530-8a36-a29c74f0599d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:29.304051 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-29563537-f59c-4530-8a36-a29c74f0599d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:29.375299 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-29563537-f59c-4530-8a36-a29c74f0599d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:29.383968 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-29563537-f59c-4530-8a36-a29c74f0599d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:29.385466 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-29563537-f59c-4530-8a36-a29c74f0599d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:29.386721 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-29563537-f59c-4530-8a36-a29c74f0599d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.095735 Jul 26 07:45:29.387345 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 879/1803] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:29 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:29.554998 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-539a3978-7e28-459e-9703-48104af753c5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:29.555584 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-539a3978-7e28-459e-9703-48104af753c5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:29.562702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-539a3978-7e28-459e-9703-48104af753c5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:29.563153 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-539a3978-7e28-459e-9703-48104af753c5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:29.563920 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-539a3978-7e28-459e-9703-48104af753c5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:29.564332 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-539a3978-7e28-459e-9703-48104af753c5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:29.708246 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-539a3978-7e28-459e-9703-48104af753c5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:29.719210 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-539a3978-7e28-459e-9703-48104af753c5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.168382 Jul 26 07:45:29.719804 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 925/1804] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:29 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:29.886739 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7dce849b-f9af-484e-84a5-f49d24f7ecf0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:29.887425 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7dce849b-f9af-484e-84a5-f49d24f7ecf0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:29.895616 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7dce849b-f9af-484e-84a5-f49d24f7ecf0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:29.896208 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7dce849b-f9af-484e-84a5-f49d24f7ecf0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:29.897200 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7dce849b-f9af-484e-84a5-f49d24f7ecf0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:29.897799 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7dce849b-f9af-484e-84a5-f49d24f7ecf0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:30.040638 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7dce849b-f9af-484e-84a5-f49d24f7ecf0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:30.048800 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7dce849b-f9af-484e-84a5-f49d24f7ecf0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.167408 Jul 26 07:45:30.049319 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 880/1805] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:29 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:30.316622 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 07:45:30.317001 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Tue Jul 26 07:45:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 07:45:30.414610 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-492a3378-3508-47ba-96b3-ac7cf385a20a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:30.415223 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-492a3378-3508-47ba-96b3-ac7cf385a20a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:30.421905 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-492a3378-3508-47ba-96b3-ac7cf385a20a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:30.422357 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-492a3378-3508-47ba-96b3-ac7cf385a20a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:30.423129 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-492a3378-3508-47ba-96b3-ac7cf385a20a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:30.423564 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-492a3378-3508-47ba-96b3-ac7cf385a20a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:30.492090 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-492a3378-3508-47ba-96b3-ac7cf385a20a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:30.501193 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-492a3378-3508-47ba-96b3-ac7cf385a20a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:30.502729 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-492a3378-3508-47ba-96b3-ac7cf385a20a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:30.503882 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-492a3378-3508-47ba-96b3-ac7cf385a20a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.093341 Jul 26 07:45:30.504431 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 926/1806] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:30 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:30.749805 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-467fd70a-901d-40bc-8ab4-d157ec54e066 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:30.750379 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-467fd70a-901d-40bc-8ab4-d157ec54e066 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:30.760023 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-467fd70a-901d-40bc-8ab4-d157ec54e066 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:30.760594 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-467fd70a-901d-40bc-8ab4-d157ec54e066 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:30.761808 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-467fd70a-901d-40bc-8ab4-d157ec54e066 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:30.762332 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-467fd70a-901d-40bc-8ab4-d157ec54e066 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:30.901852 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-467fd70a-901d-40bc-8ab4-d157ec54e066 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:30.910127 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-467fd70a-901d-40bc-8ab4-d157ec54e066 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.165441 Jul 26 07:45:30.910673 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 881/1807] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:30 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:31.072890 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9fab2c6d-aee8-4223-81d7-6e864b55a088 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:31.073697 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-9fab2c6d-aee8-4223-81d7-6e864b55a088 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:31.083133 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9fab2c6d-aee8-4223-81d7-6e864b55a088 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:31.083735 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9fab2c6d-aee8-4223-81d7-6e864b55a088 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:31.084758 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9fab2c6d-aee8-4223-81d7-6e864b55a088 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:31.085334 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9fab2c6d-aee8-4223-81d7-6e864b55a088 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:31.232324 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-9fab2c6d-aee8-4223-81d7-6e864b55a088 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:31.241237 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-9fab2c6d-aee8-4223-81d7-6e864b55a088 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.173257 Jul 26 07:45:31.241909 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 927/1808] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:31 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:31.530790 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-205b1b76-0987-4c94-a3fb-3ae0f8e77784 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:31.531797 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-205b1b76-0987-4c94-a3fb-3ae0f8e77784 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:31.542268 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-205b1b76-0987-4c94-a3fb-3ae0f8e77784 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:31.542991 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-205b1b76-0987-4c94-a3fb-3ae0f8e77784 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:31.544095 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-205b1b76-0987-4c94-a3fb-3ae0f8e77784 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:31.544956 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-205b1b76-0987-4c94-a3fb-3ae0f8e77784 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:31.620384 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-205b1b76-0987-4c94-a3fb-3ae0f8e77784 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:31.632057 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-205b1b76-0987-4c94-a3fb-3ae0f8e77784 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:31.634136 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-205b1b76-0987-4c94-a3fb-3ae0f8e77784 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:31.635737 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-205b1b76-0987-4c94-a3fb-3ae0f8e77784 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.111570 Jul 26 07:45:31.636370 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 882/1809] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:31 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:31.934925 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ac93ff67-a166-4ef6-8b3f-998749a705cf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:31.935521 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ac93ff67-a166-4ef6-8b3f-998749a705cf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:31.942100 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ac93ff67-a166-4ef6-8b3f-998749a705cf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:31.942543 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ac93ff67-a166-4ef6-8b3f-998749a705cf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:31.943321 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ac93ff67-a166-4ef6-8b3f-998749a705cf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:31.943717 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ac93ff67-a166-4ef6-8b3f-998749a705cf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:32.074788 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ac93ff67-a166-4ef6-8b3f-998749a705cf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:32.083863 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ac93ff67-a166-4ef6-8b3f-998749a705cf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.154523 Jul 26 07:45:32.084468 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 928/1810] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:31 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:32.265341 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-209539bf-6ef8-4d06-86e7-612ac9215ec7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:32.266116 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-209539bf-6ef8-4d06-86e7-612ac9215ec7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:32.273192 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-209539bf-6ef8-4d06-86e7-612ac9215ec7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:32.273639 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-209539bf-6ef8-4d06-86e7-612ac9215ec7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:32.274511 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-209539bf-6ef8-4d06-86e7-612ac9215ec7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:32.274947 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-209539bf-6ef8-4d06-86e7-612ac9215ec7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:32.431185 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-209539bf-6ef8-4d06-86e7-612ac9215ec7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:32.439786 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-209539bf-6ef8-4d06-86e7-612ac9215ec7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.178977 Jul 26 07:45:32.440368 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 883/1811] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:32 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:32.659946 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c3640540-6660-4bb4-9031-19fb05ffeec1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:32.660454 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c3640540-6660-4bb4-9031-19fb05ffeec1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:32.667080 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c3640540-6660-4bb4-9031-19fb05ffeec1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:32.667525 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c3640540-6660-4bb4-9031-19fb05ffeec1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:32.668284 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c3640540-6660-4bb4-9031-19fb05ffeec1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:32.668715 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c3640540-6660-4bb4-9031-19fb05ffeec1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:32.737482 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c3640540-6660-4bb4-9031-19fb05ffeec1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:32.748502 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c3640540-6660-4bb4-9031-19fb05ffeec1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:32.750062 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c3640540-6660-4bb4-9031-19fb05ffeec1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:32.751226 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c3640540-6660-4bb4-9031-19fb05ffeec1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.096119 Jul 26 07:45:32.751783 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 929/1812] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:32 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:33.109236 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ae2dc655-44ca-43a4-873b-298256a42034 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:33.109886 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ae2dc655-44ca-43a4-873b-298256a42034 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:33.116360 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ae2dc655-44ca-43a4-873b-298256a42034 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:33.116811 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ae2dc655-44ca-43a4-873b-298256a42034 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:33.117587 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ae2dc655-44ca-43a4-873b-298256a42034 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:33.118054 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ae2dc655-44ca-43a4-873b-298256a42034 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:33.255997 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ae2dc655-44ca-43a4-873b-298256a42034 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:33.267022 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ae2dc655-44ca-43a4-873b-298256a42034 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.162817 Jul 26 07:45:33.267682 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 884/1813] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:33 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:33.460907 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-311d1ad9-c73b-4e55-9e33-759f0ceb44d8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:33.461515 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-311d1ad9-c73b-4e55-9e33-759f0ceb44d8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:33.469299 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-311d1ad9-c73b-4e55-9e33-759f0ceb44d8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:33.469762 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-311d1ad9-c73b-4e55-9e33-759f0ceb44d8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:33.470526 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-311d1ad9-c73b-4e55-9e33-759f0ceb44d8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:33.470954 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-311d1ad9-c73b-4e55-9e33-759f0ceb44d8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:33.612784 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-311d1ad9-c73b-4e55-9e33-759f0ceb44d8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:33.621109 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-311d1ad9-c73b-4e55-9e33-759f0ceb44d8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.164102 Jul 26 07:45:33.621780 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 930/1814] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:33 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:33.777014 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-01151394-90a2-4300-ba2b-6d2722d61e02 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:33.777624 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-01151394-90a2-4300-ba2b-6d2722d61e02 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:33.786630 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-01151394-90a2-4300-ba2b-6d2722d61e02 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:33.787212 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-01151394-90a2-4300-ba2b-6d2722d61e02 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:33.788308 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-01151394-90a2-4300-ba2b-6d2722d61e02 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:33.788818 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-01151394-90a2-4300-ba2b-6d2722d61e02 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:33.854571 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-01151394-90a2-4300-ba2b-6d2722d61e02 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:33.863189 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-01151394-90a2-4300-ba2b-6d2722d61e02 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:33.864662 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-01151394-90a2-4300-ba2b-6d2722d61e02 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:33.865823 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-01151394-90a2-4300-ba2b-6d2722d61e02 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.092775 Jul 26 07:45:33.866396 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 885/1815] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:33 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:34.291304 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-1989e620-7fa1-44d4-988a-1b5efe7a7751 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:34.291970 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-1989e620-7fa1-44d4-988a-1b5efe7a7751 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:34.300586 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1989e620-7fa1-44d4-988a-1b5efe7a7751 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:34.301207 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1989e620-7fa1-44d4-988a-1b5efe7a7751 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:34.302279 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1989e620-7fa1-44d4-988a-1b5efe7a7751 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:34.302997 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1989e620-7fa1-44d4-988a-1b5efe7a7751 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:34.445108 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-1989e620-7fa1-44d4-988a-1b5efe7a7751 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:34.454409 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-1989e620-7fa1-44d4-988a-1b5efe7a7751 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.169043 Jul 26 07:45:34.455633 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 931/1816] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:34 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:34.643283 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-17830728-fb09-44fa-a454-83a112dc60b0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:34.643919 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-17830728-fb09-44fa-a454-83a112dc60b0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:34.651524 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-17830728-fb09-44fa-a454-83a112dc60b0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:34.651973 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-17830728-fb09-44fa-a454-83a112dc60b0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:34.652802 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-17830728-fb09-44fa-a454-83a112dc60b0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:34.653237 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-17830728-fb09-44fa-a454-83a112dc60b0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:34.657590 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:34.793712 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-17830728-fb09-44fa-a454-83a112dc60b0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:34.802180 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-17830728-fb09-44fa-a454-83a112dc60b0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.162836 Jul 26 07:45:34.803488 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 886/1817] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:34 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:34.893280 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c19b7b0d-f247-48c7-80a1-43355915c01b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:34.894279 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c19b7b0d-f247-48c7-80a1-43355915c01b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:34.905122 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c19b7b0d-f247-48c7-80a1-43355915c01b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:34.905573 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c19b7b0d-f247-48c7-80a1-43355915c01b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:34.906374 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c19b7b0d-f247-48c7-80a1-43355915c01b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:34.906802 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c19b7b0d-f247-48c7-80a1-43355915c01b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:34.988258 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c19b7b0d-f247-48c7-80a1-43355915c01b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:34.998758 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c19b7b0d-f247-48c7-80a1-43355915c01b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:35.000309 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c19b7b0d-f247-48c7-80a1-43355915c01b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:35.001455 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c19b7b0d-f247-48c7-80a1-43355915c01b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.114633 Jul 26 07:45:35.002035 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 932/1818] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:34 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:35.476648 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f73c7c33-2219-4a9a-8175-abdc76e69ea4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:35.477280 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-f73c7c33-2219-4a9a-8175-abdc76e69ea4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:35.484126 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f73c7c33-2219-4a9a-8175-abdc76e69ea4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:35.484569 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f73c7c33-2219-4a9a-8175-abdc76e69ea4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:35.485314 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f73c7c33-2219-4a9a-8175-abdc76e69ea4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:35.485766 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f73c7c33-2219-4a9a-8175-abdc76e69ea4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:35.630282 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-f73c7c33-2219-4a9a-8175-abdc76e69ea4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:35.639063 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f73c7c33-2219-4a9a-8175-abdc76e69ea4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.166438 Jul 26 07:45:35.639636 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 887/1819] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:35 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:35.826933 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b4217a89-5815-4e1b-a513-375da2148f60 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:35.827827 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b4217a89-5815-4e1b-a513-375da2148f60 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:35.838107 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b4217a89-5815-4e1b-a513-375da2148f60 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:35.838725 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b4217a89-5815-4e1b-a513-375da2148f60 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:35.839836 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b4217a89-5815-4e1b-a513-375da2148f60 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:35.840443 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b4217a89-5815-4e1b-a513-375da2148f60 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:35.977645 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-b4217a89-5815-4e1b-a513-375da2148f60 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:35.986272 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b4217a89-5815-4e1b-a513-375da2148f60 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.165642 Jul 26 07:45:35.986836 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 933/1820] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:35 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:36.024867 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-e2241fb3-f5df-4294-8417-9100b626cb92 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:36.025454 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-e2241fb3-f5df-4294-8417-9100b626cb92 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:36.032911 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e2241fb3-f5df-4294-8417-9100b626cb92 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:36.033491 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e2241fb3-f5df-4294-8417-9100b626cb92 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:36.034665 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e2241fb3-f5df-4294-8417-9100b626cb92 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:36.035166 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e2241fb3-f5df-4294-8417-9100b626cb92 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:36.100713 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-e2241fb3-f5df-4294-8417-9100b626cb92 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:36.109765 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-e2241fb3-f5df-4294-8417-9100b626cb92 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:36.111256 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-e2241fb3-f5df-4294-8417-9100b626cb92 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:36.112425 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-e2241fb3-f5df-4294-8417-9100b626cb92 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.091565 Jul 26 07:45:36.112980 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 888/1821] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:36 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:36.664095 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-13cab675-0dc7-4db4-9f19-591b01c66cb3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:36.664700 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-13cab675-0dc7-4db4-9f19-591b01c66cb3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:36.671338 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-13cab675-0dc7-4db4-9f19-591b01c66cb3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:36.671785 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-13cab675-0dc7-4db4-9f19-591b01c66cb3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:36.672559 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-13cab675-0dc7-4db4-9f19-591b01c66cb3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:36.672989 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-13cab675-0dc7-4db4-9f19-591b01c66cb3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:36.812917 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-13cab675-0dc7-4db4-9f19-591b01c66cb3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:36.821638 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-13cab675-0dc7-4db4-9f19-591b01c66cb3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.161536 Jul 26 07:45:36.822244 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 934/1822] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:36 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:37.010452 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-26289f38-3f2c-4259-89a5-f721ae55a6a7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:37.010903 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-26289f38-3f2c-4259-89a5-f721ae55a6a7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:37.018773 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-26289f38-3f2c-4259-89a5-f721ae55a6a7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:37.019213 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-26289f38-3f2c-4259-89a5-f721ae55a6a7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:37.019982 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-26289f38-3f2c-4259-89a5-f721ae55a6a7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:37.020803 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-26289f38-3f2c-4259-89a5-f721ae55a6a7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:37.154818 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-26289f38-3f2c-4259-89a5-f721ae55a6a7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:37.162839 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-26289f38-3f2c-4259-89a5-f721ae55a6a7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.158222 Jul 26 07:45:37.163398 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 889/1823] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:37 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:37.389479 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e76aa251-b64b-4351-b042-b27c54c4e505 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:37.390094 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e76aa251-b64b-4351-b042-b27c54c4e505 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:37.396304 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e76aa251-b64b-4351-b042-b27c54c4e505 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:37.396744 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e76aa251-b64b-4351-b042-b27c54c4e505 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:37.397502 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e76aa251-b64b-4351-b042-b27c54c4e505 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:37.397975 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e76aa251-b64b-4351-b042-b27c54c4e505 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:37.401957 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:37.467446 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-e76aa251-b64b-4351-b042-b27c54c4e505 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:37.476112 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-e76aa251-b64b-4351-b042-b27c54c4e505 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:37.477601 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-e76aa251-b64b-4351-b042-b27c54c4e505 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:37.478820 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e76aa251-b64b-4351-b042-b27c54c4e505 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.347346 Jul 26 07:45:37.479378 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 935/1824] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:37 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:37.844380 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a471e751-f40c-4ba7-b119-b860ffd7d892 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:37.844983 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a471e751-f40c-4ba7-b119-b860ffd7d892 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:37.851464 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a471e751-f40c-4ba7-b119-b860ffd7d892 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:37.851906 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a471e751-f40c-4ba7-b119-b860ffd7d892 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:37.852811 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a471e751-f40c-4ba7-b119-b860ffd7d892 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:37.853244 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a471e751-f40c-4ba7-b119-b860ffd7d892 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:37.984563 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 07:45:37.984812 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Tue Jul 26 07:45:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 07:45:37.998986 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a471e751-f40c-4ba7-b119-b860ffd7d892 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:38.006958 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a471e751-f40c-4ba7-b119-b860ffd7d892 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.166702 Jul 26 07:45:38.007509 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 890/1825] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:37 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:38.184422 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-546e0de5-089e-4012-bd55-ff4cf763afcc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:38.185060 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-546e0de5-089e-4012-bd55-ff4cf763afcc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:38.191995 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-546e0de5-089e-4012-bd55-ff4cf763afcc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:38.192440 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-546e0de5-089e-4012-bd55-ff4cf763afcc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:38.193191 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-546e0de5-089e-4012-bd55-ff4cf763afcc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:38.193621 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-546e0de5-089e-4012-bd55-ff4cf763afcc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:38.332308 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-546e0de5-089e-4012-bd55-ff4cf763afcc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:38.340446 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-546e0de5-089e-4012-bd55-ff4cf763afcc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.160387 Jul 26 07:45:38.341016 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 936/1826] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:38 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:38.500962 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7fcecc07-413c-4934-af2b-387148c6ffb4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:38.501580 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7fcecc07-413c-4934-af2b-387148c6ffb4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:38.508580 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7fcecc07-413c-4934-af2b-387148c6ffb4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:38.509032 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7fcecc07-413c-4934-af2b-387148c6ffb4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:38.509773 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7fcecc07-413c-4934-af2b-387148c6ffb4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:38.510231 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7fcecc07-413c-4934-af2b-387148c6ffb4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:38.581040 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7fcecc07-413c-4934-af2b-387148c6ffb4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:38.591770 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7fcecc07-413c-4934-af2b-387148c6ffb4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:38.593483 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7fcecc07-413c-4934-af2b-387148c6ffb4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:38.594657 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7fcecc07-413c-4934-af2b-387148c6ffb4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.097836 Jul 26 07:45:38.595212 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 891/1827] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:38 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:39.029282 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-5028911e-f99f-4907-8959-7b4804f29c41 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:39.030020 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-5028911e-f99f-4907-8959-7b4804f29c41 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:39.038685 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5028911e-f99f-4907-8959-7b4804f29c41 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:39.039213 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5028911e-f99f-4907-8959-7b4804f29c41 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:39.040262 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5028911e-f99f-4907-8959-7b4804f29c41 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:39.040824 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5028911e-f99f-4907-8959-7b4804f29c41 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:39.169021 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-5028911e-f99f-4907-8959-7b4804f29c41 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:39.177433 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-5028911e-f99f-4907-8959-7b4804f29c41 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.153085 Jul 26 07:45:39.178042 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 937/1828] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:39 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:39.364136 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6f3d9774-b6d1-4189-b189-c61c2baf60a1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:39.364724 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6f3d9774-b6d1-4189-b189-c61c2baf60a1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:39.373722 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6f3d9774-b6d1-4189-b189-c61c2baf60a1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:39.374170 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6f3d9774-b6d1-4189-b189-c61c2baf60a1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:39.374970 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6f3d9774-b6d1-4189-b189-c61c2baf60a1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:39.375403 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6f3d9774-b6d1-4189-b189-c61c2baf60a1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:39.515469 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6f3d9774-b6d1-4189-b189-c61c2baf60a1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:39.524491 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6f3d9774-b6d1-4189-b189-c61c2baf60a1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.166292 Jul 26 07:45:39.525072 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 892/1829] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:39 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:39.617047 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-086a7edb-7eaa-4f4f-ae48-7fa38b2c6238 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:39.617656 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-086a7edb-7eaa-4f4f-ae48-7fa38b2c6238 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:39.624968 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-086a7edb-7eaa-4f4f-ae48-7fa38b2c6238 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:39.625347 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-086a7edb-7eaa-4f4f-ae48-7fa38b2c6238 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:39.626155 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-086a7edb-7eaa-4f4f-ae48-7fa38b2c6238 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:39.626587 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-086a7edb-7eaa-4f4f-ae48-7fa38b2c6238 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:39.694902 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-086a7edb-7eaa-4f4f-ae48-7fa38b2c6238 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:39.705675 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-086a7edb-7eaa-4f4f-ae48-7fa38b2c6238 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:39.707161 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-086a7edb-7eaa-4f4f-ae48-7fa38b2c6238 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:39.708313 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-086a7edb-7eaa-4f4f-ae48-7fa38b2c6238 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.095368 Jul 26 07:45:39.708854 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 938/1830] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:39 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:40.201479 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-50c4c9de-5f8b-4f41-b85a-18db16faa9a8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:40.202394 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-50c4c9de-5f8b-4f41-b85a-18db16faa9a8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:40.211845 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-50c4c9de-5f8b-4f41-b85a-18db16faa9a8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:40.212487 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-50c4c9de-5f8b-4f41-b85a-18db16faa9a8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:40.213582 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-50c4c9de-5f8b-4f41-b85a-18db16faa9a8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:40.214239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-50c4c9de-5f8b-4f41-b85a-18db16faa9a8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:40.350372 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-50c4c9de-5f8b-4f41-b85a-18db16faa9a8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:40.359008 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-50c4c9de-5f8b-4f41-b85a-18db16faa9a8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.163430 Jul 26 07:45:40.359608 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 893/1831] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:40 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:40.547975 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6b44a65a-b440-416a-a4a4-ba573873da48 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:40.548561 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-6b44a65a-b440-416a-a4a4-ba573873da48 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:40.555095 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6b44a65a-b440-416a-a4a4-ba573873da48 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:40.555539 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6b44a65a-b440-416a-a4a4-ba573873da48 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:40.556285 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6b44a65a-b440-416a-a4a4-ba573873da48 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:40.556710 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6b44a65a-b440-416a-a4a4-ba573873da48 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:40.694346 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-6b44a65a-b440-416a-a4a4-ba573873da48 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:40.702506 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6b44a65a-b440-416a-a4a4-ba573873da48 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.158826 Jul 26 07:45:40.703383 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 939/1832] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:40 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:40.733134 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-1f8383a1-a3a2-4fe5-ad09-d1b31d54dee9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:40.733786 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-1f8383a1-a3a2-4fe5-ad09-d1b31d54dee9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:40.740700 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1f8383a1-a3a2-4fe5-ad09-d1b31d54dee9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:40.741151 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1f8383a1-a3a2-4fe5-ad09-d1b31d54dee9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:40.741967 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1f8383a1-a3a2-4fe5-ad09-d1b31d54dee9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:40.742403 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1f8383a1-a3a2-4fe5-ad09-d1b31d54dee9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:40.807031 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-1f8383a1-a3a2-4fe5-ad09-d1b31d54dee9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:40.816197 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-1f8383a1-a3a2-4fe5-ad09-d1b31d54dee9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:40.817689 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-1f8383a1-a3a2-4fe5-ad09-d1b31d54dee9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:40.818884 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-1f8383a1-a3a2-4fe5-ad09-d1b31d54dee9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.091455 Jul 26 07:45:40.819452 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 894/1833] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:40 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:41.382458 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d5430742-bd98-428f-a6b9-eb919fe073ef tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:41.383221 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d5430742-bd98-428f-a6b9-eb919fe073ef tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:41.390856 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d5430742-bd98-428f-a6b9-eb919fe073ef tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:41.391294 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d5430742-bd98-428f-a6b9-eb919fe073ef tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:41.392048 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d5430742-bd98-428f-a6b9-eb919fe073ef tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:41.392471 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d5430742-bd98-428f-a6b9-eb919fe073ef tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:41.528615 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d5430742-bd98-428f-a6b9-eb919fe073ef tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:41.536727 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d5430742-bd98-428f-a6b9-eb919fe073ef tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.159588 Jul 26 07:45:41.537287 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 940/1834] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:41 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:41.723659 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-5aa516f7-8c4c-44dd-85b7-848ee1cefc15 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:41.724171 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-5aa516f7-8c4c-44dd-85b7-848ee1cefc15 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:41.730608 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5aa516f7-8c4c-44dd-85b7-848ee1cefc15 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:41.731048 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5aa516f7-8c4c-44dd-85b7-848ee1cefc15 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:41.731800 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5aa516f7-8c4c-44dd-85b7-848ee1cefc15 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:41.732227 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5aa516f7-8c4c-44dd-85b7-848ee1cefc15 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:41.842514 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-1aca41ed-8d0a-4c27-a011-0868bebb2960 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:41.843087 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-1aca41ed-8d0a-4c27-a011-0868bebb2960 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:41.849884 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1aca41ed-8d0a-4c27-a011-0868bebb2960 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:41.850348 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1aca41ed-8d0a-4c27-a011-0868bebb2960 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:41.851115 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1aca41ed-8d0a-4c27-a011-0868bebb2960 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:41.851534 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1aca41ed-8d0a-4c27-a011-0868bebb2960 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:41.869847 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-5aa516f7-8c4c-44dd-85b7-848ee1cefc15 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:41.878403 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-5aa516f7-8c4c-44dd-85b7-848ee1cefc15 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.158779 Jul 26 07:45:41.878992 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 895/1835] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:41 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:41.916292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-1aca41ed-8d0a-4c27-a011-0868bebb2960 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:41.925576 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-1aca41ed-8d0a-4c27-a011-0868bebb2960 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:41.927128 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-1aca41ed-8d0a-4c27-a011-0868bebb2960 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:41.928278 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-1aca41ed-8d0a-4c27-a011-0868bebb2960 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.089871 Jul 26 07:45:41.928840 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 941/1836] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:41 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:42.566039 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c96a920a-1768-4117-90d4-29f1477d09cc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:42.566660 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c96a920a-1768-4117-90d4-29f1477d09cc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:42.573294 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c96a920a-1768-4117-90d4-29f1477d09cc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:42.573761 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c96a920a-1768-4117-90d4-29f1477d09cc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:42.574531 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c96a920a-1768-4117-90d4-29f1477d09cc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:42.574960 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c96a920a-1768-4117-90d4-29f1477d09cc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:42.719076 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-c96a920a-1768-4117-90d4-29f1477d09cc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:42.728069 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c96a920a-1768-4117-90d4-29f1477d09cc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.166065 Jul 26 07:45:42.728647 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 896/1837] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:42 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:42.899788 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-2179c740-b2d3-4a29-ad6e-8d52bf6edf4a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:42.900371 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2179c740-b2d3-4a29-ad6e-8d52bf6edf4a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:42.907434 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2179c740-b2d3-4a29-ad6e-8d52bf6edf4a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:42.907879 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2179c740-b2d3-4a29-ad6e-8d52bf6edf4a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:42.908697 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2179c740-b2d3-4a29-ad6e-8d52bf6edf4a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:42.909128 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2179c740-b2d3-4a29-ad6e-8d52bf6edf4a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:42.950824 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-83dd0a9c-d3e4-49bd-8d90-98483ca8542e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:42.951358 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-83dd0a9c-d3e4-49bd-8d90-98483ca8542e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:42.962707 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-83dd0a9c-d3e4-49bd-8d90-98483ca8542e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:42.963171 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-83dd0a9c-d3e4-49bd-8d90-98483ca8542e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:42.963954 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-83dd0a9c-d3e4-49bd-8d90-98483ca8542e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:42.964385 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-83dd0a9c-d3e4-49bd-8d90-98483ca8542e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:43.036622 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-83dd0a9c-d3e4-49bd-8d90-98483ca8542e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:43.046412 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-83dd0a9c-d3e4-49bd-8d90-98483ca8542e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:43.048126 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-83dd0a9c-d3e4-49bd-8d90-98483ca8542e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:43.049371 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-83dd0a9c-d3e4-49bd-8d90-98483ca8542e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.102560 Jul 26 07:45:43.055496 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 897/1838] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:42 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 07:45:43.322739 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2179c740-b2d3-4a29-ad6e-8d52bf6edf4a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:43.331337 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-2179c740-b2d3-4a29-ad6e-8d52bf6edf4a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.435437 Jul 26 07:45:43.331903 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 942/1839] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:42 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:43.749778 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-1c08844d-30bd-4d15-b283-7e9f4b8b55a6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:43.750424 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-1c08844d-30bd-4d15-b283-7e9f4b8b55a6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:43.756943 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1c08844d-30bd-4d15-b283-7e9f4b8b55a6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:43.757390 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1c08844d-30bd-4d15-b283-7e9f4b8b55a6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:43.758192 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1c08844d-30bd-4d15-b283-7e9f4b8b55a6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:43.758621 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1c08844d-30bd-4d15-b283-7e9f4b8b55a6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:44.074197 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-58b8fb71-d2e7-4582-aeb0-6faf7e8dca45 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:44.074752 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-58b8fb71-d2e7-4582-aeb0-6faf7e8dca45 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:44.084187 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-58b8fb71-d2e7-4582-aeb0-6faf7e8dca45 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:44.084655 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-58b8fb71-d2e7-4582-aeb0-6faf7e8dca45 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:44.085426 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-58b8fb71-d2e7-4582-aeb0-6faf7e8dca45 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:44.085993 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-58b8fb71-d2e7-4582-aeb0-6faf7e8dca45 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:44.136450 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-1c08844d-30bd-4d15-b283-7e9f4b8b55a6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:44.145051 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-1c08844d-30bd-4d15-b283-7e9f4b8b55a6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.399224 Jul 26 07:45:44.145636 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 898/1840] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:43 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:44.148616 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-58b8fb71-d2e7-4582-aeb0-6faf7e8dca45 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:44.157626 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-58b8fb71-d2e7-4582-aeb0-6faf7e8dca45 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:44.159206 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-58b8fb71-d2e7-4582-aeb0-6faf7e8dca45 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:44.160362 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-58b8fb71-d2e7-4582-aeb0-6faf7e8dca45 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.091903 Jul 26 07:45:44.160940 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 943/1841] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:44 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:44.353340 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-aa798518-6cec-4f48-9bcf-22a7bd8abe58 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:44.353932 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-aa798518-6cec-4f48-9bcf-22a7bd8abe58 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:44.360812 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-aa798518-6cec-4f48-9bcf-22a7bd8abe58 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:44.361260 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-aa798518-6cec-4f48-9bcf-22a7bd8abe58 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:44.362047 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-aa798518-6cec-4f48-9bcf-22a7bd8abe58 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:44.362470 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-aa798518-6cec-4f48-9bcf-22a7bd8abe58 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:44.495989 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-aa798518-6cec-4f48-9bcf-22a7bd8abe58 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:44.507101 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-aa798518-6cec-4f48-9bcf-22a7bd8abe58 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.157870 Jul 26 07:45:44.507890 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 899/1842] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:44 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:45.171083 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-de02dc15-8bc5-475a-8487-fc21b8f2f3ad tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:45.171695 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-de02dc15-8bc5-475a-8487-fc21b8f2f3ad tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:45.178603 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-de02dc15-8bc5-475a-8487-fc21b8f2f3ad tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:45.179050 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-de02dc15-8bc5-475a-8487-fc21b8f2f3ad tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:45.179818 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-de02dc15-8bc5-475a-8487-fc21b8f2f3ad tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:45.180251 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-de02dc15-8bc5-475a-8487-fc21b8f2f3ad tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:45.183338 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-36dd1b21-95f7-4b06-a219-6d3aba6a6edb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:45.183949 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-36dd1b21-95f7-4b06-a219-6d3aba6a6edb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:45.190826 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-36dd1b21-95f7-4b06-a219-6d3aba6a6edb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:45.191287 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-36dd1b21-95f7-4b06-a219-6d3aba6a6edb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:45.192037 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-36dd1b21-95f7-4b06-a219-6d3aba6a6edb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:45.192462 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-36dd1b21-95f7-4b06-a219-6d3aba6a6edb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:45.268449 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-36dd1b21-95f7-4b06-a219-6d3aba6a6edb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:45.277998 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-36dd1b21-95f7-4b06-a219-6d3aba6a6edb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:45.279688 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-36dd1b21-95f7-4b06-a219-6d3aba6a6edb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:45.280940 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-36dd1b21-95f7-4b06-a219-6d3aba6a6edb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.101574 Jul 26 07:45:45.281523 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 900/1843] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:45 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:45.319131 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-de02dc15-8bc5-475a-8487-fc21b8f2f3ad tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:45.331462 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-de02dc15-8bc5-475a-8487-fc21b8f2f3ad tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.166496 Jul 26 07:45:45.332161 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 944/1844] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:45 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:45.533550 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0b44460a-8bc4-4b83-a2b2-16d0387670db tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:45.534263 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0b44460a-8bc4-4b83-a2b2-16d0387670db tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:45.541270 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0b44460a-8bc4-4b83-a2b2-16d0387670db tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:45.541802 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0b44460a-8bc4-4b83-a2b2-16d0387670db tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:45.542654 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0b44460a-8bc4-4b83-a2b2-16d0387670db tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:45.543125 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0b44460a-8bc4-4b83-a2b2-16d0387670db tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:45.678299 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0b44460a-8bc4-4b83-a2b2-16d0387670db tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:45.687092 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0b44460a-8bc4-4b83-a2b2-16d0387670db tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.158234 Jul 26 07:45:45.687665 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 901/1845] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:45 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:46.308396 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8c3540dc-1cad-4f1d-8170-a42d7b2115d5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:46.309008 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8c3540dc-1cad-4f1d-8170-a42d7b2115d5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:46.316354 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8c3540dc-1cad-4f1d-8170-a42d7b2115d5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:46.316799 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8c3540dc-1cad-4f1d-8170-a42d7b2115d5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:46.317549 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8c3540dc-1cad-4f1d-8170-a42d7b2115d5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:46.318007 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8c3540dc-1cad-4f1d-8170-a42d7b2115d5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:46.355768 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-af4711e1-e05e-44b4-86ff-2b683579911f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:46.356468 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-af4711e1-e05e-44b4-86ff-2b683579911f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:46.364101 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-af4711e1-e05e-44b4-86ff-2b683579911f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:46.364712 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-af4711e1-e05e-44b4-86ff-2b683579911f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:46.365564 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-af4711e1-e05e-44b4-86ff-2b683579911f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:46.366028 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-af4711e1-e05e-44b4-86ff-2b683579911f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:46.384047 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8c3540dc-1cad-4f1d-8170-a42d7b2115d5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:46.392674 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8c3540dc-1cad-4f1d-8170-a42d7b2115d5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:46.394192 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8c3540dc-1cad-4f1d-8170-a42d7b2115d5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:46.395325 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8c3540dc-1cad-4f1d-8170-a42d7b2115d5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.093387 Jul 26 07:45:46.395875 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 945/1846] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:46 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:46.502513 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-af4711e1-e05e-44b4-86ff-2b683579911f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:46.506432 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:46.511847 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-af4711e1-e05e-44b4-86ff-2b683579911f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.159988 Jul 26 07:45:46.512424 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 902/1847] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:46 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:46.714028 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8761eef6-0c2e-4c76-a7d1-c22134a0645f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:46.714547 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8761eef6-0c2e-4c76-a7d1-c22134a0645f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:46.721419 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8761eef6-0c2e-4c76-a7d1-c22134a0645f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:46.721896 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8761eef6-0c2e-4c76-a7d1-c22134a0645f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:46.722655 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8761eef6-0c2e-4c76-a7d1-c22134a0645f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:46.723080 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8761eef6-0c2e-4c76-a7d1-c22134a0645f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:46.858961 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8761eef6-0c2e-4c76-a7d1-c22134a0645f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:46.867242 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8761eef6-0c2e-4c76-a7d1-c22134a0645f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.157362 Jul 26 07:45:46.867788 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 946/1848] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:46 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:47.235132 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 07:45:47.235442 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Tue Jul 26 07:45:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 07:45:47.420527 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ec62fb82-aa8e-43cb-bd68-bde34c21f17b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:47.421178 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ec62fb82-aa8e-43cb-bd68-bde34c21f17b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:47.428100 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ec62fb82-aa8e-43cb-bd68-bde34c21f17b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:47.428527 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ec62fb82-aa8e-43cb-bd68-bde34c21f17b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:47.429310 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ec62fb82-aa8e-43cb-bd68-bde34c21f17b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:47.429725 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ec62fb82-aa8e-43cb-bd68-bde34c21f17b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:47.492588 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ec62fb82-aa8e-43cb-bd68-bde34c21f17b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:47.501593 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ec62fb82-aa8e-43cb-bd68-bde34c21f17b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:47.503119 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ec62fb82-aa8e-43cb-bd68-bde34c21f17b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:47.504274 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ec62fb82-aa8e-43cb-bd68-bde34c21f17b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.090114 Jul 26 07:45:47.504825 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 903/1849] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:47 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:47.532787 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a93e3f69-9b3f-46be-95f9-54e621fb9ca1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:47.533407 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a93e3f69-9b3f-46be-95f9-54e621fb9ca1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:47.540813 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a93e3f69-9b3f-46be-95f9-54e621fb9ca1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:47.541272 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a93e3f69-9b3f-46be-95f9-54e621fb9ca1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:47.542077 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a93e3f69-9b3f-46be-95f9-54e621fb9ca1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:47.542511 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a93e3f69-9b3f-46be-95f9-54e621fb9ca1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:47.684301 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-a93e3f69-9b3f-46be-95f9-54e621fb9ca1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:47.692812 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a93e3f69-9b3f-46be-95f9-54e621fb9ca1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.164088 Jul 26 07:45:47.693398 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 947/1850] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:47 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:47.889115 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-717cd2d7-194f-49c1-a51f-b1b9fbfff67c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:47.889607 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-717cd2d7-194f-49c1-a51f-b1b9fbfff67c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:47.896325 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-717cd2d7-194f-49c1-a51f-b1b9fbfff67c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:47.896769 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-717cd2d7-194f-49c1-a51f-b1b9fbfff67c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:47.897496 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-717cd2d7-194f-49c1-a51f-b1b9fbfff67c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:47.897987 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-717cd2d7-194f-49c1-a51f-b1b9fbfff67c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:48.033070 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-717cd2d7-194f-49c1-a51f-b1b9fbfff67c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:48.041341 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-717cd2d7-194f-49c1-a51f-b1b9fbfff67c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.156504 Jul 26 07:45:48.041951 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 904/1851] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:47 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:48.529795 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d9d31d14-e63d-4258-a739-71156e3647f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:48.530496 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d9d31d14-e63d-4258-a739-71156e3647f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:48.537372 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d9d31d14-e63d-4258-a739-71156e3647f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:48.538009 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d9d31d14-e63d-4258-a739-71156e3647f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:48.538636 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d9d31d14-e63d-4258-a739-71156e3647f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:48.539061 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d9d31d14-e63d-4258-a739-71156e3647f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:48.607860 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d9d31d14-e63d-4258-a739-71156e3647f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:48.616460 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d9d31d14-e63d-4258-a739-71156e3647f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:48.617940 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d9d31d14-e63d-4258-a739-71156e3647f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:48.619086 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d9d31d14-e63d-4258-a739-71156e3647f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.095271 Jul 26 07:45:48.619646 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 948/1852] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:48 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:48.714864 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-4b08bc1f-88ea-4382-bb98-da6f26ae065d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:48.715449 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-4b08bc1f-88ea-4382-bb98-da6f26ae065d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:48.722241 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4b08bc1f-88ea-4382-bb98-da6f26ae065d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:48.722694 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4b08bc1f-88ea-4382-bb98-da6f26ae065d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:48.723454 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4b08bc1f-88ea-4382-bb98-da6f26ae065d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:48.723884 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4b08bc1f-88ea-4382-bb98-da6f26ae065d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:48.862157 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-4b08bc1f-88ea-4382-bb98-da6f26ae065d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:48.871131 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-4b08bc1f-88ea-4382-bb98-da6f26ae065d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.160352 Jul 26 07:45:48.871705 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 905/1853] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:48 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:49.063158 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-62641fe4-b3f3-40e2-bb22-1762c797ec91 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:49.063763 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-62641fe4-b3f3-40e2-bb22-1762c797ec91 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:49.071408 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-62641fe4-b3f3-40e2-bb22-1762c797ec91 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:49.071954 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-62641fe4-b3f3-40e2-bb22-1762c797ec91 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:49.072765 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-62641fe4-b3f3-40e2-bb22-1762c797ec91 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:49.073236 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-62641fe4-b3f3-40e2-bb22-1762c797ec91 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:49.206760 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-62641fe4-b3f3-40e2-bb22-1762c797ec91 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:49.215674 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-62641fe4-b3f3-40e2-bb22-1762c797ec91 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.156526 Jul 26 07:45:49.216269 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 949/1854] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:49 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:49.642280 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0bcc79eb-597b-4966-8dc9-b5560d9812dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:49.642878 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0bcc79eb-597b-4966-8dc9-b5560d9812dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:49.649591 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0bcc79eb-597b-4966-8dc9-b5560d9812dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:49.650057 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0bcc79eb-597b-4966-8dc9-b5560d9812dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:49.650839 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0bcc79eb-597b-4966-8dc9-b5560d9812dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:49.651268 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0bcc79eb-597b-4966-8dc9-b5560d9812dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:49.714484 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0bcc79eb-597b-4966-8dc9-b5560d9812dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:49.723317 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0bcc79eb-597b-4966-8dc9-b5560d9812dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:49.724841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0bcc79eb-597b-4966-8dc9-b5560d9812dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:49.726036 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0bcc79eb-597b-4966-8dc9-b5560d9812dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.087836 Jul 26 07:45:49.726595 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 906/1855] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:49 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:49.892353 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7d98f080-810b-4850-89b2-0f1eeebbf722 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:49.892923 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7d98f080-810b-4850-89b2-0f1eeebbf722 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:49.899963 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7d98f080-810b-4850-89b2-0f1eeebbf722 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:49.900419 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7d98f080-810b-4850-89b2-0f1eeebbf722 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:49.901177 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7d98f080-810b-4850-89b2-0f1eeebbf722 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:49.901610 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7d98f080-810b-4850-89b2-0f1eeebbf722 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:50.035498 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7d98f080-810b-4850-89b2-0f1eeebbf722 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:50.043827 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7d98f080-810b-4850-89b2-0f1eeebbf722 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.155569 Jul 26 07:45:50.044438 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 950/1856] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:49 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:50.239666 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-63bffd7b-c678-45d3-8bf5-44e290ae8320 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:50.240256 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-63bffd7b-c678-45d3-8bf5-44e290ae8320 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:50.250075 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-63bffd7b-c678-45d3-8bf5-44e290ae8320 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:50.250516 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-63bffd7b-c678-45d3-8bf5-44e290ae8320 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:50.251278 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-63bffd7b-c678-45d3-8bf5-44e290ae8320 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:50.251705 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-63bffd7b-c678-45d3-8bf5-44e290ae8320 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:50.393563 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-63bffd7b-c678-45d3-8bf5-44e290ae8320 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:50.405338 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-63bffd7b-c678-45d3-8bf5-44e290ae8320 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.171332 Jul 26 07:45:50.406369 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 907/1857] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:50 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:50.749897 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9b5f5445-3097-402a-ba3d-2b668a1c9b5f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:50.750494 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-9b5f5445-3097-402a-ba3d-2b668a1c9b5f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:50.757055 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9b5f5445-3097-402a-ba3d-2b668a1c9b5f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:50.757504 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9b5f5445-3097-402a-ba3d-2b668a1c9b5f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:50.758290 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9b5f5445-3097-402a-ba3d-2b668a1c9b5f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:50.758714 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9b5f5445-3097-402a-ba3d-2b668a1c9b5f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:50.825762 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-9b5f5445-3097-402a-ba3d-2b668a1c9b5f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:50.829513 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:50.834897 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-9b5f5445-3097-402a-ba3d-2b668a1c9b5f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:50.836371 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-9b5f5445-3097-402a-ba3d-2b668a1c9b5f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:50.837498 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-9b5f5445-3097-402a-ba3d-2b668a1c9b5f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.091753 Jul 26 07:45:50.838149 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 951/1858] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:50 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:51.066734 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-e93a0f66-b7b7-479d-9e08-ea2d18324c77 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:51.067612 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-e93a0f66-b7b7-479d-9e08-ea2d18324c77 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:51.075069 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e93a0f66-b7b7-479d-9e08-ea2d18324c77 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:51.075460 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e93a0f66-b7b7-479d-9e08-ea2d18324c77 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:51.076254 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e93a0f66-b7b7-479d-9e08-ea2d18324c77 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:51.076684 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e93a0f66-b7b7-479d-9e08-ea2d18324c77 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:51.225228 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-e93a0f66-b7b7-479d-9e08-ea2d18324c77 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:51.233960 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-e93a0f66-b7b7-479d-9e08-ea2d18324c77 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.171437 Jul 26 07:45:51.234535 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 908/1859] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:51 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:51.435245 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8b28dd7b-ca0d-45c6-8787-ce593729e0a7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:51.435911 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8b28dd7b-ca0d-45c6-8787-ce593729e0a7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:51.443478 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8b28dd7b-ca0d-45c6-8787-ce593729e0a7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:51.443934 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8b28dd7b-ca0d-45c6-8787-ce593729e0a7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:51.444697 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8b28dd7b-ca0d-45c6-8787-ce593729e0a7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:51.445130 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8b28dd7b-ca0d-45c6-8787-ce593729e0a7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:51.582207 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8b28dd7b-ca0d-45c6-8787-ce593729e0a7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:51.590136 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8b28dd7b-ca0d-45c6-8787-ce593729e0a7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.161692 Jul 26 07:45:51.590705 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 952/1860] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:51 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:51.861470 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7085b0fc-744f-45f0-9c1f-6ece8e933373 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:51.862204 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7085b0fc-744f-45f0-9c1f-6ece8e933373 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:51.869352 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7085b0fc-744f-45f0-9c1f-6ece8e933373 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:51.870003 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7085b0fc-744f-45f0-9c1f-6ece8e933373 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:51.870836 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7085b0fc-744f-45f0-9c1f-6ece8e933373 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:51.871318 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7085b0fc-744f-45f0-9c1f-6ece8e933373 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:52.097273 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7085b0fc-744f-45f0-9c1f-6ece8e933373 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:52.106258 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7085b0fc-744f-45f0-9c1f-6ece8e933373 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:52.107747 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7085b0fc-744f-45f0-9c1f-6ece8e933373 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:52.109050 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7085b0fc-744f-45f0-9c1f-6ece8e933373 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.252058 Jul 26 07:45:52.109578 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 909/1861] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:51 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:52.255687 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3b4a1f0c-5643-4265-a3dc-3945ef2e8cd3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:52.256292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3b4a1f0c-5643-4265-a3dc-3945ef2e8cd3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:52.262965 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3b4a1f0c-5643-4265-a3dc-3945ef2e8cd3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:52.263414 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3b4a1f0c-5643-4265-a3dc-3945ef2e8cd3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:52.264174 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3b4a1f0c-5643-4265-a3dc-3945ef2e8cd3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:52.264601 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3b4a1f0c-5643-4265-a3dc-3945ef2e8cd3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:52.415072 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3b4a1f0c-5643-4265-a3dc-3945ef2e8cd3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:52.423834 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3b4a1f0c-5643-4265-a3dc-3945ef2e8cd3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.172132 Jul 26 07:45:52.424411 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 953/1862] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:52 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:52.612663 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-469f88da-bd28-4673-b33f-181353c53279 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:52.613185 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-469f88da-bd28-4673-b33f-181353c53279 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:52.619748 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-469f88da-bd28-4673-b33f-181353c53279 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:52.620185 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-469f88da-bd28-4673-b33f-181353c53279 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:52.620936 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-469f88da-bd28-4673-b33f-181353c53279 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:52.621356 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-469f88da-bd28-4673-b33f-181353c53279 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:52.761093 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-469f88da-bd28-4673-b33f-181353c53279 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:52.771183 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-469f88da-bd28-4673-b33f-181353c53279 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.162245 Jul 26 07:45:52.771918 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 910/1863] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:52 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:53.132142 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8e0d8c4c-035b-4ec8-bad7-bd7e1aafdb43 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:53.132747 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8e0d8c4c-035b-4ec8-bad7-bd7e1aafdb43 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:53.140911 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8e0d8c4c-035b-4ec8-bad7-bd7e1aafdb43 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:53.141359 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8e0d8c4c-035b-4ec8-bad7-bd7e1aafdb43 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:53.142160 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8e0d8c4c-035b-4ec8-bad7-bd7e1aafdb43 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:53.142594 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8e0d8c4c-035b-4ec8-bad7-bd7e1aafdb43 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:53.213017 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8e0d8c4c-035b-4ec8-bad7-bd7e1aafdb43 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:53.226218 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8e0d8c4c-035b-4ec8-bad7-bd7e1aafdb43 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:53.228510 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8e0d8c4c-035b-4ec8-bad7-bd7e1aafdb43 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:53.230200 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8e0d8c4c-035b-4ec8-bad7-bd7e1aafdb43 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.101746 Jul 26 07:45:53.231053 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 954/1864] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:53 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:53.451883 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-1bea2921-7dbd-49e8-ba20-e0ba2bf1ff53 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:53.452458 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-1bea2921-7dbd-49e8-ba20-e0ba2bf1ff53 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:53.460111 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1bea2921-7dbd-49e8-ba20-e0ba2bf1ff53 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:53.460492 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1bea2921-7dbd-49e8-ba20-e0ba2bf1ff53 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:53.461254 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1bea2921-7dbd-49e8-ba20-e0ba2bf1ff53 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:53.461683 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1bea2921-7dbd-49e8-ba20-e0ba2bf1ff53 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:53.600323 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-1bea2921-7dbd-49e8-ba20-e0ba2bf1ff53 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:53.608792 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-1bea2921-7dbd-49e8-ba20-e0ba2bf1ff53 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.161667 Jul 26 07:45:53.609353 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 911/1865] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:53 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:53.796038 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-4f4ab695-ca34-4582-b3d1-5ad1919a06bf tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:53.796909 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-4f4ab695-ca34-4582-b3d1-5ad1919a06bf tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:53.806056 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4f4ab695-ca34-4582-b3d1-5ad1919a06bf tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:53.806685 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4f4ab695-ca34-4582-b3d1-5ad1919a06bf tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:53.807760 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4f4ab695-ca34-4582-b3d1-5ad1919a06bf tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:53.808366 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4f4ab695-ca34-4582-b3d1-5ad1919a06bf tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:53.941629 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-4f4ab695-ca34-4582-b3d1-5ad1919a06bf tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:53.949732 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-4f4ab695-ca34-4582-b3d1-5ad1919a06bf tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.159319 Jul 26 07:45:53.950337 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 955/1866] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:53 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:54.256824 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-3445b4e6-0770-4e65-8535-53fa41771b8d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:54.257633 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-3445b4e6-0770-4e65-8535-53fa41771b8d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:54.266936 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3445b4e6-0770-4e65-8535-53fa41771b8d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:54.267700 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3445b4e6-0770-4e65-8535-53fa41771b8d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:54.268920 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3445b4e6-0770-4e65-8535-53fa41771b8d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:54.269651 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3445b4e6-0770-4e65-8535-53fa41771b8d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:54.338536 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-3445b4e6-0770-4e65-8535-53fa41771b8d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:54.347159 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-3445b4e6-0770-4e65-8535-53fa41771b8d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:54.348622 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-3445b4e6-0770-4e65-8535-53fa41771b8d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:54.349768 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-3445b4e6-0770-4e65-8535-53fa41771b8d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.099310 Jul 26 07:45:54.350350 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 912/1867] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:54 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:54.633856 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9d8780b4-9cc6-4778-ac87-7048f7efa424 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:54.634530 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-9d8780b4-9cc6-4778-ac87-7048f7efa424 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:54.642883 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9d8780b4-9cc6-4778-ac87-7048f7efa424 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:54.643337 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9d8780b4-9cc6-4778-ac87-7048f7efa424 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:54.644104 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9d8780b4-9cc6-4778-ac87-7048f7efa424 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:54.644532 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9d8780b4-9cc6-4778-ac87-7048f7efa424 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:54.782323 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-9d8780b4-9cc6-4778-ac87-7048f7efa424 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:54.790392 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-9d8780b4-9cc6-4778-ac87-7048f7efa424 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.162835 Jul 26 07:45:54.790966 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 956/1868] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:54 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:54.972712 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-aef92d39-4743-47ff-aa30-a0b0ecf146f6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:54.973296 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-aef92d39-4743-47ff-aa30-a0b0ecf146f6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:54.980257 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-aef92d39-4743-47ff-aa30-a0b0ecf146f6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:54.980703 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-aef92d39-4743-47ff-aa30-a0b0ecf146f6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:54.981454 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-aef92d39-4743-47ff-aa30-a0b0ecf146f6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:54.981915 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-aef92d39-4743-47ff-aa30-a0b0ecf146f6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:55.123465 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-aef92d39-4743-47ff-aa30-a0b0ecf146f6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:55.132133 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-aef92d39-4743-47ff-aa30-a0b0ecf146f6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.163446 Jul 26 07:45:55.132683 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 913/1869] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:54 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:55.374582 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3b244761-a08d-4dee-9743-ea18d60b9b1e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:55.375125 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3b244761-a08d-4dee-9743-ea18d60b9b1e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:55.384273 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3b244761-a08d-4dee-9743-ea18d60b9b1e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:55.384815 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3b244761-a08d-4dee-9743-ea18d60b9b1e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:55.385901 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3b244761-a08d-4dee-9743-ea18d60b9b1e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:55.386523 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3b244761-a08d-4dee-9743-ea18d60b9b1e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:55.453407 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3b244761-a08d-4dee-9743-ea18d60b9b1e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:55.462228 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3b244761-a08d-4dee-9743-ea18d60b9b1e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:55.463699 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3b244761-a08d-4dee-9743-ea18d60b9b1e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:55.464831 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3b244761-a08d-4dee-9743-ea18d60b9b1e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.095954 Jul 26 07:45:55.465408 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 957/1870] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:55 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:55.814614 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0930852d-80c3-4671-914a-98480ecab186 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:55.815224 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0930852d-80c3-4671-914a-98480ecab186 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:55.821690 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0930852d-80c3-4671-914a-98480ecab186 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:55.822173 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0930852d-80c3-4671-914a-98480ecab186 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:55.822928 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0930852d-80c3-4671-914a-98480ecab186 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:55.823355 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0930852d-80c3-4671-914a-98480ecab186 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:55.954461 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0930852d-80c3-4671-914a-98480ecab186 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:55.967164 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0930852d-80c3-4671-914a-98480ecab186 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.157789 Jul 26 07:45:55.967972 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 914/1871] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:55 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:56.162495 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e0b3f2a4-71db-4803-8fc7-4d1dfb2f174e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:56.163195 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e0b3f2a4-71db-4803-8fc7-4d1dfb2f174e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:56.172782 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e0b3f2a4-71db-4803-8fc7-4d1dfb2f174e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:56.173226 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e0b3f2a4-71db-4803-8fc7-4d1dfb2f174e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:56.174015 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e0b3f2a4-71db-4803-8fc7-4d1dfb2f174e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:56.174442 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e0b3f2a4-71db-4803-8fc7-4d1dfb2f174e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:56.320297 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-e0b3f2a4-71db-4803-8fc7-4d1dfb2f174e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:56.329334 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e0b3f2a4-71db-4803-8fc7-4d1dfb2f174e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.172634 Jul 26 07:45:56.329964 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 958/1872] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:56 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:56.487296 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2dfdefdc-14d6-4fb9-8082-e8463778d483 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:56.487921 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2dfdefdc-14d6-4fb9-8082-e8463778d483 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:56.489855 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=80 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:56.495865 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2dfdefdc-14d6-4fb9-8082-e8463778d483 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:56.496309 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2dfdefdc-14d6-4fb9-8082-e8463778d483 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:56.497062 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2dfdefdc-14d6-4fb9-8082-e8463778d483 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:56.497485 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2dfdefdc-14d6-4fb9-8082-e8463778d483 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:56.560427 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2dfdefdc-14d6-4fb9-8082-e8463778d483 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:56.569365 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2dfdefdc-14d6-4fb9-8082-e8463778d483 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:56.570893 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2dfdefdc-14d6-4fb9-8082-e8463778d483 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:56.572048 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2dfdefdc-14d6-4fb9-8082-e8463778d483 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.088767 Jul 26 07:45:56.572617 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 915/1873] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:56 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:56.992336 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-cb566002-38ef-48c1-9cd7-3df196095bb3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:56.993699 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-cb566002-38ef-48c1-9cd7-3df196095bb3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:57.002884 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cb566002-38ef-48c1-9cd7-3df196095bb3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:57.003571 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cb566002-38ef-48c1-9cd7-3df196095bb3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:57.004645 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cb566002-38ef-48c1-9cd7-3df196095bb3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:57.005217 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cb566002-38ef-48c1-9cd7-3df196095bb3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:57.145980 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-cb566002-38ef-48c1-9cd7-3df196095bb3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:57.154112 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-cb566002-38ef-48c1-9cd7-3df196095bb3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.167549 Jul 26 07:45:57.154666 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 959/1874] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:56 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:57.352705 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2258353a-2dec-4dab-b3bd-4a6b6a68a390 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:57.353503 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2258353a-2dec-4dab-b3bd-4a6b6a68a390 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:57.362484 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2258353a-2dec-4dab-b3bd-4a6b6a68a390 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:57.363080 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2258353a-2dec-4dab-b3bd-4a6b6a68a390 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:57.364087 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2258353a-2dec-4dab-b3bd-4a6b6a68a390 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:57.364657 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2258353a-2dec-4dab-b3bd-4a6b6a68a390 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:57.504192 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2258353a-2dec-4dab-b3bd-4a6b6a68a390 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:57.513129 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2258353a-2dec-4dab-b3bd-4a6b6a68a390 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.165525 Jul 26 07:45:57.513651 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 916/1875] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:57 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:57.596179 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-5d10a9e3-832f-47c8-a6f8-97b6471d7d40 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:57.596797 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-5d10a9e3-832f-47c8-a6f8-97b6471d7d40 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:57.599480 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=76 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:57.605533 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5d10a9e3-832f-47c8-a6f8-97b6471d7d40 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:57.606001 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5d10a9e3-832f-47c8-a6f8-97b6471d7d40 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:57.606759 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5d10a9e3-832f-47c8-a6f8-97b6471d7d40 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:57.607184 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5d10a9e3-832f-47c8-a6f8-97b6471d7d40 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:57.670455 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-5d10a9e3-832f-47c8-a6f8-97b6471d7d40 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:57.680216 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-5d10a9e3-832f-47c8-a6f8-97b6471d7d40 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:57.681725 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-5d10a9e3-832f-47c8-a6f8-97b6471d7d40 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:57.682927 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-5d10a9e3-832f-47c8-a6f8-97b6471d7d40 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.091447 Jul 26 07:45:57.683482 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 960/1876] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:57 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:58.176465 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a5b011b2-9835-4592-bf87-2c0fd072d54a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:58.177072 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a5b011b2-9835-4592-bf87-2c0fd072d54a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:58.183666 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a5b011b2-9835-4592-bf87-2c0fd072d54a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:58.184112 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a5b011b2-9835-4592-bf87-2c0fd072d54a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:58.184882 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a5b011b2-9835-4592-bf87-2c0fd072d54a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:58.185287 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a5b011b2-9835-4592-bf87-2c0fd072d54a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:58.318282 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a5b011b2-9835-4592-bf87-2c0fd072d54a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:58.331205 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a5b011b2-9835-4592-bf87-2c0fd072d54a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.159163 Jul 26 07:45:58.331770 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 917/1877] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:58 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:58.537460 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ab4920a1-cad0-48bc-9b56-180483233265 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:58.538231 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ab4920a1-cad0-48bc-9b56-180483233265 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:58.546639 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ab4920a1-cad0-48bc-9b56-180483233265 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:58.547292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ab4920a1-cad0-48bc-9b56-180483233265 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:58.548300 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ab4920a1-cad0-48bc-9b56-180483233265 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:58.548902 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ab4920a1-cad0-48bc-9b56-180483233265 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:58.681488 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ab4920a1-cad0-48bc-9b56-180483233265 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:58.690291 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ab4920a1-cad0-48bc-9b56-180483233265 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.158111 Jul 26 07:45:58.690859 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 961/1878] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:58 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:58.704946 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0e0377d5-5bab-4c05-9815-832d17dac283 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:58.705562 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0e0377d5-5bab-4c05-9815-832d17dac283 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:58.712136 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0e0377d5-5bab-4c05-9815-832d17dac283 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:58.712579 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0e0377d5-5bab-4c05-9815-832d17dac283 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:58.713350 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0e0377d5-5bab-4c05-9815-832d17dac283 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:58.713767 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0e0377d5-5bab-4c05-9815-832d17dac283 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:58.776858 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0e0377d5-5bab-4c05-9815-832d17dac283 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:58.786936 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0e0377d5-5bab-4c05-9815-832d17dac283 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:58.788531 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0e0377d5-5bab-4c05-9815-832d17dac283 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:58.789730 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0e0377d5-5bab-4c05-9815-832d17dac283 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.089208 Jul 26 07:45:58.790325 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 918/1879] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:58 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:45:59.352442 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b832ae3c-18ab-47c8-829a-4ce1c0f761ed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:59.352943 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b832ae3c-18ab-47c8-829a-4ce1c0f761ed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:59.359405 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b832ae3c-18ab-47c8-829a-4ce1c0f761ed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:59.359851 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b832ae3c-18ab-47c8-829a-4ce1c0f761ed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:59.360601 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b832ae3c-18ab-47c8-829a-4ce1c0f761ed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:59.361027 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b832ae3c-18ab-47c8-829a-4ce1c0f761ed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:59.514017 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-b832ae3c-18ab-47c8-829a-4ce1c0f761ed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:59.525024 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b832ae3c-18ab-47c8-829a-4ce1c0f761ed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.176110 Jul 26 07:45:59.525695 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 962/1880] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:59 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:59.714841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-3557e19f-0c8e-4d71-81f5-55979d5952d1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:59.715418 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-3557e19f-0c8e-4d71-81f5-55979d5952d1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:59.724554 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3557e19f-0c8e-4d71-81f5-55979d5952d1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:59.724990 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3557e19f-0c8e-4d71-81f5-55979d5952d1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:59.725816 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3557e19f-0c8e-4d71-81f5-55979d5952d1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:59.726239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3557e19f-0c8e-4d71-81f5-55979d5952d1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:59.749896 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:59.812872 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-024445de-0da6-4575-b090-b750bd49e5ad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:45:59.814275 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-024445de-0da6-4575-b090-b750bd49e5ad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:45:59.822418 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-024445de-0da6-4575-b090-b750bd49e5ad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:59.822862 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-024445de-0da6-4575-b090-b750bd49e5ad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:59.823726 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-024445de-0da6-4575-b090-b750bd49e5ad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:45:59.824146 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-024445de-0da6-4575-b090-b750bd49e5ad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:45:59.870334 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-3557e19f-0c8e-4d71-81f5-55979d5952d1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:59.878907 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-3557e19f-0c8e-4d71-81f5-55979d5952d1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.170065 Jul 26 07:45:59.879467 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 919/1881] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:45:59 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:45:59.888713 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-024445de-0da6-4575-b090-b750bd49e5ad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:59.897396 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-024445de-0da6-4575-b090-b750bd49e5ad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:59.898906 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-024445de-0da6-4575-b090-b750bd49e5ad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:45:59.900056 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-024445de-0da6-4575-b090-b750bd49e5ad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.091282 Jul 26 07:45:59.900649 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 963/1882] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:45:59 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:00.548475 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a0a182ce-f8f4-47da-a63b-4151fa65d224 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:00.549060 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a0a182ce-f8f4-47da-a63b-4151fa65d224 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:00.556026 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a0a182ce-f8f4-47da-a63b-4151fa65d224 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:00.556473 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a0a182ce-f8f4-47da-a63b-4151fa65d224 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:00.557234 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a0a182ce-f8f4-47da-a63b-4151fa65d224 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:00.557670 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a0a182ce-f8f4-47da-a63b-4151fa65d224 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:00.704001 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a0a182ce-f8f4-47da-a63b-4151fa65d224 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:00.712482 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a0a182ce-f8f4-47da-a63b-4151fa65d224 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.168003 Jul 26 07:46:00.713040 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 920/1883] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:00 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:00.900976 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7924c38c-37cd-4f4e-b6c8-028d6a61226c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:00.901618 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7924c38c-37cd-4f4e-b6c8-028d6a61226c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:00.908566 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7924c38c-37cd-4f4e-b6c8-028d6a61226c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:00.909011 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7924c38c-37cd-4f4e-b6c8-028d6a61226c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:00.909839 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7924c38c-37cd-4f4e-b6c8-028d6a61226c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:00.910269 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7924c38c-37cd-4f4e-b6c8-028d6a61226c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:00.922771 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-e665adc7-a646-4d21-b519-12a34c68eac0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:00.923355 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-e665adc7-a646-4d21-b519-12a34c68eac0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:00.930511 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e665adc7-a646-4d21-b519-12a34c68eac0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:00.930966 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e665adc7-a646-4d21-b519-12a34c68eac0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:00.931736 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e665adc7-a646-4d21-b519-12a34c68eac0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:00.932171 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e665adc7-a646-4d21-b519-12a34c68eac0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:00.998689 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-e665adc7-a646-4d21-b519-12a34c68eac0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:01.007556 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-e665adc7-a646-4d21-b519-12a34c68eac0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:01.009046 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-e665adc7-a646-4d21-b519-12a34c68eac0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:01.010240 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-e665adc7-a646-4d21-b519-12a34c68eac0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.091464 Jul 26 07:46:01.010801 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 921/1884] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:00 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:01.046834 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7924c38c-37cd-4f4e-b6c8-028d6a61226c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:01.054956 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7924c38c-37cd-4f4e-b6c8-028d6a61226c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.157942 Jul 26 07:46:01.055487 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 964/1885] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:00 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:01.734601 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-bf52ac33-ee1c-44b6-8f09-736c25441d20 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:01.735114 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-bf52ac33-ee1c-44b6-8f09-736c25441d20 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:01.743579 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bf52ac33-ee1c-44b6-8f09-736c25441d20 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:01.744333 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bf52ac33-ee1c-44b6-8f09-736c25441d20 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:01.745247 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bf52ac33-ee1c-44b6-8f09-736c25441d20 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:01.745680 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bf52ac33-ee1c-44b6-8f09-736c25441d20 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:01.883683 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-bf52ac33-ee1c-44b6-8f09-736c25441d20 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:01.891930 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-bf52ac33-ee1c-44b6-8f09-736c25441d20 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.161369 Jul 26 07:46:01.892467 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 922/1886] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:01 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:02.033007 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-dc6c4736-9080-45f8-bdbd-9c8d9f6fda12 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:02.033623 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-dc6c4736-9080-45f8-bdbd-9c8d9f6fda12 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:02.040760 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dc6c4736-9080-45f8-bdbd-9c8d9f6fda12 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:02.041210 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dc6c4736-9080-45f8-bdbd-9c8d9f6fda12 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:02.042024 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dc6c4736-9080-45f8-bdbd-9c8d9f6fda12 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:02.042457 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dc6c4736-9080-45f8-bdbd-9c8d9f6fda12 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:02.076297 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0c4be3a4-aba1-445c-a085-b92fd32f27e0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:02.076908 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0c4be3a4-aba1-445c-a085-b92fd32f27e0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:02.084348 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0c4be3a4-aba1-445c-a085-b92fd32f27e0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:02.084794 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0c4be3a4-aba1-445c-a085-b92fd32f27e0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:02.085549 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0c4be3a4-aba1-445c-a085-b92fd32f27e0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:02.086011 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0c4be3a4-aba1-445c-a085-b92fd32f27e0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:02.105131 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-dc6c4736-9080-45f8-bdbd-9c8d9f6fda12 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:02.114144 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-dc6c4736-9080-45f8-bdbd-9c8d9f6fda12 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:02.115780 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-dc6c4736-9080-45f8-bdbd-9c8d9f6fda12 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:02.116925 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-dc6c4736-9080-45f8-bdbd-9c8d9f6fda12 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.088005 Jul 26 07:46:02.117461 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 965/1887] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:02 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:02.219079 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0c4be3a4-aba1-445c-a085-b92fd32f27e0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:02.228676 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0c4be3a4-aba1-445c-a085-b92fd32f27e0 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.155933 Jul 26 07:46:02.229539 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 923/1888] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:02 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:02.913583 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f0231c2d-af7b-4d32-803f-34e86ecf5974 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:02.914217 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f0231c2d-af7b-4d32-803f-34e86ecf5974 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:02.920881 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f0231c2d-af7b-4d32-803f-34e86ecf5974 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:02.921329 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f0231c2d-af7b-4d32-803f-34e86ecf5974 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:02.922118 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f0231c2d-af7b-4d32-803f-34e86ecf5974 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:02.922542 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f0231c2d-af7b-4d32-803f-34e86ecf5974 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:03.066494 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f0231c2d-af7b-4d32-803f-34e86ecf5974 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:03.079329 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f0231c2d-af7b-4d32-803f-34e86ecf5974 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.169432 Jul 26 07:46:03.080151 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 966/1889] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:02 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:03.141944 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8d992537-b7c0-48a1-8f2d-77a31ffcf10b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:03.142694 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8d992537-b7c0-48a1-8f2d-77a31ffcf10b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:03.151507 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8d992537-b7c0-48a1-8f2d-77a31ffcf10b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:03.152099 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8d992537-b7c0-48a1-8f2d-77a31ffcf10b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:03.153092 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8d992537-b7c0-48a1-8f2d-77a31ffcf10b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:03.153658 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8d992537-b7c0-48a1-8f2d-77a31ffcf10b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:03.220757 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8d992537-b7c0-48a1-8f2d-77a31ffcf10b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:03.229547 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8d992537-b7c0-48a1-8f2d-77a31ffcf10b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:03.231053 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8d992537-b7c0-48a1-8f2d-77a31ffcf10b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:03.232202 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8d992537-b7c0-48a1-8f2d-77a31ffcf10b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.095504 Jul 26 07:46:03.232741 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 924/1890] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:03 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:03.253119 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c886f488-99c9-424a-b54c-8a85e03096f4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:03.253926 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c886f488-99c9-424a-b54c-8a85e03096f4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:03.260297 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c886f488-99c9-424a-b54c-8a85e03096f4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:03.260688 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c886f488-99c9-424a-b54c-8a85e03096f4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:03.261441 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c886f488-99c9-424a-b54c-8a85e03096f4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:03.261906 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c886f488-99c9-424a-b54c-8a85e03096f4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:03.403415 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c886f488-99c9-424a-b54c-8a85e03096f4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:03.412259 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c886f488-99c9-424a-b54c-8a85e03096f4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.165558 Jul 26 07:46:03.412798 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 967/1891] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:03 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:04.103676 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-69fec959-cd8d-49db-8984-e7c752152b9f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:04.104418 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-69fec959-cd8d-49db-8984-e7c752152b9f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:04.111557 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-69fec959-cd8d-49db-8984-e7c752152b9f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:04.112002 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-69fec959-cd8d-49db-8984-e7c752152b9f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:04.112793 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-69fec959-cd8d-49db-8984-e7c752152b9f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:04.113225 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-69fec959-cd8d-49db-8984-e7c752152b9f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:04.250682 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-69fec959-cd8d-49db-8984-e7c752152b9f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:04.255477 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-1e0c480d-968a-452a-be4c-2e7eb31a8c81 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:04.256110 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-1e0c480d-968a-452a-be4c-2e7eb31a8c81 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:04.259110 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-69fec959-cd8d-49db-8984-e7c752152b9f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.160459 Jul 26 07:46:04.259856 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 925/1892] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:04 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:04.262954 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1e0c480d-968a-452a-be4c-2e7eb31a8c81 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:04.263397 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1e0c480d-968a-452a-be4c-2e7eb31a8c81 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:04.264152 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1e0c480d-968a-452a-be4c-2e7eb31a8c81 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:04.264574 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1e0c480d-968a-452a-be4c-2e7eb31a8c81 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:04.283973 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:46:04.330295 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-1e0c480d-968a-452a-be4c-2e7eb31a8c81 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:04.339729 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-1e0c480d-968a-452a-be4c-2e7eb31a8c81 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:04.341208 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-1e0c480d-968a-452a-be4c-2e7eb31a8c81 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:04.342398 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-1e0c480d-968a-452a-be4c-2e7eb31a8c81 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.090784 Jul 26 07:46:04.342928 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 968/1893] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:04 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 07:46:04.435944 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-24cde6ad-a702-49b3-a580-a2116041ad69 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:04.436555 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-24cde6ad-a702-49b3-a580-a2116041ad69 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:04.444385 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-24cde6ad-a702-49b3-a580-a2116041ad69 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:04.445019 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-24cde6ad-a702-49b3-a580-a2116041ad69 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:04.446128 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-24cde6ad-a702-49b3-a580-a2116041ad69 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:04.446786 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-24cde6ad-a702-49b3-a580-a2116041ad69 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:04.589497 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-24cde6ad-a702-49b3-a580-a2116041ad69 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:04.600881 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-24cde6ad-a702-49b3-a580-a2116041ad69 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.170236 Jul 26 07:46:04.601665 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 926/1894] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:04 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:05.280862 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-1edbab08-fb4c-4584-a1e2-c10e8584917a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:05.281447 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-1edbab08-fb4c-4584-a1e2-c10e8584917a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:05.288387 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1edbab08-fb4c-4584-a1e2-c10e8584917a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:05.288831 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1edbab08-fb4c-4584-a1e2-c10e8584917a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:05.289595 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1edbab08-fb4c-4584-a1e2-c10e8584917a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:05.290050 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1edbab08-fb4c-4584-a1e2-c10e8584917a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:05.365561 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-37e82326-622b-41fe-a5f3-618a7aeb5c5e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:05.366202 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-37e82326-622b-41fe-a5f3-618a7aeb5c5e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:05.373493 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-37e82326-622b-41fe-a5f3-618a7aeb5c5e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:05.373973 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-37e82326-622b-41fe-a5f3-618a7aeb5c5e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:05.374775 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-37e82326-622b-41fe-a5f3-618a7aeb5c5e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:05.375203 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-37e82326-622b-41fe-a5f3-618a7aeb5c5e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:05.426179 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-1edbab08-fb4c-4584-a1e2-c10e8584917a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:05.434679 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-1edbab08-fb4c-4584-a1e2-c10e8584917a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.157900 Jul 26 07:46:05.435518 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 969/1895] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:05 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:05.442508 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-37e82326-622b-41fe-a5f3-618a7aeb5c5e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:05.451348 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-37e82326-622b-41fe-a5f3-618a7aeb5c5e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:05.453182 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-37e82326-622b-41fe-a5f3-618a7aeb5c5e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:05.454363 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-37e82326-622b-41fe-a5f3-618a7aeb5c5e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.092995 Jul 26 07:46:05.454921 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 927/1896] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:05 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 07:46:05.628133 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-023386c3-925d-4095-8a3a-74982bcd04ba tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:05.628847 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-023386c3-925d-4095-8a3a-74982bcd04ba tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:05.635857 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-023386c3-925d-4095-8a3a-74982bcd04ba tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:05.636306 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-023386c3-925d-4095-8a3a-74982bcd04ba tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:05.637060 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-023386c3-925d-4095-8a3a-74982bcd04ba tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:05.637496 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-023386c3-925d-4095-8a3a-74982bcd04ba tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:05.780289 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-023386c3-925d-4095-8a3a-74982bcd04ba tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:05.788374 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-023386c3-925d-4095-8a3a-74982bcd04ba tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.166559 Jul 26 07:46:05.788965 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 970/1897] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:05 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:06.457456 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a4b0a066-d4ae-4faa-8822-f8760c0d5a93 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:06.458406 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a4b0a066-d4ae-4faa-8822-f8760c0d5a93 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:06.465042 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a4b0a066-d4ae-4faa-8822-f8760c0d5a93 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:06.465483 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a4b0a066-d4ae-4faa-8822-f8760c0d5a93 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:06.466277 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a4b0a066-d4ae-4faa-8822-f8760c0d5a93 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:06.466703 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a4b0a066-d4ae-4faa-8822-f8760c0d5a93 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:06.476944 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-0054ee86-9122-44bc-bd27-edd7adf3e9f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:06.477582 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-0054ee86-9122-44bc-bd27-edd7adf3e9f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:06.484381 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0054ee86-9122-44bc-bd27-edd7adf3e9f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:06.484822 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0054ee86-9122-44bc-bd27-edd7adf3e9f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:06.485569 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0054ee86-9122-44bc-bd27-edd7adf3e9f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:06.486020 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0054ee86-9122-44bc-bd27-edd7adf3e9f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:06.550124 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-0054ee86-9122-44bc-bd27-edd7adf3e9f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:06.559511 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-0054ee86-9122-44bc-bd27-edd7adf3e9f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:06.561149 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-0054ee86-9122-44bc-bd27-edd7adf3e9f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:06.562470 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-0054ee86-9122-44bc-bd27-edd7adf3e9f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.089503 Jul 26 07:46:06.563072 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 971/1898] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:06 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:06.600145 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a4b0a066-d4ae-4faa-8822-f8760c0d5a93 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:06.609179 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a4b0a066-d4ae-4faa-8822-f8760c0d5a93 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.156299 Jul 26 07:46:06.609866 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 928/1899] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:06 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:06.810109 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-86453cc1-ca0a-4258-950d-d8e595e991fc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:06.810722 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-86453cc1-ca0a-4258-950d-d8e595e991fc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:06.817254 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-86453cc1-ca0a-4258-950d-d8e595e991fc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:06.817689 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-86453cc1-ca0a-4258-950d-d8e595e991fc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:06.818581 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-86453cc1-ca0a-4258-950d-d8e595e991fc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:06.819001 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-86453cc1-ca0a-4258-950d-d8e595e991fc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:06.953171 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-86453cc1-ca0a-4258-950d-d8e595e991fc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:06.961513 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-86453cc1-ca0a-4258-950d-d8e595e991fc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.155344 Jul 26 07:46:06.962198 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 972/1900] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:06 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:07.588938 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-318bc20a-f761-4272-be50-2a8927e948dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:07.589832 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-318bc20a-f761-4272-be50-2a8927e948dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:07.600210 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-318bc20a-f761-4272-be50-2a8927e948dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:07.600660 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-318bc20a-f761-4272-be50-2a8927e948dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:07.601441 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-318bc20a-f761-4272-be50-2a8927e948dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:07.601899 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-318bc20a-f761-4272-be50-2a8927e948dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:07.632540 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8662e0e3-65e6-4305-b82e-a64f3470e428 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:07.633132 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8662e0e3-65e6-4305-b82e-a64f3470e428 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:07.639932 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8662e0e3-65e6-4305-b82e-a64f3470e428 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:07.640374 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8662e0e3-65e6-4305-b82e-a64f3470e428 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:07.641160 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8662e0e3-65e6-4305-b82e-a64f3470e428 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:07.641596 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8662e0e3-65e6-4305-b82e-a64f3470e428 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:07.665604 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-318bc20a-f761-4272-be50-2a8927e948dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:07.674785 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-318bc20a-f761-4272-be50-2a8927e948dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:07.676270 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-318bc20a-f761-4272-be50-2a8927e948dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:07.677448 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-318bc20a-f761-4272-be50-2a8927e948dd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.095129 Jul 26 07:46:07.678087 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 929/1901] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:07 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:07.776998 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8662e0e3-65e6-4305-b82e-a64f3470e428 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:07.785129 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8662e0e3-65e6-4305-b82e-a64f3470e428 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.156561 Jul 26 07:46:07.785684 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 973/1902] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:07 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:07.984395 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-200262c1-0de2-4785-81ff-fa9a0506610e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:07.985257 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-200262c1-0de2-4785-81ff-fa9a0506610e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:07.993487 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-200262c1-0de2-4785-81ff-fa9a0506610e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:07.993963 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-200262c1-0de2-4785-81ff-fa9a0506610e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:07.994728 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-200262c1-0de2-4785-81ff-fa9a0506610e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:07.995152 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-200262c1-0de2-4785-81ff-fa9a0506610e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:08.131233 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-200262c1-0de2-4785-81ff-fa9a0506610e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:08.140400 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-200262c1-0de2-4785-81ff-fa9a0506610e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.160935 Jul 26 07:46:08.141009 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 930/1903] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:07 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:08.701367 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b1b46b88-4d0e-4224-b8ad-61322be3a26c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:08.702230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b1b46b88-4d0e-4224-b8ad-61322be3a26c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:08.709864 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b1b46b88-4d0e-4224-b8ad-61322be3a26c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:08.710303 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b1b46b88-4d0e-4224-b8ad-61322be3a26c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:08.711040 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b1b46b88-4d0e-4224-b8ad-61322be3a26c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:08.711497 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b1b46b88-4d0e-4224-b8ad-61322be3a26c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:08.775616 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-b1b46b88-4d0e-4224-b8ad-61322be3a26c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:08.784549 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-b1b46b88-4d0e-4224-b8ad-61322be3a26c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:08.786106 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-b1b46b88-4d0e-4224-b8ad-61322be3a26c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:08.787305 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b1b46b88-4d0e-4224-b8ad-61322be3a26c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.090068 Jul 26 07:46:08.787867 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 974/1904] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:08 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:08.807468 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9a812905-0d4d-4aed-a2b5-e01ca2ebc613 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:08.808070 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-9a812905-0d4d-4aed-a2b5-e01ca2ebc613 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:08.814953 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9a812905-0d4d-4aed-a2b5-e01ca2ebc613 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:08.815401 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9a812905-0d4d-4aed-a2b5-e01ca2ebc613 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:08.816331 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9a812905-0d4d-4aed-a2b5-e01ca2ebc613 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:08.816867 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9a812905-0d4d-4aed-a2b5-e01ca2ebc613 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:08.947949 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-9a812905-0d4d-4aed-a2b5-e01ca2ebc613 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:08.956836 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-9a812905-0d4d-4aed-a2b5-e01ca2ebc613 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.153847 Jul 26 07:46:08.957305 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 931/1905] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:08 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:09.162785 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-2fbcfddf-5a33-44a5-868c-6e4f7333c26f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:09.163413 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2fbcfddf-5a33-44a5-868c-6e4f7333c26f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:09.170059 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2fbcfddf-5a33-44a5-868c-6e4f7333c26f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:09.170501 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2fbcfddf-5a33-44a5-868c-6e4f7333c26f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:09.171264 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2fbcfddf-5a33-44a5-868c-6e4f7333c26f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:09.171680 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2fbcfddf-5a33-44a5-868c-6e4f7333c26f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:09.306961 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2fbcfddf-5a33-44a5-868c-6e4f7333c26f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:09.315608 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-2fbcfddf-5a33-44a5-868c-6e4f7333c26f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.156795 Jul 26 07:46:09.316185 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 975/1906] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:09 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:09.811310 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-488714ee-37b3-46d0-9487-61c385cf5159 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:09.811901 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-488714ee-37b3-46d0-9487-61c385cf5159 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:09.819195 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-488714ee-37b3-46d0-9487-61c385cf5159 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:09.819651 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-488714ee-37b3-46d0-9487-61c385cf5159 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:09.820494 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-488714ee-37b3-46d0-9487-61c385cf5159 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:09.820936 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-488714ee-37b3-46d0-9487-61c385cf5159 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:09.884484 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-488714ee-37b3-46d0-9487-61c385cf5159 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:09.893424 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-488714ee-37b3-46d0-9487-61c385cf5159 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:09.894994 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-488714ee-37b3-46d0-9487-61c385cf5159 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:09.896168 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-488714ee-37b3-46d0-9487-61c385cf5159 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.088904 Jul 26 07:46:09.896729 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 932/1907] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:09 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:09.978725 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-0e1f9bc0-ac07-4eeb-ace5-5feaa058ac8b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:09.979308 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-0e1f9bc0-ac07-4eeb-ace5-5feaa058ac8b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:09.986380 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0e1f9bc0-ac07-4eeb-ace5-5feaa058ac8b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:09.986825 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0e1f9bc0-ac07-4eeb-ace5-5feaa058ac8b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:09.987577 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0e1f9bc0-ac07-4eeb-ace5-5feaa058ac8b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:09.988067 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0e1f9bc0-ac07-4eeb-ace5-5feaa058ac8b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:10.120551 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-0e1f9bc0-ac07-4eeb-ace5-5feaa058ac8b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:10.128611 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-0e1f9bc0-ac07-4eeb-ace5-5feaa058ac8b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.154281 Jul 26 07:46:10.129174 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 976/1908] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:09 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:10.337063 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-883da042-c307-47ad-85ec-b3497d832aef tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:10.337573 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-883da042-c307-47ad-85ec-b3497d832aef tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:10.344153 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-883da042-c307-47ad-85ec-b3497d832aef tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:10.344591 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-883da042-c307-47ad-85ec-b3497d832aef tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:10.345340 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-883da042-c307-47ad-85ec-b3497d832aef tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:10.345793 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-883da042-c307-47ad-85ec-b3497d832aef tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:10.479821 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-883da042-c307-47ad-85ec-b3497d832aef tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:10.488033 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-883da042-c307-47ad-85ec-b3497d832aef tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.155078 Jul 26 07:46:10.488597 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 933/1909] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:10 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:10.919195 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3d7b9541-cdda-4d17-88ef-f4b5ecc2cc36 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:10.919787 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3d7b9541-cdda-4d17-88ef-f4b5ecc2cc36 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:10.926524 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3d7b9541-cdda-4d17-88ef-f4b5ecc2cc36 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:10.926973 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3d7b9541-cdda-4d17-88ef-f4b5ecc2cc36 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:10.927871 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3d7b9541-cdda-4d17-88ef-f4b5ecc2cc36 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:10.928307 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3d7b9541-cdda-4d17-88ef-f4b5ecc2cc36 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:10.990863 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3d7b9541-cdda-4d17-88ef-f4b5ecc2cc36 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:10.999630 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3d7b9541-cdda-4d17-88ef-f4b5ecc2cc36 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:11.001131 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3d7b9541-cdda-4d17-88ef-f4b5ecc2cc36 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:11.002321 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3d7b9541-cdda-4d17-88ef-f4b5ecc2cc36 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.087175 Jul 26 07:46:11.002871 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 977/1910] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:10 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:11.150373 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-acaa29dc-b0aa-4545-886f-b9d777dc94fd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:11.150988 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-acaa29dc-b0aa-4545-886f-b9d777dc94fd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:11.158217 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-acaa29dc-b0aa-4545-886f-b9d777dc94fd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:11.158661 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-acaa29dc-b0aa-4545-886f-b9d777dc94fd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:11.159433 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-acaa29dc-b0aa-4545-886f-b9d777dc94fd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:11.159864 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-acaa29dc-b0aa-4545-886f-b9d777dc94fd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:11.302072 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-acaa29dc-b0aa-4545-886f-b9d777dc94fd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:11.310781 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-acaa29dc-b0aa-4545-886f-b9d777dc94fd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.164606 Jul 26 07:46:11.311383 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 934/1911] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:11 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:11.511837 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-4390d20a-8a8f-43c6-9e66-840f49776ba2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:11.512575 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-4390d20a-8a8f-43c6-9e66-840f49776ba2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:11.520094 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4390d20a-8a8f-43c6-9e66-840f49776ba2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:11.520615 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4390d20a-8a8f-43c6-9e66-840f49776ba2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:11.521551 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4390d20a-8a8f-43c6-9e66-840f49776ba2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:11.522101 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4390d20a-8a8f-43c6-9e66-840f49776ba2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:11.662430 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-4390d20a-8a8f-43c6-9e66-840f49776ba2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:11.670945 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-4390d20a-8a8f-43c6-9e66-840f49776ba2 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.163669 Jul 26 07:46:11.671513 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 978/1912] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:11 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:12.025840 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8810a374-e045-40e2-916d-d129b667d8c9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:12.026452 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8810a374-e045-40e2-916d-d129b667d8c9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:12.033183 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8810a374-e045-40e2-916d-d129b667d8c9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:12.033614 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8810a374-e045-40e2-916d-d129b667d8c9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:12.034437 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8810a374-e045-40e2-916d-d129b667d8c9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:12.034862 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8810a374-e045-40e2-916d-d129b667d8c9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:12.104067 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8810a374-e045-40e2-916d-d129b667d8c9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:12.117185 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8810a374-e045-40e2-916d-d129b667d8c9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:12.119138 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8810a374-e045-40e2-916d-d129b667d8c9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:12.120917 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8810a374-e045-40e2-916d-d129b667d8c9 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.099020 Jul 26 07:46:12.121782 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 935/1913] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:12 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:12.336849 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-563747b7-7de0-4ee0-ab9f-72ac6708f242 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:12.343068 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-563747b7-7de0-4ee0-ab9f-72ac6708f242 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:12.353366 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-563747b7-7de0-4ee0-ab9f-72ac6708f242 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:12.353849 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-563747b7-7de0-4ee0-ab9f-72ac6708f242 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:12.354630 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-563747b7-7de0-4ee0-ab9f-72ac6708f242 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:12.355067 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-563747b7-7de0-4ee0-ab9f-72ac6708f242 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:12.486105 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-563747b7-7de0-4ee0-ab9f-72ac6708f242 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:12.494412 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-563747b7-7de0-4ee0-ab9f-72ac6708f242 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.163851 Jul 26 07:46:12.494957 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 979/1914] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:12 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:12.696161 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-072d054b-7d6e-4259-b213-d27e01249e78 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:12.696739 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-072d054b-7d6e-4259-b213-d27e01249e78 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:12.705794 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-072d054b-7d6e-4259-b213-d27e01249e78 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:12.705915 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-072d054b-7d6e-4259-b213-d27e01249e78 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:12.707107 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-072d054b-7d6e-4259-b213-d27e01249e78 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:12.707259 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-072d054b-7d6e-4259-b213-d27e01249e78 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:12.711946 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:46:12.842473 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-072d054b-7d6e-4259-b213-d27e01249e78 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:12.851826 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-072d054b-7d6e-4259-b213-d27e01249e78 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.161846 Jul 26 07:46:12.852389 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 936/1915] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:12 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:13.144769 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-5008b5ec-10ff-4070-9ce5-742fb01a2da4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:13.145367 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-5008b5ec-10ff-4070-9ce5-742fb01a2da4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:13.151921 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5008b5ec-10ff-4070-9ce5-742fb01a2da4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:13.152371 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5008b5ec-10ff-4070-9ce5-742fb01a2da4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:13.153132 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5008b5ec-10ff-4070-9ce5-742fb01a2da4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:13.153565 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5008b5ec-10ff-4070-9ce5-742fb01a2da4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:13.229189 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-5008b5ec-10ff-4070-9ce5-742fb01a2da4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:13.237777 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-5008b5ec-10ff-4070-9ce5-742fb01a2da4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:13.239304 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-5008b5ec-10ff-4070-9ce5-742fb01a2da4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:13.240625 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-5008b5ec-10ff-4070-9ce5-742fb01a2da4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.099941 Jul 26 07:46:13.241323 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 980/1916] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:13 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:13.516595 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ee9ca514-bb58-40db-9f74-8df0d79a1d5c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:13.517200 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ee9ca514-bb58-40db-9f74-8df0d79a1d5c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:13.523883 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ee9ca514-bb58-40db-9f74-8df0d79a1d5c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:13.524343 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ee9ca514-bb58-40db-9f74-8df0d79a1d5c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:13.525110 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ee9ca514-bb58-40db-9f74-8df0d79a1d5c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:13.525546 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ee9ca514-bb58-40db-9f74-8df0d79a1d5c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:13.742385 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ee9ca514-bb58-40db-9f74-8df0d79a1d5c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:13.750582 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ee9ca514-bb58-40db-9f74-8df0d79a1d5c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.237918 Jul 26 07:46:13.751143 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 937/1917] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:13 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:13.872875 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-cbf257f6-d9f4-462a-9c2a-344e8bb6e2c1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:13.873488 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-cbf257f6-d9f4-462a-9c2a-344e8bb6e2c1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:13.881169 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cbf257f6-d9f4-462a-9c2a-344e8bb6e2c1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:13.881622 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cbf257f6-d9f4-462a-9c2a-344e8bb6e2c1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:13.882423 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cbf257f6-d9f4-462a-9c2a-344e8bb6e2c1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:13.882865 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cbf257f6-d9f4-462a-9c2a-344e8bb6e2c1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:14.020279 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-cbf257f6-d9f4-462a-9c2a-344e8bb6e2c1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:14.029372 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-cbf257f6-d9f4-462a-9c2a-344e8bb6e2c1 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.160418 Jul 26 07:46:14.029984 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 981/1918] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:13 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:14.266733 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-80e3db17-718b-4f2a-be90-630b5ee6bc02 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:14.267315 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-80e3db17-718b-4f2a-be90-630b5ee6bc02 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:14.274283 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-80e3db17-718b-4f2a-be90-630b5ee6bc02 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:14.274732 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-80e3db17-718b-4f2a-be90-630b5ee6bc02 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:14.275507 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-80e3db17-718b-4f2a-be90-630b5ee6bc02 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:14.275939 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-80e3db17-718b-4f2a-be90-630b5ee6bc02 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:14.340656 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-80e3db17-718b-4f2a-be90-630b5ee6bc02 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:14.349872 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-80e3db17-718b-4f2a-be90-630b5ee6bc02 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:14.351365 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-80e3db17-718b-4f2a-be90-630b5ee6bc02 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:14.352534 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-80e3db17-718b-4f2a-be90-630b5ee6bc02 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.089884 Jul 26 07:46:14.353112 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 938/1919] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:14 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:14.772139 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-50f5f0db-66e5-49a8-9d5a-290ad4ac9e9d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:14.772805 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-50f5f0db-66e5-49a8-9d5a-290ad4ac9e9d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:14.779472 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-50f5f0db-66e5-49a8-9d5a-290ad4ac9e9d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:14.779912 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-50f5f0db-66e5-49a8-9d5a-290ad4ac9e9d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:14.780684 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-50f5f0db-66e5-49a8-9d5a-290ad4ac9e9d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:14.781111 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-50f5f0db-66e5-49a8-9d5a-290ad4ac9e9d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:14.923115 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-50f5f0db-66e5-49a8-9d5a-290ad4ac9e9d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:14.932155 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-50f5f0db-66e5-49a8-9d5a-290ad4ac9e9d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.163954 Jul 26 07:46:14.932879 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 982/1920] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:14 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:46:15.051228 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7e4a3d64-9925-4ebc-b2e6-f0b3092b0b28 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:15.051836 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7e4a3d64-9925-4ebc-b2e6-f0b3092b0b28 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:15.058892 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7e4a3d64-9925-4ebc-b2e6-f0b3092b0b28 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:15.059343 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7e4a3d64-9925-4ebc-b2e6-f0b3092b0b28 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:15.060105 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7e4a3d64-9925-4ebc-b2e6-f0b3092b0b28 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:15.060521 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7e4a3d64-9925-4ebc-b2e6-f0b3092b0b28 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:15.206251 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7e4a3d64-9925-4ebc-b2e6-f0b3092b0b28 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:15.214989 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7e4a3d64-9925-4ebc-b2e6-f0b3092b0b28 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.167843 Jul 26 07:46:15.215573 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 939/1921] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:15 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:15.378291 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-964c1a91-b4ee-4f52-b319-65ef66a04c2d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:15.379179 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-964c1a91-b4ee-4f52-b319-65ef66a04c2d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:15.386331 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-964c1a91-b4ee-4f52-b319-65ef66a04c2d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:15.386766 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-964c1a91-b4ee-4f52-b319-65ef66a04c2d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:15.387507 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-964c1a91-b4ee-4f52-b319-65ef66a04c2d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:15.387961 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-964c1a91-b4ee-4f52-b319-65ef66a04c2d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:15.457632 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-964c1a91-b4ee-4f52-b319-65ef66a04c2d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:15.466938 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-964c1a91-b4ee-4f52-b319-65ef66a04c2d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:15.468445 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-964c1a91-b4ee-4f52-b319-65ef66a04c2d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:15.469606 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-964c1a91-b4ee-4f52-b319-65ef66a04c2d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.097550 Jul 26 07:46:15.470194 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 983/1922] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:15 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:15.953991 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-3fba07d3-6ff8-4034-8cfd-8b08233df6d4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:15.954621 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-3fba07d3-6ff8-4034-8cfd-8b08233df6d4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:15.961135 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3fba07d3-6ff8-4034-8cfd-8b08233df6d4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:15.961617 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3fba07d3-6ff8-4034-8cfd-8b08233df6d4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:15.962365 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3fba07d3-6ff8-4034-8cfd-8b08233df6d4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:15.962790 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3fba07d3-6ff8-4034-8cfd-8b08233df6d4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:16.098429 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-3fba07d3-6ff8-4034-8cfd-8b08233df6d4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:16.107358 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-3fba07d3-6ff8-4034-8cfd-8b08233df6d4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.157666 Jul 26 07:46:16.107972 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 940/1923] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:15 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:16.241563 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7876d44d-c0f1-450a-8c29-9e9ad945cbde tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:16.242199 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7876d44d-c0f1-450a-8c29-9e9ad945cbde tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:16.249249 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7876d44d-c0f1-450a-8c29-9e9ad945cbde tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:16.249686 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7876d44d-c0f1-450a-8c29-9e9ad945cbde tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:16.250480 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7876d44d-c0f1-450a-8c29-9e9ad945cbde tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:16.250894 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7876d44d-c0f1-450a-8c29-9e9ad945cbde tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:16.388553 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7876d44d-c0f1-450a-8c29-9e9ad945cbde tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:16.399446 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7876d44d-c0f1-450a-8c29-9e9ad945cbde tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.163788 Jul 26 07:46:16.400031 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 984/1924] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:16 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:16.493160 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ffb9152a-c4ff-4b95-9442-dbe901ff1c0e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:16.493672 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ffb9152a-c4ff-4b95-9442-dbe901ff1c0e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:16.500116 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ffb9152a-c4ff-4b95-9442-dbe901ff1c0e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:16.500561 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ffb9152a-c4ff-4b95-9442-dbe901ff1c0e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:16.501296 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ffb9152a-c4ff-4b95-9442-dbe901ff1c0e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:16.501696 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ffb9152a-c4ff-4b95-9442-dbe901ff1c0e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:16.574648 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ffb9152a-c4ff-4b95-9442-dbe901ff1c0e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:16.588351 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ffb9152a-c4ff-4b95-9442-dbe901ff1c0e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:16.590245 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ffb9152a-c4ff-4b95-9442-dbe901ff1c0e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:16.591400 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ffb9152a-c4ff-4b95-9442-dbe901ff1c0e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.102524 Jul 26 07:46:16.591955 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 941/1925] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:16 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:17.135062 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-833028b9-1288-468f-9e26-c5517222a750 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:17.136193 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-833028b9-1288-468f-9e26-c5517222a750 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:17.147127 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-833028b9-1288-468f-9e26-c5517222a750 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:17.148014 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-833028b9-1288-468f-9e26-c5517222a750 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:17.154873 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-833028b9-1288-468f-9e26-c5517222a750 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:17.154873 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-833028b9-1288-468f-9e26-c5517222a750 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:17.154873 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:46:17.302288 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-833028b9-1288-468f-9e26-c5517222a750 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:17.311116 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-833028b9-1288-468f-9e26-c5517222a750 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.182882 Jul 26 07:46:17.311696 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 985/1926] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:17 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:17.424918 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-563dc3a4-f70b-4fa6-b510-f4de1ac2d209 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:17.425692 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-563dc3a4-f70b-4fa6-b510-f4de1ac2d209 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:17.436685 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-563dc3a4-f70b-4fa6-b510-f4de1ac2d209 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:17.437384 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-563dc3a4-f70b-4fa6-b510-f4de1ac2d209 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:17.438657 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-563dc3a4-f70b-4fa6-b510-f4de1ac2d209 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:17.439294 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-563dc3a4-f70b-4fa6-b510-f4de1ac2d209 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:17.579250 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-563dc3a4-f70b-4fa6-b510-f4de1ac2d209 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:17.587635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-563dc3a4-f70b-4fa6-b510-f4de1ac2d209 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.169275 Jul 26 07:46:17.588213 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 942/1927] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:17 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:17.618266 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-282b880f-0ea9-452c-9865-0b9d533ab97d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:17.618862 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-282b880f-0ea9-452c-9865-0b9d533ab97d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:17.625213 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-282b880f-0ea9-452c-9865-0b9d533ab97d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:17.625658 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-282b880f-0ea9-452c-9865-0b9d533ab97d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:17.626433 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-282b880f-0ea9-452c-9865-0b9d533ab97d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:17.626856 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-282b880f-0ea9-452c-9865-0b9d533ab97d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:17.694855 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-282b880f-0ea9-452c-9865-0b9d533ab97d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:17.707039 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-282b880f-0ea9-452c-9865-0b9d533ab97d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:17.709187 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-282b880f-0ea9-452c-9865-0b9d533ab97d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:17.710362 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-282b880f-0ea9-452c-9865-0b9d533ab97d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.096091 Jul 26 07:46:17.710923 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 986/1928] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:17 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:18.335540 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-99f3ee55-333d-44bd-8cd4-ffebfe36bdb3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:18.336549 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-99f3ee55-333d-44bd-8cd4-ffebfe36bdb3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:18.347244 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-99f3ee55-333d-44bd-8cd4-ffebfe36bdb3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:18.347912 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-99f3ee55-333d-44bd-8cd4-ffebfe36bdb3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:18.349218 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-99f3ee55-333d-44bd-8cd4-ffebfe36bdb3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:18.349868 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-99f3ee55-333d-44bd-8cd4-ffebfe36bdb3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:18.485542 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-99f3ee55-333d-44bd-8cd4-ffebfe36bdb3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:18.494041 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-99f3ee55-333d-44bd-8cd4-ffebfe36bdb3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.164233 Jul 26 07:46:18.494612 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 943/1929] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:18 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:18.608892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-24dc9461-088d-486e-a5af-e36018335011 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:18.609534 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-24dc9461-088d-486e-a5af-e36018335011 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:18.616339 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-24dc9461-088d-486e-a5af-e36018335011 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:18.616780 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-24dc9461-088d-486e-a5af-e36018335011 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:18.617529 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-24dc9461-088d-486e-a5af-e36018335011 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:18.617987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-24dc9461-088d-486e-a5af-e36018335011 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:18.737511 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c371ac24-2cd8-4a3a-92cf-29908be47031 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:18.738153 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c371ac24-2cd8-4a3a-92cf-29908be47031 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:18.744869 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c371ac24-2cd8-4a3a-92cf-29908be47031 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:18.745309 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c371ac24-2cd8-4a3a-92cf-29908be47031 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:18.746103 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c371ac24-2cd8-4a3a-92cf-29908be47031 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:18.746530 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c371ac24-2cd8-4a3a-92cf-29908be47031 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:18.750723 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-24dc9461-088d-486e-a5af-e36018335011 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:18.758798 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-24dc9461-088d-486e-a5af-e36018335011 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.153821 Jul 26 07:46:18.759428 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 987/1930] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:18 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:18.811785 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-c371ac24-2cd8-4a3a-92cf-29908be47031 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:18.820496 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-c371ac24-2cd8-4a3a-92cf-29908be47031 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:18.822077 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-c371ac24-2cd8-4a3a-92cf-29908be47031 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:18.823239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c371ac24-2cd8-4a3a-92cf-29908be47031 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.089852 Jul 26 07:46:18.823800 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 944/1931] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:18 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:19.514910 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e564decc-741f-45dc-bcb0-8ad9ef4d8996 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:19.515517 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e564decc-741f-45dc-bcb0-8ad9ef4d8996 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:19.522253 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e564decc-741f-45dc-bcb0-8ad9ef4d8996 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:19.522698 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e564decc-741f-45dc-bcb0-8ad9ef4d8996 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:19.523452 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e564decc-741f-45dc-bcb0-8ad9ef4d8996 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:19.523873 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e564decc-741f-45dc-bcb0-8ad9ef4d8996 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:19.658355 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-e564decc-741f-45dc-bcb0-8ad9ef4d8996 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:19.667845 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e564decc-741f-45dc-bcb0-8ad9ef4d8996 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.156894 Jul 26 07:46:19.668410 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 988/1932] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:19 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:19.781546 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-e99b22c0-b7f1-479e-ac27-56620a09d918 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:19.782314 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-e99b22c0-b7f1-479e-ac27-56620a09d918 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:19.790586 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e99b22c0-b7f1-479e-ac27-56620a09d918 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:19.791040 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e99b22c0-b7f1-479e-ac27-56620a09d918 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:19.791816 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e99b22c0-b7f1-479e-ac27-56620a09d918 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:19.792231 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e99b22c0-b7f1-479e-ac27-56620a09d918 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:19.847703 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ec891142-5fe3-476d-a579-81163a50e571 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:19.848342 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ec891142-5fe3-476d-a579-81163a50e571 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:19.854787 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ec891142-5fe3-476d-a579-81163a50e571 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:19.855241 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ec891142-5fe3-476d-a579-81163a50e571 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:19.855999 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ec891142-5fe3-476d-a579-81163a50e571 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:19.856429 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ec891142-5fe3-476d-a579-81163a50e571 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:19.921264 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ec891142-5fe3-476d-a579-81163a50e571 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:19.929995 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ec891142-5fe3-476d-a579-81163a50e571 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:19.931459 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ec891142-5fe3-476d-a579-81163a50e571 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:19.932608 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ec891142-5fe3-476d-a579-81163a50e571 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.088877 Jul 26 07:46:19.933176 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 989/1933] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:19 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:19.934619 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-e99b22c0-b7f1-479e-ac27-56620a09d918 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:19.942869 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-e99b22c0-b7f1-479e-ac27-56620a09d918 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.165301 Jul 26 07:46:19.943707 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 945/1934] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:19 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:20.689525 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-28a54ca5-3289-4efd-b265-414a73b01da0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:20.690225 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-28a54ca5-3289-4efd-b265-414a73b01da0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:20.697490 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-28a54ca5-3289-4efd-b265-414a73b01da0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:20.697893 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-28a54ca5-3289-4efd-b265-414a73b01da0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:20.698671 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-28a54ca5-3289-4efd-b265-414a73b01da0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:20.699106 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-28a54ca5-3289-4efd-b265-414a73b01da0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:20.841507 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-28a54ca5-3289-4efd-b265-414a73b01da0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:20.854123 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-28a54ca5-3289-4efd-b265-414a73b01da0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.168297 Jul 26 07:46:20.855002 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 990/1935] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:20 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:20.955222 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a1790dc2-6d98-46d1-a913-351b91f0bed2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:20.955863 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a1790dc2-6d98-46d1-a913-351b91f0bed2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:20.964618 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a1790dc2-6d98-46d1-a913-351b91f0bed2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:20.965099 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a1790dc2-6d98-46d1-a913-351b91f0bed2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:20.966286 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a1790dc2-6d98-46d1-a913-351b91f0bed2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:20.966898 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a1790dc2-6d98-46d1-a913-351b91f0bed2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:20.971894 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9679d7bb-e884-4bbd-ba14-d04e16297ebe tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:20.972531 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-9679d7bb-e884-4bbd-ba14-d04e16297ebe tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:20.979138 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9679d7bb-e884-4bbd-ba14-d04e16297ebe tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:20.979584 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9679d7bb-e884-4bbd-ba14-d04e16297ebe tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:20.980362 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9679d7bb-e884-4bbd-ba14-d04e16297ebe tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:20.980792 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9679d7bb-e884-4bbd-ba14-d04e16297ebe tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:21.034245 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a1790dc2-6d98-46d1-a913-351b91f0bed2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:21.043255 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a1790dc2-6d98-46d1-a913-351b91f0bed2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:21.044725 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a1790dc2-6d98-46d1-a913-351b91f0bed2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:21.045927 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a1790dc2-6d98-46d1-a913-351b91f0bed2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.095182 Jul 26 07:46:21.046521 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 946/1936] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:20 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:21.116463 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-9679d7bb-e884-4bbd-ba14-d04e16297ebe tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:21.125035 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-9679d7bb-e884-4bbd-ba14-d04e16297ebe tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.163113 Jul 26 07:46:21.125610 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 991/1937] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:20 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:21.881774 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-82ab1864-7e96-4e54-a786-baea4458a5dd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:21.882385 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-82ab1864-7e96-4e54-a786-baea4458a5dd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:21.888859 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-82ab1864-7e96-4e54-a786-baea4458a5dd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:21.889309 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-82ab1864-7e96-4e54-a786-baea4458a5dd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:21.890110 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-82ab1864-7e96-4e54-a786-baea4458a5dd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:21.890577 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-82ab1864-7e96-4e54-a786-baea4458a5dd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:22.037163 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-82ab1864-7e96-4e54-a786-baea4458a5dd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:22.045348 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-82ab1864-7e96-4e54-a786-baea4458a5dd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.169029 Jul 26 07:46:22.045986 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 947/1938] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:21 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:22.069100 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-dbc088a3-8842-43ac-91b3-12fbf0ad31b6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:22.069717 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-dbc088a3-8842-43ac-91b3-12fbf0ad31b6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:22.076870 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dbc088a3-8842-43ac-91b3-12fbf0ad31b6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:22.077325 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dbc088a3-8842-43ac-91b3-12fbf0ad31b6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:22.078467 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dbc088a3-8842-43ac-91b3-12fbf0ad31b6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:22.078896 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dbc088a3-8842-43ac-91b3-12fbf0ad31b6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:22.145536 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-dbc088a3-8842-43ac-91b3-12fbf0ad31b6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:22.146903 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-145aa099-2044-40e7-94ff-d793bffb3770 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:22.147548 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-145aa099-2044-40e7-94ff-d793bffb3770 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:22.153949 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-145aa099-2044-40e7-94ff-d793bffb3770 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:22.154430 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-145aa099-2044-40e7-94ff-d793bffb3770 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:22.154619 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-dbc088a3-8842-43ac-91b3-12fbf0ad31b6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:22.155194 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-145aa099-2044-40e7-94ff-d793bffb3770 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:22.155630 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-145aa099-2044-40e7-94ff-d793bffb3770 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:22.156134 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-dbc088a3-8842-43ac-91b3-12fbf0ad31b6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:22.157274 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-dbc088a3-8842-43ac-91b3-12fbf0ad31b6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.092461 Jul 26 07:46:22.158013 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 992/1939] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:22 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:22.295443 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-145aa099-2044-40e7-94ff-d793bffb3770 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:22.305598 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-145aa099-2044-40e7-94ff-d793bffb3770 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.162550 Jul 26 07:46:22.306180 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 948/1940] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:22 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:23.066918 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-10e801f7-242d-4ff0-83cc-8f6d0237baed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:23.067520 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-10e801f7-242d-4ff0-83cc-8f6d0237baed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:23.074340 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-10e801f7-242d-4ff0-83cc-8f6d0237baed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:23.074969 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-10e801f7-242d-4ff0-83cc-8f6d0237baed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:23.075520 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-10e801f7-242d-4ff0-83cc-8f6d0237baed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:23.075944 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-10e801f7-242d-4ff0-83cc-8f6d0237baed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:23.180619 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a5629b3d-2dd2-42df-a61f-b1256339a6f7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:23.181347 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a5629b3d-2dd2-42df-a61f-b1256339a6f7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:23.188326 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a5629b3d-2dd2-42df-a61f-b1256339a6f7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:23.188752 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a5629b3d-2dd2-42df-a61f-b1256339a6f7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:23.189547 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a5629b3d-2dd2-42df-a61f-b1256339a6f7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:23.190018 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a5629b3d-2dd2-42df-a61f-b1256339a6f7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:23.208511 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-10e801f7-242d-4ff0-83cc-8f6d0237baed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:23.216849 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-10e801f7-242d-4ff0-83cc-8f6d0237baed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.153912 Jul 26 07:46:23.217453 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 993/1941] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:23 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:23.253176 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a5629b3d-2dd2-42df-a61f-b1256339a6f7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:23.262151 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a5629b3d-2dd2-42df-a61f-b1256339a6f7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:23.263638 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a5629b3d-2dd2-42df-a61f-b1256339a6f7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:23.264798 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a5629b3d-2dd2-42df-a61f-b1256339a6f7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.088424 Jul 26 07:46:23.265356 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 949/1942] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:23 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:23.328015 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-eace7991-2064-4363-a61c-efbd09f4b3e4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:23.328536 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-eace7991-2064-4363-a61c-efbd09f4b3e4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:23.335057 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-eace7991-2064-4363-a61c-efbd09f4b3e4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:23.335523 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-eace7991-2064-4363-a61c-efbd09f4b3e4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:23.336277 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-eace7991-2064-4363-a61c-efbd09f4b3e4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:23.336712 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-eace7991-2064-4363-a61c-efbd09f4b3e4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:23.467512 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-eace7991-2064-4363-a61c-efbd09f4b3e4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:23.476077 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-eace7991-2064-4363-a61c-efbd09f4b3e4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.152471 Jul 26 07:46:23.476660 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 994/1943] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:23 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:24.238645 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8536e7cb-242a-4e76-b0ab-3f09f04dcd58 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:24.239246 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8536e7cb-242a-4e76-b0ab-3f09f04dcd58 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:24.246093 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8536e7cb-242a-4e76-b0ab-3f09f04dcd58 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:24.246613 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8536e7cb-242a-4e76-b0ab-3f09f04dcd58 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:24.247416 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8536e7cb-242a-4e76-b0ab-3f09f04dcd58 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:24.247851 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8536e7cb-242a-4e76-b0ab-3f09f04dcd58 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:24.288053 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-0646e3d5-6e04-4361-a4c6-8ae0955609a1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:24.288651 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-0646e3d5-6e04-4361-a4c6-8ae0955609a1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:24.298440 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0646e3d5-6e04-4361-a4c6-8ae0955609a1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:24.299115 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0646e3d5-6e04-4361-a4c6-8ae0955609a1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:24.300128 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0646e3d5-6e04-4361-a4c6-8ae0955609a1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:24.300824 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0646e3d5-6e04-4361-a4c6-8ae0955609a1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:24.367659 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-0646e3d5-6e04-4361-a4c6-8ae0955609a1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:24.378319 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-0646e3d5-6e04-4361-a4c6-8ae0955609a1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:24.379801 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-0646e3d5-6e04-4361-a4c6-8ae0955609a1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:24.381184 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-0646e3d5-6e04-4361-a4c6-8ae0955609a1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.097142 Jul 26 07:46:24.381721 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 995/1944] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:24 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:24.400371 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8536e7cb-242a-4e76-b0ab-3f09f04dcd58 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:24.408478 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8536e7cb-242a-4e76-b0ab-3f09f04dcd58 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.174475 Jul 26 07:46:24.409054 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 950/1945] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:24 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:24.497729 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-efa37a7c-0aed-4d5c-9bdf-77456d9992f3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:24.498356 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-efa37a7c-0aed-4d5c-9bdf-77456d9992f3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:24.505063 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-efa37a7c-0aed-4d5c-9bdf-77456d9992f3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:24.505513 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-efa37a7c-0aed-4d5c-9bdf-77456d9992f3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:24.506326 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-efa37a7c-0aed-4d5c-9bdf-77456d9992f3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:24.506758 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-efa37a7c-0aed-4d5c-9bdf-77456d9992f3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:24.646550 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-efa37a7c-0aed-4d5c-9bdf-77456d9992f3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:24.655109 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-efa37a7c-0aed-4d5c-9bdf-77456d9992f3 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.161468 Jul 26 07:46:24.655688 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 996/1946] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:24 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:25.404972 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-787bf9a6-c1d3-4507-8df1-532009c43883 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:25.405556 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-787bf9a6-c1d3-4507-8df1-532009c43883 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:25.412796 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-787bf9a6-c1d3-4507-8df1-532009c43883 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:25.413238 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-787bf9a6-c1d3-4507-8df1-532009c43883 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:25.414042 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-787bf9a6-c1d3-4507-8df1-532009c43883 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:25.414472 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-787bf9a6-c1d3-4507-8df1-532009c43883 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:25.430374 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3d01bbd4-0469-4422-90b8-3e753bad0d97 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:25.431636 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3d01bbd4-0469-4422-90b8-3e753bad0d97 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:25.438643 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3d01bbd4-0469-4422-90b8-3e753bad0d97 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:25.439087 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3d01bbd4-0469-4422-90b8-3e753bad0d97 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:25.439864 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3d01bbd4-0469-4422-90b8-3e753bad0d97 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:25.440304 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3d01bbd4-0469-4422-90b8-3e753bad0d97 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:25.479164 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-787bf9a6-c1d3-4507-8df1-532009c43883 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:25.487936 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-787bf9a6-c1d3-4507-8df1-532009c43883 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:25.489418 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-787bf9a6-c1d3-4507-8df1-532009c43883 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:25.490731 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-787bf9a6-c1d3-4507-8df1-532009c43883 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.089835 Jul 26 07:46:25.491291 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 951/1947] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:25 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:25.568701 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3d01bbd4-0469-4422-90b8-3e753bad0d97 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:25.576678 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3d01bbd4-0469-4422-90b8-3e753bad0d97 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.150490 Jul 26 07:46:25.577217 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 997/1948] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:25 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:25.676963 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-001ef0e0-725c-4579-bd6b-fff9013d01a7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:25.677569 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-001ef0e0-725c-4579-bd6b-fff9013d01a7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:25.684376 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-001ef0e0-725c-4579-bd6b-fff9013d01a7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:25.684826 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-001ef0e0-725c-4579-bd6b-fff9013d01a7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:25.685579 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-001ef0e0-725c-4579-bd6b-fff9013d01a7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:25.686084 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-001ef0e0-725c-4579-bd6b-fff9013d01a7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:25.817769 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-001ef0e0-725c-4579-bd6b-fff9013d01a7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:25.821287 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:46:25.826116 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-001ef0e0-725c-4579-bd6b-fff9013d01a7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.153126 Jul 26 07:46:25.826685 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 952/1949] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:25 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:26.513056 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-dae6214e-3a13-4811-9689-953daf359df3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:26.513662 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-dae6214e-3a13-4811-9689-953daf359df3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:26.520624 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dae6214e-3a13-4811-9689-953daf359df3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:26.521042 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dae6214e-3a13-4811-9689-953daf359df3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:26.521829 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dae6214e-3a13-4811-9689-953daf359df3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:26.522265 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dae6214e-3a13-4811-9689-953daf359df3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:26.590059 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-dae6214e-3a13-4811-9689-953daf359df3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:26.598526 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c3e822a7-7b00-4ce2-bdf3-250fc25fe224 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:26.599140 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c3e822a7-7b00-4ce2-bdf3-250fc25fe224 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:26.599490 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-dae6214e-3a13-4811-9689-953daf359df3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:26.601107 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-dae6214e-3a13-4811-9689-953daf359df3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:26.601833 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=76 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:46:26.602337 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-dae6214e-3a13-4811-9689-953daf359df3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.093365 Jul 26 07:46:26.602964 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 998/1950] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:26 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:26.607586 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c3e822a7-7b00-4ce2-bdf3-250fc25fe224 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:26.608036 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c3e822a7-7b00-4ce2-bdf3-250fc25fe224 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:26.608810 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c3e822a7-7b00-4ce2-bdf3-250fc25fe224 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:26.609248 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c3e822a7-7b00-4ce2-bdf3-250fc25fe224 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:26.750451 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-c3e822a7-7b00-4ce2-bdf3-250fc25fe224 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:26.762961 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c3e822a7-7b00-4ce2-bdf3-250fc25fe224 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.168542 Jul 26 07:46:26.763757 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 953/1951] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:26 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:46:26.847809 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c1cd6797-ee98-49cd-bfc1-d3e9d4baa78d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:26.848429 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c1cd6797-ee98-49cd-bfc1-d3e9d4baa78d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:26.856171 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c1cd6797-ee98-49cd-bfc1-d3e9d4baa78d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:26.856626 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c1cd6797-ee98-49cd-bfc1-d3e9d4baa78d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:26.857406 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c1cd6797-ee98-49cd-bfc1-d3e9d4baa78d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:26.857877 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c1cd6797-ee98-49cd-bfc1-d3e9d4baa78d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:27.001373 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c1cd6797-ee98-49cd-bfc1-d3e9d4baa78d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:27.009984 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c1cd6797-ee98-49cd-bfc1-d3e9d4baa78d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.166085 Jul 26 07:46:27.010557 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 999/1952] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:26 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:27.628684 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-1ecb7e9a-b987-4414-bf62-16416a68ddc8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:27.629372 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-1ecb7e9a-b987-4414-bf62-16416a68ddc8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:27.639219 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1ecb7e9a-b987-4414-bf62-16416a68ddc8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:27.639815 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1ecb7e9a-b987-4414-bf62-16416a68ddc8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:27.640863 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1ecb7e9a-b987-4414-bf62-16416a68ddc8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:27.641449 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1ecb7e9a-b987-4414-bf62-16416a68ddc8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:27.705718 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-1ecb7e9a-b987-4414-bf62-16416a68ddc8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:27.714699 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-1ecb7e9a-b987-4414-bf62-16416a68ddc8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:27.716166 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-1ecb7e9a-b987-4414-bf62-16416a68ddc8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:27.717328 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-1ecb7e9a-b987-4414-bf62-16416a68ddc8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.094955 Jul 26 07:46:27.717902 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 954/1953] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:27 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:27.788299 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8b391986-bf8d-4008-a42e-a5e824199380 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:27.789139 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8b391986-bf8d-4008-a42e-a5e824199380 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:27.791416 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=80 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:46:27.797365 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8b391986-bf8d-4008-a42e-a5e824199380 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:27.797843 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8b391986-bf8d-4008-a42e-a5e824199380 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:27.798620 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8b391986-bf8d-4008-a42e-a5e824199380 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:27.799047 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8b391986-bf8d-4008-a42e-a5e824199380 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:27.931687 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8b391986-bf8d-4008-a42e-a5e824199380 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:27.944124 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8b391986-bf8d-4008-a42e-a5e824199380 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.159382 Jul 26 07:46:27.944723 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1000/1954] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:27 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:28.037553 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-5b8f5d95-d767-4cb7-bf5d-047b6141784c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:28.038541 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-5b8f5d95-d767-4cb7-bf5d-047b6141784c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:28.045196 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5b8f5d95-d767-4cb7-bf5d-047b6141784c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:28.045635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5b8f5d95-d767-4cb7-bf5d-047b6141784c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:28.046441 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5b8f5d95-d767-4cb7-bf5d-047b6141784c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:28.046865 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5b8f5d95-d767-4cb7-bf5d-047b6141784c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:28.180971 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-5b8f5d95-d767-4cb7-bf5d-047b6141784c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:28.192152 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-5b8f5d95-d767-4cb7-bf5d-047b6141784c tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.160987 Jul 26 07:46:28.192988 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 955/1955] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:28 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:28.740793 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-91e36f53-ebd3-4feb-b56f-813f287b3ff2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:28.742006 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-91e36f53-ebd3-4feb-b56f-813f287b3ff2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:28.748191 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-91e36f53-ebd3-4feb-b56f-813f287b3ff2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:28.748633 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-91e36f53-ebd3-4feb-b56f-813f287b3ff2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:28.749404 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-91e36f53-ebd3-4feb-b56f-813f287b3ff2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:28.749848 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-91e36f53-ebd3-4feb-b56f-813f287b3ff2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:28.818419 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-91e36f53-ebd3-4feb-b56f-813f287b3ff2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:28.822050 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:46:28.832455 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-91e36f53-ebd3-4feb-b56f-813f287b3ff2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:28.833980 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-91e36f53-ebd3-4feb-b56f-813f287b3ff2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:28.835185 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-91e36f53-ebd3-4feb-b56f-813f287b3ff2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.099040 Jul 26 07:46:28.835748 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1001/1956] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:28 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:28.968747 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a27cdb6c-dbba-408e-8ca5-130fd2354e5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:28.969351 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a27cdb6c-dbba-408e-8ca5-130fd2354e5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:28.979549 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a27cdb6c-dbba-408e-8ca5-130fd2354e5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:28.980124 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a27cdb6c-dbba-408e-8ca5-130fd2354e5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:28.981315 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a27cdb6c-dbba-408e-8ca5-130fd2354e5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:28.981996 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a27cdb6c-dbba-408e-8ca5-130fd2354e5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:29.135715 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a27cdb6c-dbba-408e-8ca5-130fd2354e5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:29.147329 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a27cdb6c-dbba-408e-8ca5-130fd2354e5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.184258 Jul 26 07:46:29.147905 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 956/1957] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:28 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:29.214862 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-cded07f4-2653-4847-83ca-96cac3651814 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:29.215474 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-cded07f4-2653-4847-83ca-96cac3651814 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:29.222028 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cded07f4-2653-4847-83ca-96cac3651814 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:29.222475 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cded07f4-2653-4847-83ca-96cac3651814 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:29.223241 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cded07f4-2653-4847-83ca-96cac3651814 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:29.223675 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cded07f4-2653-4847-83ca-96cac3651814 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:29.368983 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-cded07f4-2653-4847-83ca-96cac3651814 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:29.377152 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-cded07f4-2653-4847-83ca-96cac3651814 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.166593 Jul 26 07:46:29.377725 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1002/1958] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:29 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:29.857399 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-594aa531-6a0a-4126-9c42-95f85959e76b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:29.858023 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-594aa531-6a0a-4126-9c42-95f85959e76b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:29.864604 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-594aa531-6a0a-4126-9c42-95f85959e76b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:29.865049 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-594aa531-6a0a-4126-9c42-95f85959e76b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:29.865898 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-594aa531-6a0a-4126-9c42-95f85959e76b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:29.866338 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-594aa531-6a0a-4126-9c42-95f85959e76b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:29.938120 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-594aa531-6a0a-4126-9c42-95f85959e76b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:29.946726 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-594aa531-6a0a-4126-9c42-95f85959e76b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:29.948234 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-594aa531-6a0a-4126-9c42-95f85959e76b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:29.949393 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-594aa531-6a0a-4126-9c42-95f85959e76b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.096044 Jul 26 07:46:29.949973 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 957/1959] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:29 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:30.169007 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-62068561-8547-4329-bbc7-fab296c55ba1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:30.169591 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-62068561-8547-4329-bbc7-fab296c55ba1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:30.176511 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-62068561-8547-4329-bbc7-fab296c55ba1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:30.176957 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-62068561-8547-4329-bbc7-fab296c55ba1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:30.177712 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-62068561-8547-4329-bbc7-fab296c55ba1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:30.178182 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-62068561-8547-4329-bbc7-fab296c55ba1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:30.319784 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-62068561-8547-4329-bbc7-fab296c55ba1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:30.328760 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-62068561-8547-4329-bbc7-fab296c55ba1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.163732 Jul 26 07:46:30.329341 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1003/1960] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:30 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:30.399808 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-98501795-485a-40eb-bc5f-5f23bd046f8b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:30.400386 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-98501795-485a-40eb-bc5f-5f23bd046f8b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:30.407611 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-98501795-485a-40eb-bc5f-5f23bd046f8b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:30.408061 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-98501795-485a-40eb-bc5f-5f23bd046f8b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:30.411633 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-98501795-485a-40eb-bc5f-5f23bd046f8b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:30.412076 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-98501795-485a-40eb-bc5f-5f23bd046f8b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:30.562044 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-98501795-485a-40eb-bc5f-5f23bd046f8b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:30.575293 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-98501795-485a-40eb-bc5f-5f23bd046f8b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.180238 Jul 26 07:46:30.576208 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 958/1961] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:30 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:30.975657 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a22ac87e-e2dd-4e29-b881-74fae6ee995c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:30.976269 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a22ac87e-e2dd-4e29-b881-74fae6ee995c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:30.982758 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a22ac87e-e2dd-4e29-b881-74fae6ee995c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:30.983206 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a22ac87e-e2dd-4e29-b881-74fae6ee995c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:30.984000 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a22ac87e-e2dd-4e29-b881-74fae6ee995c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:30.984402 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a22ac87e-e2dd-4e29-b881-74fae6ee995c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:31.052576 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-a22ac87e-e2dd-4e29-b881-74fae6ee995c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:31.064167 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-a22ac87e-e2dd-4e29-b881-74fae6ee995c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:31.066702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-a22ac87e-e2dd-4e29-b881-74fae6ee995c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:31.068384 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a22ac87e-e2dd-4e29-b881-74fae6ee995c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.098590 Jul 26 07:46:31.071679 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1004/1962] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:30 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:31.358758 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8b8670cf-4d36-4372-ba5b-4b46685984ab tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:31.359775 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8b8670cf-4d36-4372-ba5b-4b46685984ab tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:31.367999 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8b8670cf-4d36-4372-ba5b-4b46685984ab tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:31.368443 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8b8670cf-4d36-4372-ba5b-4b46685984ab tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:31.369197 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8b8670cf-4d36-4372-ba5b-4b46685984ab tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:31.369622 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8b8670cf-4d36-4372-ba5b-4b46685984ab tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:31.507797 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8b8670cf-4d36-4372-ba5b-4b46685984ab tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:31.515991 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8b8670cf-4d36-4372-ba5b-4b46685984ab tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.162507 Jul 26 07:46:31.516528 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 959/1963] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:31 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:31.601236 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-36448470-1247-42c3-bbc6-f15cfb2fb693 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:31.602269 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-36448470-1247-42c3-bbc6-f15cfb2fb693 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:31.609284 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-36448470-1247-42c3-bbc6-f15cfb2fb693 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:31.609759 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-36448470-1247-42c3-bbc6-f15cfb2fb693 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:31.610533 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-36448470-1247-42c3-bbc6-f15cfb2fb693 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:31.610965 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-36448470-1247-42c3-bbc6-f15cfb2fb693 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:31.759450 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-36448470-1247-42c3-bbc6-f15cfb2fb693 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:31.767730 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-36448470-1247-42c3-bbc6-f15cfb2fb693 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.173020 Jul 26 07:46:31.768313 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1005/1964] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:31 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:32.098102 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a602e75a-ef47-41fe-9862-1c338dc327f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:32.098881 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a602e75a-ef47-41fe-9862-1c338dc327f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:32.108309 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a602e75a-ef47-41fe-9862-1c338dc327f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:32.108895 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a602e75a-ef47-41fe-9862-1c338dc327f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:32.110096 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a602e75a-ef47-41fe-9862-1c338dc327f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:32.110778 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a602e75a-ef47-41fe-9862-1c338dc327f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:32.182434 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a602e75a-ef47-41fe-9862-1c338dc327f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:32.191096 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a602e75a-ef47-41fe-9862-1c338dc327f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:32.192578 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a602e75a-ef47-41fe-9862-1c338dc327f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:32.193846 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a602e75a-ef47-41fe-9862-1c338dc327f6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.101390 Jul 26 07:46:32.194413 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 960/1965] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:32 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:32.539652 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ef29dc93-3586-4d8c-960d-b7ee209ffad1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:32.540349 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ef29dc93-3586-4d8c-960d-b7ee209ffad1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:32.547152 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef29dc93-3586-4d8c-960d-b7ee209ffad1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:32.547615 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef29dc93-3586-4d8c-960d-b7ee209ffad1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:32.548383 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef29dc93-3586-4d8c-960d-b7ee209ffad1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:32.548825 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef29dc93-3586-4d8c-960d-b7ee209ffad1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:32.685875 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ef29dc93-3586-4d8c-960d-b7ee209ffad1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:32.694383 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ef29dc93-3586-4d8c-960d-b7ee209ffad1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.160496 Jul 26 07:46:32.694895 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1006/1966] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:32 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:32.788933 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-cfd0df57-58ee-428c-b8fe-59e7c0208107 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:32.790058 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-cfd0df57-58ee-428c-b8fe-59e7c0208107 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:32.796588 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cfd0df57-58ee-428c-b8fe-59e7c0208107 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:32.797034 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cfd0df57-58ee-428c-b8fe-59e7c0208107 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:32.797834 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cfd0df57-58ee-428c-b8fe-59e7c0208107 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:32.798268 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cfd0df57-58ee-428c-b8fe-59e7c0208107 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:32.935330 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-cfd0df57-58ee-428c-b8fe-59e7c0208107 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:32.943602 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-cfd0df57-58ee-428c-b8fe-59e7c0208107 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.158675 Jul 26 07:46:32.944174 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 961/1967] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:32 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:33.222879 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-157ae948-373c-4e16-bbe5-8296590e90e6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:33.223484 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-157ae948-373c-4e16-bbe5-8296590e90e6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:33.230305 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-157ae948-373c-4e16-bbe5-8296590e90e6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:33.230747 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-157ae948-373c-4e16-bbe5-8296590e90e6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:33.231500 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-157ae948-373c-4e16-bbe5-8296590e90e6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:33.231919 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-157ae948-373c-4e16-bbe5-8296590e90e6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:33.298641 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-157ae948-373c-4e16-bbe5-8296590e90e6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:33.307953 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-157ae948-373c-4e16-bbe5-8296590e90e6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:33.309437 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-157ae948-373c-4e16-bbe5-8296590e90e6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:33.310644 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-157ae948-373c-4e16-bbe5-8296590e90e6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.091774 Jul 26 07:46:33.311251 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1007/1968] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:33 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:33.716508 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-aab3796a-2d83-4d8b-856e-810378292cbd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:33.717026 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-aab3796a-2d83-4d8b-856e-810378292cbd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:33.723674 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-aab3796a-2d83-4d8b-856e-810378292cbd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:33.724136 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-aab3796a-2d83-4d8b-856e-810378292cbd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:33.724898 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-aab3796a-2d83-4d8b-856e-810378292cbd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:33.725321 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-aab3796a-2d83-4d8b-856e-810378292cbd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:33.873160 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-aab3796a-2d83-4d8b-856e-810378292cbd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:33.881662 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-aab3796a-2d83-4d8b-856e-810378292cbd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.169320 Jul 26 07:46:33.882266 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 962/1969] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:33 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:33.966951 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-dbf6a649-e2e4-46bd-864a-5b9313d85d9e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:33.967651 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-dbf6a649-e2e4-46bd-864a-5b9313d85d9e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:33.977041 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dbf6a649-e2e4-46bd-864a-5b9313d85d9e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:33.977507 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dbf6a649-e2e4-46bd-864a-5b9313d85d9e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:33.978295 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dbf6a649-e2e4-46bd-864a-5b9313d85d9e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:33.978729 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dbf6a649-e2e4-46bd-864a-5b9313d85d9e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:34.125593 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-dbf6a649-e2e4-46bd-864a-5b9313d85d9e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:34.138933 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-dbf6a649-e2e4-46bd-864a-5b9313d85d9e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.177087 Jul 26 07:46:34.139977 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1008/1970] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:33 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:34.336619 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d7b2f3b4-6207-4347-b563-7f16a137f19c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:34.337264 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d7b2f3b4-6207-4347-b563-7f16a137f19c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:34.343878 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d7b2f3b4-6207-4347-b563-7f16a137f19c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:34.344326 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d7b2f3b4-6207-4347-b563-7f16a137f19c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:34.345083 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d7b2f3b4-6207-4347-b563-7f16a137f19c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:34.345514 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d7b2f3b4-6207-4347-b563-7f16a137f19c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:34.414290 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d7b2f3b4-6207-4347-b563-7f16a137f19c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:34.424312 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d7b2f3b4-6207-4347-b563-7f16a137f19c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:34.425836 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d7b2f3b4-6207-4347-b563-7f16a137f19c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:34.427009 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d7b2f3b4-6207-4347-b563-7f16a137f19c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.096683 Jul 26 07:46:34.427535 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 963/1971] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:34 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:34.905925 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-53cc1a96-26a5-49cb-b214-ddf15652572c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:34.906714 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-53cc1a96-26a5-49cb-b214-ddf15652572c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:34.915636 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-53cc1a96-26a5-49cb-b214-ddf15652572c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:34.916362 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-53cc1a96-26a5-49cb-b214-ddf15652572c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:34.917651 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-53cc1a96-26a5-49cb-b214-ddf15652572c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:34.918336 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-53cc1a96-26a5-49cb-b214-ddf15652572c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:35.057105 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-53cc1a96-26a5-49cb-b214-ddf15652572c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:35.070577 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-53cc1a96-26a5-49cb-b214-ddf15652572c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.169649 Jul 26 07:46:35.071504 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1009/1972] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:34 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:35.166220 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-229a790d-447d-49ba-8a50-8fa3647bfc2a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:35.166927 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-229a790d-447d-49ba-8a50-8fa3647bfc2a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:35.175580 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-229a790d-447d-49ba-8a50-8fa3647bfc2a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:35.176167 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-229a790d-447d-49ba-8a50-8fa3647bfc2a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:35.177153 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-229a790d-447d-49ba-8a50-8fa3647bfc2a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:35.177719 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-229a790d-447d-49ba-8a50-8fa3647bfc2a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:35.325367 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-229a790d-447d-49ba-8a50-8fa3647bfc2a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:35.336305 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-229a790d-447d-49ba-8a50-8fa3647bfc2a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.175259 Jul 26 07:46:35.336949 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 964/1973] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:35 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:35.450668 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a0dcad07-52f4-41c2-a2ba-0c905e008fc4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:35.451288 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a0dcad07-52f4-41c2-a2ba-0c905e008fc4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:35.458448 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a0dcad07-52f4-41c2-a2ba-0c905e008fc4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:35.458896 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a0dcad07-52f4-41c2-a2ba-0c905e008fc4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:35.459669 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a0dcad07-52f4-41c2-a2ba-0c905e008fc4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:35.460107 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a0dcad07-52f4-41c2-a2ba-0c905e008fc4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:35.536200 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-a0dcad07-52f4-41c2-a2ba-0c905e008fc4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:35.545139 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-a0dcad07-52f4-41c2-a2ba-0c905e008fc4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:35.546655 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-a0dcad07-52f4-41c2-a2ba-0c905e008fc4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:35.547792 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a0dcad07-52f4-41c2-a2ba-0c905e008fc4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.101220 Jul 26 07:46:35.548351 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1010/1974] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:35 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:36.099827 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-98dd0a50-0da6-4697-bc4e-bcc359e6e0c7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:36.100599 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-98dd0a50-0da6-4697-bc4e-bcc359e6e0c7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:36.108662 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-98dd0a50-0da6-4697-bc4e-bcc359e6e0c7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:36.109198 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-98dd0a50-0da6-4697-bc4e-bcc359e6e0c7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:36.110197 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-98dd0a50-0da6-4697-bc4e-bcc359e6e0c7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:36.110737 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-98dd0a50-0da6-4697-bc4e-bcc359e6e0c7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:36.247451 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-98dd0a50-0da6-4697-bc4e-bcc359e6e0c7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:36.255921 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-98dd0a50-0da6-4697-bc4e-bcc359e6e0c7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.161013 Jul 26 07:46:36.256493 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 965/1975] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:36 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:36.359593 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-63df49f9-7390-4e72-9e2e-6393fada0aee tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:36.360310 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-63df49f9-7390-4e72-9e2e-6393fada0aee tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:36.369445 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-63df49f9-7390-4e72-9e2e-6393fada0aee tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:36.369933 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-63df49f9-7390-4e72-9e2e-6393fada0aee tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:36.370690 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-63df49f9-7390-4e72-9e2e-6393fada0aee tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:36.371122 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-63df49f9-7390-4e72-9e2e-6393fada0aee tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:36.505259 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-63df49f9-7390-4e72-9e2e-6393fada0aee tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:36.514075 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-63df49f9-7390-4e72-9e2e-6393fada0aee tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.160300 Jul 26 07:46:36.514631 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1011/1976] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:36 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:36.577689 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c9870237-aebd-4f8e-810d-e5688f2243b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:36.578364 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c9870237-aebd-4f8e-810d-e5688f2243b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:36.585209 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c9870237-aebd-4f8e-810d-e5688f2243b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:36.585653 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c9870237-aebd-4f8e-810d-e5688f2243b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:36.586468 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c9870237-aebd-4f8e-810d-e5688f2243b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:36.586899 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c9870237-aebd-4f8e-810d-e5688f2243b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:36.657960 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-c9870237-aebd-4f8e-810d-e5688f2243b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:36.666917 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-c9870237-aebd-4f8e-810d-e5688f2243b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:36.668388 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-c9870237-aebd-4f8e-810d-e5688f2243b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:36.669531 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c9870237-aebd-4f8e-810d-e5688f2243b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.096376 Jul 26 07:46:36.670134 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 966/1977] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:36 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:37.280069 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-1bf54a18-aa5b-4839-985c-e36e904f57a8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:37.280854 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-1bf54a18-aa5b-4839-985c-e36e904f57a8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:37.289844 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1bf54a18-aa5b-4839-985c-e36e904f57a8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:37.290230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1bf54a18-aa5b-4839-985c-e36e904f57a8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:37.290993 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1bf54a18-aa5b-4839-985c-e36e904f57a8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:37.291424 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1bf54a18-aa5b-4839-985c-e36e904f57a8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:37.430811 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-1bf54a18-aa5b-4839-985c-e36e904f57a8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:37.439120 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-1bf54a18-aa5b-4839-985c-e36e904f57a8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.165259 Jul 26 07:46:37.439715 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1012/1978] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:37 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:37.535408 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-eb05e042-b23e-4d42-9c55-bef2ebd1b23e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:37.535974 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-eb05e042-b23e-4d42-9c55-bef2ebd1b23e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:37.543108 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-eb05e042-b23e-4d42-9c55-bef2ebd1b23e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:37.543491 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-eb05e042-b23e-4d42-9c55-bef2ebd1b23e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:37.544247 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-eb05e042-b23e-4d42-9c55-bef2ebd1b23e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:37.544692 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-eb05e042-b23e-4d42-9c55-bef2ebd1b23e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:37.686120 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-eb05e042-b23e-4d42-9c55-bef2ebd1b23e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:37.692292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ce36a5a0-5b31-4a1f-9008-565a8beeee13 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:37.692976 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ce36a5a0-5b31-4a1f-9008-565a8beeee13 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:37.694672 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-eb05e042-b23e-4d42-9c55-bef2ebd1b23e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.163189 Jul 26 07:46:37.695224 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 967/1979] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:37 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:37.699173 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ce36a5a0-5b31-4a1f-9008-565a8beeee13 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:37.699593 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ce36a5a0-5b31-4a1f-9008-565a8beeee13 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:37.700363 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ce36a5a0-5b31-4a1f-9008-565a8beeee13 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:37.700782 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ce36a5a0-5b31-4a1f-9008-565a8beeee13 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:37.767322 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ce36a5a0-5b31-4a1f-9008-565a8beeee13 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:37.776327 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ce36a5a0-5b31-4a1f-9008-565a8beeee13 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:37.777848 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ce36a5a0-5b31-4a1f-9008-565a8beeee13 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:37.778941 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ce36a5a0-5b31-4a1f-9008-565a8beeee13 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.090528 Jul 26 07:46:37.779497 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1013/1980] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:37 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 07:46:38.460986 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-97785741-0359-4faf-bb65-8212d61bada0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:38.461702 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-97785741-0359-4faf-bb65-8212d61bada0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:38.468259 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-97785741-0359-4faf-bb65-8212d61bada0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:38.468709 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-97785741-0359-4faf-bb65-8212d61bada0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:38.469468 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-97785741-0359-4faf-bb65-8212d61bada0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:38.469942 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-97785741-0359-4faf-bb65-8212d61bada0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:38.627176 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-97785741-0359-4faf-bb65-8212d61bada0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:38.635668 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-97785741-0359-4faf-bb65-8212d61bada0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.178680 Jul 26 07:46:38.636225 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 968/1981] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:38 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:38.717027 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-938199b0-a82b-46cc-baf2-09e934796f33 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:38.717843 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-938199b0-a82b-46cc-baf2-09e934796f33 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:38.727537 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-938199b0-a82b-46cc-baf2-09e934796f33 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:38.728104 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-938199b0-a82b-46cc-baf2-09e934796f33 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:38.728897 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-938199b0-a82b-46cc-baf2-09e934796f33 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:38.729327 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-938199b0-a82b-46cc-baf2-09e934796f33 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:38.802931 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-279a7b5a-498e-4a27-9bf9-1d816c45bbe1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:38.803513 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-279a7b5a-498e-4a27-9bf9-1d816c45bbe1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:38.809768 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-279a7b5a-498e-4a27-9bf9-1d816c45bbe1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:38.810232 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-279a7b5a-498e-4a27-9bf9-1d816c45bbe1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:38.810992 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-279a7b5a-498e-4a27-9bf9-1d816c45bbe1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:38.811398 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-279a7b5a-498e-4a27-9bf9-1d816c45bbe1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:38.830916 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:46:38.860973 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-938199b0-a82b-46cc-baf2-09e934796f33 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:38.869054 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-938199b0-a82b-46cc-baf2-09e934796f33 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.156192 Jul 26 07:46:38.869614 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1014/1982] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:38 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:38.876369 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-279a7b5a-498e-4a27-9bf9-1d816c45bbe1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:38.885323 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-279a7b5a-498e-4a27-9bf9-1d816c45bbe1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:38.886882 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-279a7b5a-498e-4a27-9bf9-1d816c45bbe1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:38.888048 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-279a7b5a-498e-4a27-9bf9-1d816c45bbe1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.090557 Jul 26 07:46:38.888596 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 969/1983] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:38 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:39.658202 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-dc4df9f2-edad-49b7-9beb-47f89d09e1b7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:39.659258 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-dc4df9f2-edad-49b7-9beb-47f89d09e1b7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:39.666821 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dc4df9f2-edad-49b7-9beb-47f89d09e1b7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:39.667271 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dc4df9f2-edad-49b7-9beb-47f89d09e1b7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:39.668037 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dc4df9f2-edad-49b7-9beb-47f89d09e1b7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:39.668470 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dc4df9f2-edad-49b7-9beb-47f89d09e1b7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:39.800508 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-dc4df9f2-edad-49b7-9beb-47f89d09e1b7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:39.810845 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-dc4df9f2-edad-49b7-9beb-47f89d09e1b7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.157248 Jul 26 07:46:39.811793 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1015/1984] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:39 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:39.891724 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-4a753456-eb18-4bcd-a347-c78952028594 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:39.892342 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-4a753456-eb18-4bcd-a347-c78952028594 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:39.899618 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4a753456-eb18-4bcd-a347-c78952028594 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:39.900061 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4a753456-eb18-4bcd-a347-c78952028594 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:39.900838 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4a753456-eb18-4bcd-a347-c78952028594 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:39.901281 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4a753456-eb18-4bcd-a347-c78952028594 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:39.910831 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-cf821cd3-9138-4432-a9e8-74d392e4d0c3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:39.911247 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-cf821cd3-9138-4432-a9e8-74d392e4d0c3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:39.919458 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cf821cd3-9138-4432-a9e8-74d392e4d0c3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:39.919899 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cf821cd3-9138-4432-a9e8-74d392e4d0c3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:39.920807 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cf821cd3-9138-4432-a9e8-74d392e4d0c3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:39.921383 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cf821cd3-9138-4432-a9e8-74d392e4d0c3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:39.988125 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-cf821cd3-9138-4432-a9e8-74d392e4d0c3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:39.996808 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-cf821cd3-9138-4432-a9e8-74d392e4d0c3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:39.998407 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-cf821cd3-9138-4432-a9e8-74d392e4d0c3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:39.999484 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-cf821cd3-9138-4432-a9e8-74d392e4d0c3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.092885 Jul 26 07:46:40.000144 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1016/1985] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:39 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:40.039078 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-4a753456-eb18-4bcd-a347-c78952028594 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:40.051087 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-4a753456-eb18-4bcd-a347-c78952028594 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.163242 Jul 26 07:46:40.051893 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 970/1986] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:39 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:40.837663 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c5e67c21-87c2-4ed7-b0c0-a5675d97d988 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:40.838590 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c5e67c21-87c2-4ed7-b0c0-a5675d97d988 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:40.849143 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c5e67c21-87c2-4ed7-b0c0-a5675d97d988 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:40.849810 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c5e67c21-87c2-4ed7-b0c0-a5675d97d988 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:40.851041 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c5e67c21-87c2-4ed7-b0c0-a5675d97d988 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:40.851724 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c5e67c21-87c2-4ed7-b0c0-a5675d97d988 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:40.989803 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c5e67c21-87c2-4ed7-b0c0-a5675d97d988 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:41.000599 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c5e67c21-87c2-4ed7-b0c0-a5675d97d988 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.168893 Jul 26 07:46:41.001173 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1017/1987] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:40 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:41.022412 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-67372ebf-be2f-41d7-b35d-e081651d1e95 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:41.022998 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-67372ebf-be2f-41d7-b35d-e081651d1e95 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:41.030011 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-67372ebf-be2f-41d7-b35d-e081651d1e95 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:41.030461 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-67372ebf-be2f-41d7-b35d-e081651d1e95 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:41.031212 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-67372ebf-be2f-41d7-b35d-e081651d1e95 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:41.031649 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-67372ebf-be2f-41d7-b35d-e081651d1e95 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:41.074641 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d5423966-3955-4faf-b01f-9c802f532176 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:41.075254 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d5423966-3955-4faf-b01f-9c802f532176 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:41.082137 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d5423966-3955-4faf-b01f-9c802f532176 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:41.082622 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d5423966-3955-4faf-b01f-9c802f532176 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:41.083383 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d5423966-3955-4faf-b01f-9c802f532176 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:41.083816 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d5423966-3955-4faf-b01f-9c802f532176 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:41.093873 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-67372ebf-be2f-41d7-b35d-e081651d1e95 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:41.102922 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-67372ebf-be2f-41d7-b35d-e081651d1e95 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:41.103758 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:46:41.104583 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-67372ebf-be2f-41d7-b35d-e081651d1e95 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:41.105696 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-67372ebf-be2f-41d7-b35d-e081651d1e95 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.087250 Jul 26 07:46:41.106394 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 971/1988] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:41 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:41.213147 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d5423966-3955-4faf-b01f-9c802f532176 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:41.221375 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d5423966-3955-4faf-b01f-9c802f532176 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.150940 Jul 26 07:46:41.221973 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1018/1989] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:41 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:42.025081 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-059f753d-c329-442c-b979-31dceaf12f2f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:42.025702 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-059f753d-c329-442c-b979-31dceaf12f2f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:42.032777 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-059f753d-c329-442c-b979-31dceaf12f2f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:42.033220 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-059f753d-c329-442c-b979-31dceaf12f2f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:42.034047 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-059f753d-c329-442c-b979-31dceaf12f2f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:42.034480 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-059f753d-c329-442c-b979-31dceaf12f2f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:42.128776 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c3891745-a6d5-4024-81fb-6d61f247f243 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:42.129367 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c3891745-a6d5-4024-81fb-6d61f247f243 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:42.136398 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c3891745-a6d5-4024-81fb-6d61f247f243 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:42.136867 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c3891745-a6d5-4024-81fb-6d61f247f243 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:42.137640 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c3891745-a6d5-4024-81fb-6d61f247f243 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:42.138161 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c3891745-a6d5-4024-81fb-6d61f247f243 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:42.168892 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-059f753d-c329-442c-b979-31dceaf12f2f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:42.177438 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-059f753d-c329-442c-b979-31dceaf12f2f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.157975 Jul 26 07:46:42.178034 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 972/1990] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:42 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:42.204531 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c3891745-a6d5-4024-81fb-6d61f247f243 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:42.215340 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c3891745-a6d5-4024-81fb-6d61f247f243 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:42.216838 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c3891745-a6d5-4024-81fb-6d61f247f243 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:42.218029 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c3891745-a6d5-4024-81fb-6d61f247f243 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.093207 Jul 26 07:46:42.218594 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1019/1991] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:42 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:42.242983 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-792a65ad-e97e-499a-86af-72401e7b3bf5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:42.243592 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-792a65ad-e97e-499a-86af-72401e7b3bf5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:42.250328 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-792a65ad-e97e-499a-86af-72401e7b3bf5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:42.250796 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-792a65ad-e97e-499a-86af-72401e7b3bf5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:42.251682 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-792a65ad-e97e-499a-86af-72401e7b3bf5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:42.252106 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-792a65ad-e97e-499a-86af-72401e7b3bf5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:42.387747 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-792a65ad-e97e-499a-86af-72401e7b3bf5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:42.396118 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-792a65ad-e97e-499a-86af-72401e7b3bf5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.157175 Jul 26 07:46:42.396681 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 973/1992] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:42 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:43.200352 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f2b764c6-b2ac-4149-a409-7862c58d3acd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:43.200934 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f2b764c6-b2ac-4149-a409-7862c58d3acd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:43.208359 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f2b764c6-b2ac-4149-a409-7862c58d3acd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:43.208800 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f2b764c6-b2ac-4149-a409-7862c58d3acd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:43.209562 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f2b764c6-b2ac-4149-a409-7862c58d3acd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:43.210015 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f2b764c6-b2ac-4149-a409-7862c58d3acd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:43.240696 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7001a0e3-a183-4f66-813d-f167ca55d25f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:43.241287 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7001a0e3-a183-4f66-813d-f167ca55d25f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:43.248042 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7001a0e3-a183-4f66-813d-f167ca55d25f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:43.248513 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7001a0e3-a183-4f66-813d-f167ca55d25f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:43.249419 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7001a0e3-a183-4f66-813d-f167ca55d25f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:43.249861 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7001a0e3-a183-4f66-813d-f167ca55d25f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:43.314091 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7001a0e3-a183-4f66-813d-f167ca55d25f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:43.323089 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7001a0e3-a183-4f66-813d-f167ca55d25f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:43.324579 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7001a0e3-a183-4f66-813d-f167ca55d25f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:43.325772 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7001a0e3-a183-4f66-813d-f167ca55d25f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.088969 Jul 26 07:46:43.326323 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 974/1993] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:43 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:43.346307 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f2b764c6-b2ac-4149-a409-7862c58d3acd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:43.354903 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f2b764c6-b2ac-4149-a409-7862c58d3acd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.158563 Jul 26 07:46:43.355478 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1020/1994] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:43 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:43.418803 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-59bcf803-d342-4ace-b783-fcb0ee1621bc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:43.419439 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-59bcf803-d342-4ace-b783-fcb0ee1621bc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:43.426519 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-59bcf803-d342-4ace-b783-fcb0ee1621bc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:43.426998 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-59bcf803-d342-4ace-b783-fcb0ee1621bc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:43.427822 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-59bcf803-d342-4ace-b783-fcb0ee1621bc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:43.428301 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-59bcf803-d342-4ace-b783-fcb0ee1621bc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:43.569713 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-59bcf803-d342-4ace-b783-fcb0ee1621bc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:43.580253 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-59bcf803-d342-4ace-b783-fcb0ee1621bc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.165629 Jul 26 07:46:43.580931 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 975/1995] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:43 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:44.351499 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8e8a9a68-3f6b-4cb8-97a6-c5a9e7607fb7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:44.352125 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8e8a9a68-3f6b-4cb8-97a6-c5a9e7607fb7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:44.362319 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8e8a9a68-3f6b-4cb8-97a6-c5a9e7607fb7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:44.362875 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8e8a9a68-3f6b-4cb8-97a6-c5a9e7607fb7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:44.363863 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8e8a9a68-3f6b-4cb8-97a6-c5a9e7607fb7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:44.364426 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8e8a9a68-3f6b-4cb8-97a6-c5a9e7607fb7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:44.376335 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0ed9d73a-65e2-4b6c-9bfd-cdb1cf12810e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:44.376934 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0ed9d73a-65e2-4b6c-9bfd-cdb1cf12810e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:44.384438 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0ed9d73a-65e2-4b6c-9bfd-cdb1cf12810e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:44.384915 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0ed9d73a-65e2-4b6c-9bfd-cdb1cf12810e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:44.385708 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0ed9d73a-65e2-4b6c-9bfd-cdb1cf12810e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:44.386176 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0ed9d73a-65e2-4b6c-9bfd-cdb1cf12810e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:44.525477 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0ed9d73a-65e2-4b6c-9bfd-cdb1cf12810e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:44.533911 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0ed9d73a-65e2-4b6c-9bfd-cdb1cf12810e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.161364 Jul 26 07:46:44.534487 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 976/1996] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:44 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:44.586460 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8e8a9a68-3f6b-4cb8-97a6-c5a9e7607fb7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:44.595065 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8e8a9a68-3f6b-4cb8-97a6-c5a9e7607fb7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:44.598097 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8e8a9a68-3f6b-4cb8-97a6-c5a9e7607fb7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:44.598097 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8e8a9a68-3f6b-4cb8-97a6-c5a9e7607fb7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.252475 Jul 26 07:46:44.598364 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1021/1997] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:44 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:44.603509 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f207394e-67cc-4bc3-bd39-96f26a4b236e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:44.604159 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-f207394e-67cc-4bc3-bd39-96f26a4b236e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:44.610413 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f207394e-67cc-4bc3-bd39-96f26a4b236e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:44.610861 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f207394e-67cc-4bc3-bd39-96f26a4b236e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:44.611624 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f207394e-67cc-4bc3-bd39-96f26a4b236e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:44.612060 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f207394e-67cc-4bc3-bd39-96f26a4b236e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:44.756077 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-f207394e-67cc-4bc3-bd39-96f26a4b236e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:44.764472 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f207394e-67cc-4bc3-bd39-96f26a4b236e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.164955 Jul 26 07:46:44.765038 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 977/1998] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:44 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:45.555114 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b0d7dd03-a5c6-4ca4-af26-a0604d41043c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:45.555736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b0d7dd03-a5c6-4ca4-af26-a0604d41043c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:45.562994 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b0d7dd03-a5c6-4ca4-af26-a0604d41043c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:45.563465 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b0d7dd03-a5c6-4ca4-af26-a0604d41043c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:45.564212 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b0d7dd03-a5c6-4ca4-af26-a0604d41043c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:45.564632 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b0d7dd03-a5c6-4ca4-af26-a0604d41043c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:45.620514 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a6aca775-80e0-4a65-bafa-0e2b27c24ae6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:45.621142 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a6aca775-80e0-4a65-bafa-0e2b27c24ae6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:45.628242 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a6aca775-80e0-4a65-bafa-0e2b27c24ae6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:45.628698 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a6aca775-80e0-4a65-bafa-0e2b27c24ae6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:45.629459 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a6aca775-80e0-4a65-bafa-0e2b27c24ae6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:45.629925 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a6aca775-80e0-4a65-bafa-0e2b27c24ae6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:45.695762 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a6aca775-80e0-4a65-bafa-0e2b27c24ae6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:45.701148 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-b0d7dd03-a5c6-4ca4-af26-a0604d41043c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:45.705069 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a6aca775-80e0-4a65-bafa-0e2b27c24ae6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:45.706574 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a6aca775-80e0-4a65-bafa-0e2b27c24ae6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:45.707726 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a6aca775-80e0-4a65-bafa-0e2b27c24ae6 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.091162 Jul 26 07:46:45.708526 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 978/1999] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:45 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:45.709564 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b0d7dd03-a5c6-4ca4-af26-a0604d41043c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.158353 Jul 26 07:46:45.710172 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1022/2000] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:45 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:45.790787 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a3834b44-a714-4aa7-8b46-8485cd605462 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:45.791412 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a3834b44-a714-4aa7-8b46-8485cd605462 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:45.798381 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a3834b44-a714-4aa7-8b46-8485cd605462 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:45.798818 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a3834b44-a714-4aa7-8b46-8485cd605462 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:45.799567 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a3834b44-a714-4aa7-8b46-8485cd605462 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:45.799994 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a3834b44-a714-4aa7-8b46-8485cd605462 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:45.931154 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a3834b44-a714-4aa7-8b46-8485cd605462 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:45.939504 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a3834b44-a714-4aa7-8b46-8485cd605462 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.152695 Jul 26 07:46:45.940064 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 979/2001] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:45 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:46.730663 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-65a11dc1-6cff-426f-b495-a69d2e71bcbf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:46.731344 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e242cf80-7a0e-450a-9acc-173e21dfd907 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:46.731344 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e242cf80-7a0e-450a-9acc-173e21dfd907 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:46.731816 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-65a11dc1-6cff-426f-b495-a69d2e71bcbf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:46.738025 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-65a11dc1-6cff-426f-b495-a69d2e71bcbf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:46.738232 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e242cf80-7a0e-450a-9acc-173e21dfd907 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:46.738471 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-65a11dc1-6cff-426f-b495-a69d2e71bcbf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:46.738623 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e242cf80-7a0e-450a-9acc-173e21dfd907 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:46.739221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-65a11dc1-6cff-426f-b495-a69d2e71bcbf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:46.739389 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e242cf80-7a0e-450a-9acc-173e21dfd907 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:46.739634 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-65a11dc1-6cff-426f-b495-a69d2e71bcbf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:46.739804 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e242cf80-7a0e-450a-9acc-173e21dfd907 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:46.802674 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-e242cf80-7a0e-450a-9acc-173e21dfd907 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:46.814536 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-e242cf80-7a0e-450a-9acc-173e21dfd907 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:46.816038 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-e242cf80-7a0e-450a-9acc-173e21dfd907 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:46.817216 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e242cf80-7a0e-450a-9acc-173e21dfd907 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.090637 Jul 26 07:46:46.817784 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1023/2002] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:46 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:46.880589 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-65a11dc1-6cff-426f-b495-a69d2e71bcbf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:46.889213 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-65a11dc1-6cff-426f-b495-a69d2e71bcbf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.162555 Jul 26 07:46:46.889783 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 980/2003] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:46 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:46.965136 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-725c2c60-e81c-401c-8346-b0c5d185046a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:46.966161 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-725c2c60-e81c-401c-8346-b0c5d185046a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:46.976404 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-725c2c60-e81c-401c-8346-b0c5d185046a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:46.977153 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-725c2c60-e81c-401c-8346-b0c5d185046a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:46.978556 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-725c2c60-e81c-401c-8346-b0c5d185046a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:46.979025 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-725c2c60-e81c-401c-8346-b0c5d185046a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:47.115481 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-725c2c60-e81c-401c-8346-b0c5d185046a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:47.127953 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-725c2c60-e81c-401c-8346-b0c5d185046a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.169482 Jul 26 07:46:47.128527 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1024/2004] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:46 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:47.843603 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6e8ee822-32e5-4b92-99ef-8cec8e0e43a7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:47.844541 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6e8ee822-32e5-4b92-99ef-8cec8e0e43a7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:47.854416 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6e8ee822-32e5-4b92-99ef-8cec8e0e43a7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:47.854857 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6e8ee822-32e5-4b92-99ef-8cec8e0e43a7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:47.855642 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6e8ee822-32e5-4b92-99ef-8cec8e0e43a7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:47.856076 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6e8ee822-32e5-4b92-99ef-8cec8e0e43a7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:47.910606 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-41522d90-ef47-42c5-bd89-01ea7c6d13ad tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:47.911250 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-41522d90-ef47-42c5-bd89-01ea7c6d13ad tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:47.917905 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6e8ee822-32e5-4b92-99ef-8cec8e0e43a7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:47.918063 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-41522d90-ef47-42c5-bd89-01ea7c6d13ad tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:47.918439 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-41522d90-ef47-42c5-bd89-01ea7c6d13ad tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:47.919214 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-41522d90-ef47-42c5-bd89-01ea7c6d13ad tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:47.919654 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-41522d90-ef47-42c5-bd89-01ea7c6d13ad tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:47.926723 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6e8ee822-32e5-4b92-99ef-8cec8e0e43a7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:47.928199 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6e8ee822-32e5-4b92-99ef-8cec8e0e43a7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:47.929341 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6e8ee822-32e5-4b92-99ef-8cec8e0e43a7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.091960 Jul 26 07:46:47.929919 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 981/2005] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:47 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:48.063133 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-41522d90-ef47-42c5-bd89-01ea7c6d13ad tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:48.076338 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-41522d90-ef47-42c5-bd89-01ea7c6d13ad tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.169306 Jul 26 07:46:48.077068 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1025/2006] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:47 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:46:48.149805 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-4288a713-e1ff-42e3-b063-5d7eab877cbf tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:48.150412 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-4288a713-e1ff-42e3-b063-5d7eab877cbf tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:48.157038 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4288a713-e1ff-42e3-b063-5d7eab877cbf tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:48.157479 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4288a713-e1ff-42e3-b063-5d7eab877cbf tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:48.158284 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4288a713-e1ff-42e3-b063-5d7eab877cbf tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:48.158718 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4288a713-e1ff-42e3-b063-5d7eab877cbf tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:48.299628 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-4288a713-e1ff-42e3-b063-5d7eab877cbf tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:48.309274 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-4288a713-e1ff-42e3-b063-5d7eab877cbf tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.163535 Jul 26 07:46:48.309867 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 982/2007] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:48 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:48.954845 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d5d186ff-e4a8-4e7c-88d8-6da18da29007 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:48.955490 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d5d186ff-e4a8-4e7c-88d8-6da18da29007 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:48.964212 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d5d186ff-e4a8-4e7c-88d8-6da18da29007 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:48.964652 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d5d186ff-e4a8-4e7c-88d8-6da18da29007 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:48.965416 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d5d186ff-e4a8-4e7c-88d8-6da18da29007 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:48.965868 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d5d186ff-e4a8-4e7c-88d8-6da18da29007 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:49.039938 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d5d186ff-e4a8-4e7c-88d8-6da18da29007 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:49.053192 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d5d186ff-e4a8-4e7c-88d8-6da18da29007 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:49.054777 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d5d186ff-e4a8-4e7c-88d8-6da18da29007 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:49.055986 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d5d186ff-e4a8-4e7c-88d8-6da18da29007 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.107435 Jul 26 07:46:49.056856 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1026/2008] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:48 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:49.102015 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f9a41036-2fd1-4fe2-a9b3-7235f71152be tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:49.102645 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-f9a41036-2fd1-4fe2-a9b3-7235f71152be tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:49.109771 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f9a41036-2fd1-4fe2-a9b3-7235f71152be tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:49.110255 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f9a41036-2fd1-4fe2-a9b3-7235f71152be tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:49.111287 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f9a41036-2fd1-4fe2-a9b3-7235f71152be tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:49.111516 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f9a41036-2fd1-4fe2-a9b3-7235f71152be tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:49.328426 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-f9a41036-2fd1-4fe2-a9b3-7235f71152be tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:49.331060 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7d0471df-6eab-44fc-95f3-4675243b21b6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:49.331777 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7d0471df-6eab-44fc-95f3-4675243b21b6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:49.337155 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f9a41036-2fd1-4fe2-a9b3-7235f71152be tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.239180 Jul 26 07:46:49.337991 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 983/2009] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:49 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:49.338138 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7d0471df-6eab-44fc-95f3-4675243b21b6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:49.338339 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7d0471df-6eab-44fc-95f3-4675243b21b6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:49.339123 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7d0471df-6eab-44fc-95f3-4675243b21b6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:49.339555 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7d0471df-6eab-44fc-95f3-4675243b21b6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:49.472916 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7d0471df-6eab-44fc-95f3-4675243b21b6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:49.481387 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7d0471df-6eab-44fc-95f3-4675243b21b6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.154652 Jul 26 07:46:49.482052 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1027/2010] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:49 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:50.083311 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-1d43cb07-a786-4d3d-bd50-136f88086b56 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:50.084237 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-1d43cb07-a786-4d3d-bd50-136f88086b56 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:50.094204 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1d43cb07-a786-4d3d-bd50-136f88086b56 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:50.094886 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1d43cb07-a786-4d3d-bd50-136f88086b56 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:50.096033 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1d43cb07-a786-4d3d-bd50-136f88086b56 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:50.096701 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1d43cb07-a786-4d3d-bd50-136f88086b56 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:50.160278 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-1d43cb07-a786-4d3d-bd50-136f88086b56 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:50.168928 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-1d43cb07-a786-4d3d-bd50-136f88086b56 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:50.170465 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-1d43cb07-a786-4d3d-bd50-136f88086b56 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:50.171611 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-1d43cb07-a786-4d3d-bd50-136f88086b56 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.094818 Jul 26 07:46:50.172165 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 984/2011] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:50 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:50.361703 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-37d71856-6843-4383-bfab-9fb8ee8def8b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:50.362459 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-37d71856-6843-4383-bfab-9fb8ee8def8b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:50.371067 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-37d71856-6843-4383-bfab-9fb8ee8def8b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:50.371521 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-37d71856-6843-4383-bfab-9fb8ee8def8b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:50.372297 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-37d71856-6843-4383-bfab-9fb8ee8def8b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:50.372730 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-37d71856-6843-4383-bfab-9fb8ee8def8b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:50.503168 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-aeecfb29-cc34-4a09-b265-6ce5b5c9643e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:50.504112 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-aeecfb29-cc34-4a09-b265-6ce5b5c9643e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:50.510504 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-aeecfb29-cc34-4a09-b265-6ce5b5c9643e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:50.510955 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-aeecfb29-cc34-4a09-b265-6ce5b5c9643e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:50.511726 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-aeecfb29-cc34-4a09-b265-6ce5b5c9643e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:50.512161 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-aeecfb29-cc34-4a09-b265-6ce5b5c9643e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:50.514194 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-37d71856-6843-4383-bfab-9fb8ee8def8b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:50.522451 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-37d71856-6843-4383-bfab-9fb8ee8def8b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.166014 Jul 26 07:46:50.523019 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1028/2012] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:50 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:50.642486 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-aeecfb29-cc34-4a09-b265-6ce5b5c9643e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:50.656803 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-aeecfb29-cc34-4a09-b265-6ce5b5c9643e tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.157001 Jul 26 07:46:50.657686 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 985/2013] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:50 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:51.196226 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-06e7512b-3256-4bef-b335-7116d587193d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:51.197115 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-06e7512b-3256-4bef-b335-7116d587193d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:51.206245 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-06e7512b-3256-4bef-b335-7116d587193d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:51.206846 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-06e7512b-3256-4bef-b335-7116d587193d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:51.207902 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-06e7512b-3256-4bef-b335-7116d587193d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:51.208419 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-06e7512b-3256-4bef-b335-7116d587193d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:51.276637 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-06e7512b-3256-4bef-b335-7116d587193d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:51.285686 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-06e7512b-3256-4bef-b335-7116d587193d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:51.287226 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-06e7512b-3256-4bef-b335-7116d587193d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:51.288409 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-06e7512b-3256-4bef-b335-7116d587193d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.097587 Jul 26 07:46:51.289162 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1029/2014] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:51 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:51.545212 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8f83addb-764b-4155-a102-a006c8315c19 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:51.545840 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8f83addb-764b-4155-a102-a006c8315c19 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:51.552819 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8f83addb-764b-4155-a102-a006c8315c19 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:51.553270 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8f83addb-764b-4155-a102-a006c8315c19 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:51.554085 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8f83addb-764b-4155-a102-a006c8315c19 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:51.554515 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8f83addb-764b-4155-a102-a006c8315c19 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:51.558738 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:46:51.679211 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-cc104719-76f2-4c7f-9fa5-e286dc08b8bd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:51.679842 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-cc104719-76f2-4c7f-9fa5-e286dc08b8bd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:51.686960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cc104719-76f2-4c7f-9fa5-e286dc08b8bd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:51.687424 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cc104719-76f2-4c7f-9fa5-e286dc08b8bd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:51.688178 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cc104719-76f2-4c7f-9fa5-e286dc08b8bd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:51.688639 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cc104719-76f2-4c7f-9fa5-e286dc08b8bd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:51.695930 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8f83addb-764b-4155-a102-a006c8315c19 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:51.704666 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8f83addb-764b-4155-a102-a006c8315c19 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.163913 Jul 26 07:46:51.705268 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 986/2015] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:51 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:51.832401 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-cc104719-76f2-4c7f-9fa5-e286dc08b8bd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:51.842554 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-cc104719-76f2-4c7f-9fa5-e286dc08b8bd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.167312 Jul 26 07:46:51.843098 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1030/2016] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:51 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:52.313951 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7833344b-d465-4662-a299-af5b6b567fb3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:52.314662 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7833344b-d465-4662-a299-af5b6b567fb3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:52.323124 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7833344b-d465-4662-a299-af5b6b567fb3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:52.323572 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7833344b-d465-4662-a299-af5b6b567fb3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:52.324335 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7833344b-d465-4662-a299-af5b6b567fb3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:52.324764 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7833344b-d465-4662-a299-af5b6b567fb3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:52.399254 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7833344b-d465-4662-a299-af5b6b567fb3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:52.412022 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7833344b-d465-4662-a299-af5b6b567fb3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:52.414284 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7833344b-d465-4662-a299-af5b6b567fb3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:52.416106 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7833344b-d465-4662-a299-af5b6b567fb3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.107676 Jul 26 07:46:52.416691 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 987/2017] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:52 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:52.729338 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9e3949e1-3e0f-4b11-b040-5c65b1524abe tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:52.731297 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-9e3949e1-3e0f-4b11-b040-5c65b1524abe tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:52.740548 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9e3949e1-3e0f-4b11-b040-5c65b1524abe tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:52.741117 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9e3949e1-3e0f-4b11-b040-5c65b1524abe tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:52.742227 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9e3949e1-3e0f-4b11-b040-5c65b1524abe tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:52.742851 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9e3949e1-3e0f-4b11-b040-5c65b1524abe tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:52.863540 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a3506628-bef2-44ff-a6fb-46874615d26f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:52.864252 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a3506628-bef2-44ff-a6fb-46874615d26f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:52.871223 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a3506628-bef2-44ff-a6fb-46874615d26f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:52.871676 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a3506628-bef2-44ff-a6fb-46874615d26f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:52.872441 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a3506628-bef2-44ff-a6fb-46874615d26f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:52.872879 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a3506628-bef2-44ff-a6fb-46874615d26f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:52.889803 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-9e3949e1-3e0f-4b11-b040-5c65b1524abe tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:52.899327 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-9e3949e1-3e0f-4b11-b040-5c65b1524abe tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.176111 Jul 26 07:46:52.909816 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1031/2018] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:52 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:53.016043 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a3506628-bef2-44ff-a6fb-46874615d26f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:53.028898 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a3506628-bef2-44ff-a6fb-46874615d26f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.169063 Jul 26 07:46:53.029674 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 988/2019] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:52 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:46:53.443042 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-596bc2b0-389e-43e3-be16-b9fa13829f30 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:53.443654 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-596bc2b0-389e-43e3-be16-b9fa13829f30 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:53.450150 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-596bc2b0-389e-43e3-be16-b9fa13829f30 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:53.450600 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-596bc2b0-389e-43e3-be16-b9fa13829f30 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:53.451362 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-596bc2b0-389e-43e3-be16-b9fa13829f30 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:53.451793 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-596bc2b0-389e-43e3-be16-b9fa13829f30 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:53.516961 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-596bc2b0-389e-43e3-be16-b9fa13829f30 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:53.525959 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-596bc2b0-389e-43e3-be16-b9fa13829f30 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:53.527447 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-596bc2b0-389e-43e3-be16-b9fa13829f30 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:53.528580 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-596bc2b0-389e-43e3-be16-b9fa13829f30 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.089509 Jul 26 07:46:53.529126 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1032/2020] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:53 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:53.924467 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c0b7ec0b-0a01-4dee-9620-db66d6e68886 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:53.925260 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c0b7ec0b-0a01-4dee-9620-db66d6e68886 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:53.933966 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c0b7ec0b-0a01-4dee-9620-db66d6e68886 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:53.934548 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c0b7ec0b-0a01-4dee-9620-db66d6e68886 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:53.935531 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c0b7ec0b-0a01-4dee-9620-db66d6e68886 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:53.936074 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c0b7ec0b-0a01-4dee-9620-db66d6e68886 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:54.056794 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-bda14116-89e2-4434-a2a0-bb460fa9d29d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:54.057421 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-bda14116-89e2-4434-a2a0-bb460fa9d29d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:54.064270 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bda14116-89e2-4434-a2a0-bb460fa9d29d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:54.064727 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bda14116-89e2-4434-a2a0-bb460fa9d29d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:54.065477 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bda14116-89e2-4434-a2a0-bb460fa9d29d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:54.065948 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bda14116-89e2-4434-a2a0-bb460fa9d29d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:54.081213 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-c0b7ec0b-0a01-4dee-9620-db66d6e68886 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:54.089514 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c0b7ec0b-0a01-4dee-9620-db66d6e68886 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.170026 Jul 26 07:46:54.090129 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 989/2021] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:53 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:54.209866 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-bda14116-89e2-4434-a2a0-bb460fa9d29d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:54.219059 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-bda14116-89e2-4434-a2a0-bb460fa9d29d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.168158 Jul 26 07:46:54.219625 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1033/2022] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:54 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:54.554724 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0f6e4364-e12b-4e0a-a460-86885dfd644b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:54.555547 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0f6e4364-e12b-4e0a-a460-86885dfd644b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:54.565111 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0f6e4364-e12b-4e0a-a460-86885dfd644b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:54.565633 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0f6e4364-e12b-4e0a-a460-86885dfd644b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:54.566808 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0f6e4364-e12b-4e0a-a460-86885dfd644b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:54.567375 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0f6e4364-e12b-4e0a-a460-86885dfd644b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:54.636539 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0f6e4364-e12b-4e0a-a460-86885dfd644b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:54.647686 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0f6e4364-e12b-4e0a-a460-86885dfd644b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:54.649447 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0f6e4364-e12b-4e0a-a460-86885dfd644b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:54.650818 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0f6e4364-e12b-4e0a-a460-86885dfd644b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.102330 Jul 26 07:46:54.651804 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 990/2023] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:54 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:55.114723 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-67dfc5f5-4883-4397-8c77-b61cd2217dbe tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:55.115778 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-67dfc5f5-4883-4397-8c77-b61cd2217dbe tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:55.126594 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-67dfc5f5-4883-4397-8c77-b61cd2217dbe tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:55.127554 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-67dfc5f5-4883-4397-8c77-b61cd2217dbe tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:55.128741 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-67dfc5f5-4883-4397-8c77-b61cd2217dbe tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:55.129471 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-67dfc5f5-4883-4397-8c77-b61cd2217dbe tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:55.240410 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-55dbb139-7f99-43c5-a3b2-0599c38b1b82 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:55.241023 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-55dbb139-7f99-43c5-a3b2-0599c38b1b82 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:55.247816 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-55dbb139-7f99-43c5-a3b2-0599c38b1b82 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:55.248268 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-55dbb139-7f99-43c5-a3b2-0599c38b1b82 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:55.249080 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-55dbb139-7f99-43c5-a3b2-0599c38b1b82 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:55.249507 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-55dbb139-7f99-43c5-a3b2-0599c38b1b82 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:55.267679 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-67dfc5f5-4883-4397-8c77-b61cd2217dbe tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:55.276489 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-67dfc5f5-4883-4397-8c77-b61cd2217dbe tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.168278 Jul 26 07:46:55.277168 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1034/2024] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:55 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:55.402359 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-55dbb139-7f99-43c5-a3b2-0599c38b1b82 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:55.414263 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-55dbb139-7f99-43c5-a3b2-0599c38b1b82 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.177444 Jul 26 07:46:55.414851 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 991/2025] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:55 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:55.680432 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d8ff048a-d9ac-4683-abaf-5cb80e6c127d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:55.680996 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d8ff048a-d9ac-4683-abaf-5cb80e6c127d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:55.687888 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d8ff048a-d9ac-4683-abaf-5cb80e6c127d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:55.688334 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d8ff048a-d9ac-4683-abaf-5cb80e6c127d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:55.689093 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d8ff048a-d9ac-4683-abaf-5cb80e6c127d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:55.689526 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d8ff048a-d9ac-4683-abaf-5cb80e6c127d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:55.693514 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:46:55.759612 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d8ff048a-d9ac-4683-abaf-5cb80e6c127d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:55.768547 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d8ff048a-d9ac-4683-abaf-5cb80e6c127d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:55.770045 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d8ff048a-d9ac-4683-abaf-5cb80e6c127d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:55.771233 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d8ff048a-d9ac-4683-abaf-5cb80e6c127d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.095073 Jul 26 07:46:55.771778 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1035/2026] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:55 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:56.298847 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a353bf21-a6d8-4f2f-b639-5e8318ee5181 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:56.299444 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a353bf21-a6d8-4f2f-b639-5e8318ee5181 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:56.305987 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a353bf21-a6d8-4f2f-b639-5e8318ee5181 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:56.306538 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a353bf21-a6d8-4f2f-b639-5e8318ee5181 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:56.307304 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a353bf21-a6d8-4f2f-b639-5e8318ee5181 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:56.307737 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a353bf21-a6d8-4f2f-b639-5e8318ee5181 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:56.436365 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-1db5affb-6cd3-42f8-b520-34eb16f1a0aa tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:56.436952 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-1db5affb-6cd3-42f8-b520-34eb16f1a0aa tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:56.442484 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a353bf21-a6d8-4f2f-b639-5e8318ee5181 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:56.445786 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1db5affb-6cd3-42f8-b520-34eb16f1a0aa tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:56.446240 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1db5affb-6cd3-42f8-b520-34eb16f1a0aa tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:56.447017 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1db5affb-6cd3-42f8-b520-34eb16f1a0aa tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:56.447448 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1db5affb-6cd3-42f8-b520-34eb16f1a0aa tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:56.450853 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a353bf21-a6d8-4f2f-b639-5e8318ee5181 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.156415 Jul 26 07:46:56.451620 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 992/2027] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:56 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:56.581787 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-1db5affb-6cd3-42f8-b520-34eb16f1a0aa tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:56.590176 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-1db5affb-6cd3-42f8-b520-34eb16f1a0aa tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.158426 Jul 26 07:46:56.590755 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1036/2028] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:56 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:56.804186 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b2380571-e01b-4602-8e31-83a14d4f0205 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:56.805092 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-b2380571-e01b-4602-8e31-83a14d4f0205 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:56.807925 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=80 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:46:56.816029 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b2380571-e01b-4602-8e31-83a14d4f0205 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:56.816527 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b2380571-e01b-4602-8e31-83a14d4f0205 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:56.817575 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b2380571-e01b-4602-8e31-83a14d4f0205 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:56.818250 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b2380571-e01b-4602-8e31-83a14d4f0205 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:56.883591 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-b2380571-e01b-4602-8e31-83a14d4f0205 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:56.892661 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-b2380571-e01b-4602-8e31-83a14d4f0205 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:56.894205 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-b2380571-e01b-4602-8e31-83a14d4f0205 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:56.895376 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b2380571-e01b-4602-8e31-83a14d4f0205 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.097389 Jul 26 07:46:56.895935 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 993/2029] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:56 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:57.475846 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7b94f1e3-87bb-4241-a625-05b642f5f082 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:57.476501 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7b94f1e3-87bb-4241-a625-05b642f5f082 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:57.485014 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7b94f1e3-87bb-4241-a625-05b642f5f082 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:57.485470 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7b94f1e3-87bb-4241-a625-05b642f5f082 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:57.486279 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7b94f1e3-87bb-4241-a625-05b642f5f082 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:57.486712 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7b94f1e3-87bb-4241-a625-05b642f5f082 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:57.611658 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-eb98597f-6319-426f-9fa6-e1604c555f98 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:57.612270 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-eb98597f-6319-426f-9fa6-e1604c555f98 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:57.619492 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-eb98597f-6319-426f-9fa6-e1604c555f98 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:57.620060 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-eb98597f-6319-426f-9fa6-e1604c555f98 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:57.620262 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7b94f1e3-87bb-4241-a625-05b642f5f082 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:57.621017 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-eb98597f-6319-426f-9fa6-e1604c555f98 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:57.621515 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-eb98597f-6319-426f-9fa6-e1604c555f98 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:57.628644 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7b94f1e3-87bb-4241-a625-05b642f5f082 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.159589 Jul 26 07:46:57.629229 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1037/2030] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:57 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:46:57.763818 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-eb98597f-6319-426f-9fa6-e1604c555f98 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:57.776217 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-eb98597f-6319-426f-9fa6-e1604c555f98 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.168107 Jul 26 07:46:57.776853 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 994/2031] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:57 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:46:57.918482 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-4e13b56d-5010-4830-b701-7b51c7d3d9d5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:57.919097 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-4e13b56d-5010-4830-b701-7b51c7d3d9d5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:57.921021 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=76 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:46:57.926699 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4e13b56d-5010-4830-b701-7b51c7d3d9d5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:57.927082 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4e13b56d-5010-4830-b701-7b51c7d3d9d5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:57.927851 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4e13b56d-5010-4830-b701-7b51c7d3d9d5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:57.928287 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4e13b56d-5010-4830-b701-7b51c7d3d9d5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:58.000738 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-4e13b56d-5010-4830-b701-7b51c7d3d9d5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:58.009418 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-4e13b56d-5010-4830-b701-7b51c7d3d9d5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:58.010934 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-4e13b56d-5010-4830-b701-7b51c7d3d9d5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:58.012079 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-4e13b56d-5010-4830-b701-7b51c7d3d9d5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.097638 Jul 26 07:46:58.012634 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1038/2032] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:57 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:58.650599 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7acf42c6-4e5d-4679-b773-e98b47a7a227 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:58.651192 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7acf42c6-4e5d-4679-b773-e98b47a7a227 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:58.658509 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7acf42c6-4e5d-4679-b773-e98b47a7a227 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:58.658932 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7acf42c6-4e5d-4679-b773-e98b47a7a227 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:58.659725 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7acf42c6-4e5d-4679-b773-e98b47a7a227 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:58.660157 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7acf42c6-4e5d-4679-b773-e98b47a7a227 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:58.795385 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7acf42c6-4e5d-4679-b773-e98b47a7a227 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:58.796835 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-5a1928eb-bca5-4879-b249-ec7e3022952a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:58.797488 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-5a1928eb-bca5-4879-b249-ec7e3022952a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:58.803451 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7acf42c6-4e5d-4679-b773-e98b47a7a227 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.156849 Jul 26 07:46:58.804019 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 995/2033] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:58 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:58.804144 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5a1928eb-bca5-4879-b249-ec7e3022952a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:58.804611 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5a1928eb-bca5-4879-b249-ec7e3022952a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:58.805355 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5a1928eb-bca5-4879-b249-ec7e3022952a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:58.805839 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5a1928eb-bca5-4879-b249-ec7e3022952a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:58.942756 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-5a1928eb-bca5-4879-b249-ec7e3022952a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:58.954272 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-5a1928eb-bca5-4879-b249-ec7e3022952a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.161221 Jul 26 07:46:58.954806 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1039/2034] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:58 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:59.040682 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-af7ba61a-051a-4d19-ab11-7dfc2bbe337d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:59.041314 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-af7ba61a-051a-4d19-ab11-7dfc2bbe337d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:59.048235 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-af7ba61a-051a-4d19-ab11-7dfc2bbe337d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:59.048675 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-af7ba61a-051a-4d19-ab11-7dfc2bbe337d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:59.049428 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-af7ba61a-051a-4d19-ab11-7dfc2bbe337d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:59.049878 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-af7ba61a-051a-4d19-ab11-7dfc2bbe337d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:59.120893 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-af7ba61a-051a-4d19-ab11-7dfc2bbe337d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:59.130174 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-af7ba61a-051a-4d19-ab11-7dfc2bbe337d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:59.131657 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-af7ba61a-051a-4d19-ab11-7dfc2bbe337d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:59.132808 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-af7ba61a-051a-4d19-ab11-7dfc2bbe337d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.096180 Jul 26 07:46:59.133354 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 996/2035] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:46:59 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:46:59.824791 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-0d66c57e-08f9-41ac-a334-4acc0e202df4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:59.825500 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-0d66c57e-08f9-41ac-a334-4acc0e202df4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:59.832934 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0d66c57e-08f9-41ac-a334-4acc0e202df4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:59.833379 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0d66c57e-08f9-41ac-a334-4acc0e202df4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:59.834174 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0d66c57e-08f9-41ac-a334-4acc0e202df4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:59.834608 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0d66c57e-08f9-41ac-a334-4acc0e202df4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:59.966823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-0d66c57e-08f9-41ac-a334-4acc0e202df4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:46:59.974470 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-64f2e495-a7b6-48b8-9ffe-63eb21b10add tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:46:59.975034 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-0d66c57e-08f9-41ac-a334-4acc0e202df4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.154168 Jul 26 07:46:59.975149 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-64f2e495-a7b6-48b8-9ffe-63eb21b10add tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:46:59.975565 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1040/2036] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:59 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:46:59.982036 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-64f2e495-a7b6-48b8-9ffe-63eb21b10add tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:59.982484 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-64f2e495-a7b6-48b8-9ffe-63eb21b10add tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:46:59.983255 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-64f2e495-a7b6-48b8-9ffe-63eb21b10add tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:46:59.983661 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-64f2e495-a7b6-48b8-9ffe-63eb21b10add tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:00.124327 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-64f2e495-a7b6-48b8-9ffe-63eb21b10add tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:00.133009 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-64f2e495-a7b6-48b8-9ffe-63eb21b10add tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.162347 Jul 26 07:47:00.133538 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 997/2037] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:46:59 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:00.155579 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-36eb165a-cd3a-48ec-baf6-d09b24382ea7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:00.156180 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-36eb165a-cd3a-48ec-baf6-d09b24382ea7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:00.162205 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-36eb165a-cd3a-48ec-baf6-d09b24382ea7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:00.162647 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-36eb165a-cd3a-48ec-baf6-d09b24382ea7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:00.163395 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-36eb165a-cd3a-48ec-baf6-d09b24382ea7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:00.163832 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-36eb165a-cd3a-48ec-baf6-d09b24382ea7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:00.232955 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-36eb165a-cd3a-48ec-baf6-d09b24382ea7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:00.246040 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-36eb165a-cd3a-48ec-baf6-d09b24382ea7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:00.247742 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-36eb165a-cd3a-48ec-baf6-d09b24382ea7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:00.248902 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-36eb165a-cd3a-48ec-baf6-d09b24382ea7 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.097401 Jul 26 07:47:00.249527 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1041/2038] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:00 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:00.998693 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-962af122-22aa-4a8d-bc4d-87542019c04f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:00.999335 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-962af122-22aa-4a8d-bc4d-87542019c04f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:01.006707 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-962af122-22aa-4a8d-bc4d-87542019c04f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:01.007155 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-962af122-22aa-4a8d-bc4d-87542019c04f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:01.007916 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-962af122-22aa-4a8d-bc4d-87542019c04f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:01.008345 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-962af122-22aa-4a8d-bc4d-87542019c04f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:01.151156 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-962af122-22aa-4a8d-bc4d-87542019c04f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:01.159491 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-962af122-22aa-4a8d-bc4d-87542019c04f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.166549 Jul 26 07:47:01.160098 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 998/2039] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:00 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:01.160920 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-4fca87cb-c417-4562-adb1-c382f517b81d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:01.161543 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-4fca87cb-c417-4562-adb1-c382f517b81d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:01.168002 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4fca87cb-c417-4562-adb1-c382f517b81d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:01.168448 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4fca87cb-c417-4562-adb1-c382f517b81d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:01.169189 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4fca87cb-c417-4562-adb1-c382f517b81d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:01.169732 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4fca87cb-c417-4562-adb1-c382f517b81d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:01.271738 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2adc2c73-3988-4d56-8c23-2b2c53400838 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:01.272351 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2adc2c73-3988-4d56-8c23-2b2c53400838 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:01.278763 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2adc2c73-3988-4d56-8c23-2b2c53400838 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:01.279247 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2adc2c73-3988-4d56-8c23-2b2c53400838 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:01.280022 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2adc2c73-3988-4d56-8c23-2b2c53400838 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:01.280461 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2adc2c73-3988-4d56-8c23-2b2c53400838 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:01.306909 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-4fca87cb-c417-4562-adb1-c382f517b81d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:01.315095 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-4fca87cb-c417-4562-adb1-c382f517b81d tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.162359 Jul 26 07:47:01.315953 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1042/2040] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:01 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:47:01.344222 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2adc2c73-3988-4d56-8c23-2b2c53400838 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:01.356258 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2adc2c73-3988-4d56-8c23-2b2c53400838 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:01.358010 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2adc2c73-3988-4d56-8c23-2b2c53400838 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:01.359143 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2adc2c73-3988-4d56-8c23-2b2c53400838 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.091403 Jul 26 07:47:01.359692 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 999/2041] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:01 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:02.182420 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-4577f7ea-e632-4f09-b5d1-456c1458be9e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:02.183094 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-4577f7ea-e632-4f09-b5d1-456c1458be9e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:02.190653 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4577f7ea-e632-4f09-b5d1-456c1458be9e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:02.191103 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4577f7ea-e632-4f09-b5d1-456c1458be9e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:02.191865 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4577f7ea-e632-4f09-b5d1-456c1458be9e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:02.192297 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4577f7ea-e632-4f09-b5d1-456c1458be9e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:02.323342 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-4577f7ea-e632-4f09-b5d1-456c1458be9e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:02.334194 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-4577f7ea-e632-4f09-b5d1-456c1458be9e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.156837 Jul 26 07:47:02.334766 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1043/2042] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:02 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:02.337359 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0509fcdb-f18f-4dab-983d-dd9b4cfb80b7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:02.337992 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0509fcdb-f18f-4dab-983d-dd9b4cfb80b7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:02.344975 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0509fcdb-f18f-4dab-983d-dd9b4cfb80b7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:02.345414 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0509fcdb-f18f-4dab-983d-dd9b4cfb80b7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:02.346225 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0509fcdb-f18f-4dab-983d-dd9b4cfb80b7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:02.346647 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0509fcdb-f18f-4dab-983d-dd9b4cfb80b7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:02.381310 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-087bb14e-2e00-4ff5-9021-56ba65b66024 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:02.382062 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-087bb14e-2e00-4ff5-9021-56ba65b66024 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:02.388959 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-087bb14e-2e00-4ff5-9021-56ba65b66024 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:02.389419 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-087bb14e-2e00-4ff5-9021-56ba65b66024 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:02.390236 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-087bb14e-2e00-4ff5-9021-56ba65b66024 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:02.393257 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-087bb14e-2e00-4ff5-9021-56ba65b66024 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:02.455465 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-087bb14e-2e00-4ff5-9021-56ba65b66024 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:02.467990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-087bb14e-2e00-4ff5-9021-56ba65b66024 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:02.467990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-087bb14e-2e00-4ff5-9021-56ba65b66024 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:02.467990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-087bb14e-2e00-4ff5-9021-56ba65b66024 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.089794 Jul 26 07:47:02.468428 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1044/2043] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:02 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:02.493546 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0509fcdb-f18f-4dab-983d-dd9b4cfb80b7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:02.501932 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0509fcdb-f18f-4dab-983d-dd9b4cfb80b7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.168616 Jul 26 07:47:02.502508 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1000/2044] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:02 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:47:03.420362 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-85d63abd-3847-4c81-92f3-bb8a38301b2f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:03.420955 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-85d63abd-3847-4c81-92f3-bb8a38301b2f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:03.427866 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-85d63abd-3847-4c81-92f3-bb8a38301b2f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:03.428311 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-85d63abd-3847-4c81-92f3-bb8a38301b2f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:03.429070 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-85d63abd-3847-4c81-92f3-bb8a38301b2f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:03.429499 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-85d63abd-3847-4c81-92f3-bb8a38301b2f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:03.490021 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-487228b9-1d26-46d3-875e-dd3afda7ddfe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:03.490629 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-487228b9-1d26-46d3-875e-dd3afda7ddfe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:03.497284 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-487228b9-1d26-46d3-875e-dd3afda7ddfe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:03.497770 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-487228b9-1d26-46d3-875e-dd3afda7ddfe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:03.498531 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-487228b9-1d26-46d3-875e-dd3afda7ddfe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:03.498958 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-487228b9-1d26-46d3-875e-dd3afda7ddfe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:03.570658 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-487228b9-1d26-46d3-875e-dd3afda7ddfe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:03.575276 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-85d63abd-3847-4c81-92f3-bb8a38301b2f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:03.580129 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-487228b9-1d26-46d3-875e-dd3afda7ddfe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:03.581904 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-487228b9-1d26-46d3-875e-dd3afda7ddfe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:03.583127 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-487228b9-1d26-46d3-875e-dd3afda7ddfe tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.097076 Jul 26 07:47:03.584433 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-85d63abd-3847-4c81-92f3-bb8a38301b2f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.170631 Jul 26 07:47:03.584646 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1001/2045] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:03 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 07:47:03.585382 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1045/2046] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:03 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:03.589473 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-70dcd13e-4173-40a2-821d-53669caf3cac tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:03.590116 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-70dcd13e-4173-40a2-821d-53669caf3cac tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:03.596747 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-70dcd13e-4173-40a2-821d-53669caf3cac tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:03.597190 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-70dcd13e-4173-40a2-821d-53669caf3cac tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:03.597997 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-70dcd13e-4173-40a2-821d-53669caf3cac tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:03.598435 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-70dcd13e-4173-40a2-821d-53669caf3cac tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:03.746663 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-70dcd13e-4173-40a2-821d-53669caf3cac tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:03.750202 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:47:03.755728 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-70dcd13e-4173-40a2-821d-53669caf3cac tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.170271 Jul 26 07:47:03.756300 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1002/2047] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:03 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:04.607791 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-53617e92-079b-451d-8b7f-a0ff86bcbda8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:04.608549 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-53617e92-079b-451d-8b7f-a0ff86bcbda8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:04.610407 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-84054b5d-5c9a-4bc6-a5af-ca52af827507 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:04.611098 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-84054b5d-5c9a-4bc6-a5af-ca52af827507 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:04.616172 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-53617e92-079b-451d-8b7f-a0ff86bcbda8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:04.616732 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-53617e92-079b-451d-8b7f-a0ff86bcbda8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:04.617659 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-53617e92-079b-451d-8b7f-a0ff86bcbda8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:04.618213 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-53617e92-079b-451d-8b7f-a0ff86bcbda8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:04.618955 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-84054b5d-5c9a-4bc6-a5af-ca52af827507 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:04.619539 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-84054b5d-5c9a-4bc6-a5af-ca52af827507 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:04.620470 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-84054b5d-5c9a-4bc6-a5af-ca52af827507 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:04.620995 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-84054b5d-5c9a-4bc6-a5af-ca52af827507 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:04.683833 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-84054b5d-5c9a-4bc6-a5af-ca52af827507 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:04.692483 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-84054b5d-5c9a-4bc6-a5af-ca52af827507 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:04.693930 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-84054b5d-5c9a-4bc6-a5af-ca52af827507 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:04.695078 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-84054b5d-5c9a-4bc6-a5af-ca52af827507 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.090175 Jul 26 07:47:04.695633 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1003/2048] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:04 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:04.750718 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-53617e92-079b-451d-8b7f-a0ff86bcbda8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:04.758948 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-53617e92-079b-451d-8b7f-a0ff86bcbda8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.156244 Jul 26 07:47:04.759519 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1046/2049] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:04 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:04.785541 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-1eaf2998-24eb-4963-8adc-5d729d186041 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:04.786211 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-1eaf2998-24eb-4963-8adc-5d729d186041 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:04.792552 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1eaf2998-24eb-4963-8adc-5d729d186041 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:04.792993 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1eaf2998-24eb-4963-8adc-5d729d186041 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:04.793774 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1eaf2998-24eb-4963-8adc-5d729d186041 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:04.794202 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1eaf2998-24eb-4963-8adc-5d729d186041 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:04.927178 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-1eaf2998-24eb-4963-8adc-5d729d186041 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:04.938092 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-1eaf2998-24eb-4963-8adc-5d729d186041 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.156612 Jul 26 07:47:04.938680 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1004/2050] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:04 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:05.718194 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-1352c91b-c825-40fa-8142-afdca735f3d0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:05.718789 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-1352c91b-c825-40fa-8142-afdca735f3d0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:05.725802 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1352c91b-c825-40fa-8142-afdca735f3d0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:05.726267 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1352c91b-c825-40fa-8142-afdca735f3d0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:05.727023 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1352c91b-c825-40fa-8142-afdca735f3d0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:05.727444 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1352c91b-c825-40fa-8142-afdca735f3d0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:05.780876 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-616f4f0c-60eb-4ada-a599-7a234031cf17 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:05.781774 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-616f4f0c-60eb-4ada-a599-7a234031cf17 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:05.788966 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-616f4f0c-60eb-4ada-a599-7a234031cf17 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:05.789412 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-616f4f0c-60eb-4ada-a599-7a234031cf17 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:05.790309 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-616f4f0c-60eb-4ada-a599-7a234031cf17 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:05.790841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-616f4f0c-60eb-4ada-a599-7a234031cf17 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:05.798110 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-1352c91b-c825-40fa-8142-afdca735f3d0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:05.806997 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-1352c91b-c825-40fa-8142-afdca735f3d0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:05.808491 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-1352c91b-c825-40fa-8142-afdca735f3d0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:05.809651 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-1352c91b-c825-40fa-8142-afdca735f3d0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.095681 Jul 26 07:47:05.810312 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1047/2051] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:05 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:05.931023 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-616f4f0c-60eb-4ada-a599-7a234031cf17 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:05.939448 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-616f4f0c-60eb-4ada-a599-7a234031cf17 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.162733 Jul 26 07:47:05.940307 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1005/2052] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:05 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:05.961635 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-04ba191a-edca-4c16-8b28-4a6df939b40a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:05.962530 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-04ba191a-edca-4c16-8b28-4a6df939b40a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:05.971738 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-04ba191a-edca-4c16-8b28-4a6df939b40a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:05.972235 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-04ba191a-edca-4c16-8b28-4a6df939b40a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:05.973350 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-04ba191a-edca-4c16-8b28-4a6df939b40a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:05.973857 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-04ba191a-edca-4c16-8b28-4a6df939b40a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:06.114418 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-04ba191a-edca-4c16-8b28-4a6df939b40a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:06.126510 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-04ba191a-edca-4c16-8b28-4a6df939b40a tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.170859 Jul 26 07:47:06.127318 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1048/2053] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:05 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:06.835730 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-98bc961e-0e84-4f81-a9d5-2c9af22a2ea1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:06.836560 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-98bc961e-0e84-4f81-a9d5-2c9af22a2ea1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:06.846179 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-98bc961e-0e84-4f81-a9d5-2c9af22a2ea1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:06.846818 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-98bc961e-0e84-4f81-a9d5-2c9af22a2ea1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:06.847882 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-98bc961e-0e84-4f81-a9d5-2c9af22a2ea1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:06.848489 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-98bc961e-0e84-4f81-a9d5-2c9af22a2ea1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:06.915553 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-98bc961e-0e84-4f81-a9d5-2c9af22a2ea1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:06.924196 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-98bc961e-0e84-4f81-a9d5-2c9af22a2ea1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:06.925663 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-98bc961e-0e84-4f81-a9d5-2c9af22a2ea1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:06.926829 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-98bc961e-0e84-4f81-a9d5-2c9af22a2ea1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.096759 Jul 26 07:47:06.927385 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1006/2054] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:06 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:06.961185 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e5235f99-b983-4f3c-873e-476c3dd5af25 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:06.961850 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e5235f99-b983-4f3c-873e-476c3dd5af25 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:06.969211 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e5235f99-b983-4f3c-873e-476c3dd5af25 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:06.969654 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e5235f99-b983-4f3c-873e-476c3dd5af25 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:06.970463 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e5235f99-b983-4f3c-873e-476c3dd5af25 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:06.970888 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e5235f99-b983-4f3c-873e-476c3dd5af25 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:07.112683 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-e5235f99-b983-4f3c-873e-476c3dd5af25 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:07.121525 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e5235f99-b983-4f3c-873e-476c3dd5af25 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.164855 Jul 26 07:47:07.122141 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1049/2055] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:06 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:07.148318 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9c40e880-ab4e-40c4-9986-2284480bb64b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:07.148975 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-9c40e880-ab4e-40c4-9986-2284480bb64b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:07.155478 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9c40e880-ab4e-40c4-9986-2284480bb64b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:07.155922 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9c40e880-ab4e-40c4-9986-2284480bb64b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:07.156684 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9c40e880-ab4e-40c4-9986-2284480bb64b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:07.157114 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9c40e880-ab4e-40c4-9986-2284480bb64b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:07.292165 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-9c40e880-ab4e-40c4-9986-2284480bb64b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:07.304683 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-9c40e880-ab4e-40c4-9986-2284480bb64b tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.159956 Jul 26 07:47:07.305502 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1007/2056] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:07 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:07.950094 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e76da9ab-4cc7-49dc-be48-93f269b81ae5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:07.950782 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e76da9ab-4cc7-49dc-be48-93f269b81ae5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:07.958607 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e76da9ab-4cc7-49dc-be48-93f269b81ae5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:07.959125 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e76da9ab-4cc7-49dc-be48-93f269b81ae5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:07.959995 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e76da9ab-4cc7-49dc-be48-93f269b81ae5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:07.960497 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e76da9ab-4cc7-49dc-be48-93f269b81ae5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:08.030039 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-e76da9ab-4cc7-49dc-be48-93f269b81ae5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:08.042945 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-e76da9ab-4cc7-49dc-be48-93f269b81ae5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:08.045095 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-e76da9ab-4cc7-49dc-be48-93f269b81ae5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:08.046816 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e76da9ab-4cc7-49dc-be48-93f269b81ae5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.101296 Jul 26 07:47:08.047546 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1050/2057] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:07 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:08.144595 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d003e9b8-e3b1-4a3f-9cd5-2f224edb5966 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:08.145314 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d003e9b8-e3b1-4a3f-9cd5-2f224edb5966 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:08.154830 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d003e9b8-e3b1-4a3f-9cd5-2f224edb5966 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:08.155442 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d003e9b8-e3b1-4a3f-9cd5-2f224edb5966 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:08.156574 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d003e9b8-e3b1-4a3f-9cd5-2f224edb5966 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:08.157216 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d003e9b8-e3b1-4a3f-9cd5-2f224edb5966 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:08.328713 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e74a1dd1-564d-4652-b262-541f7c15fc5f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:08.329459 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e74a1dd1-564d-4652-b262-541f7c15fc5f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:08.336079 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e74a1dd1-564d-4652-b262-541f7c15fc5f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:08.336524 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e74a1dd1-564d-4652-b262-541f7c15fc5f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:08.337321 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e74a1dd1-564d-4652-b262-541f7c15fc5f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:08.337934 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e74a1dd1-564d-4652-b262-541f7c15fc5f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:08.476759 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-e74a1dd1-564d-4652-b262-541f7c15fc5f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:08.480440 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:47:08.485908 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e74a1dd1-564d-4652-b262-541f7c15fc5f tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.161816 Jul 26 07:47:08.486505 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1051/2058] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:08 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:08.543489 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d003e9b8-e3b1-4a3f-9cd5-2f224edb5966 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:08.555911 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d003e9b8-e3b1-4a3f-9cd5-2f224edb5966 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.415724 Jul 26 07:47:08.556836 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1008/2059] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:08 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:09.071063 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-95ebfeee-5a1d-4c28-b5a4-89eb278a66f3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:09.071915 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-95ebfeee-5a1d-4c28-b5a4-89eb278a66f3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:09.080174 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-95ebfeee-5a1d-4c28-b5a4-89eb278a66f3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:09.080620 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-95ebfeee-5a1d-4c28-b5a4-89eb278a66f3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:09.081383 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-95ebfeee-5a1d-4c28-b5a4-89eb278a66f3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:09.081826 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-95ebfeee-5a1d-4c28-b5a4-89eb278a66f3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:09.145647 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-95ebfeee-5a1d-4c28-b5a4-89eb278a66f3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:09.158278 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-95ebfeee-5a1d-4c28-b5a4-89eb278a66f3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:09.160608 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-95ebfeee-5a1d-4c28-b5a4-89eb278a66f3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:09.162384 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-95ebfeee-5a1d-4c28-b5a4-89eb278a66f3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.095658 Jul 26 07:47:09.163125 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1052/2060] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:09 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:09.508003 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d130b82c-404a-4e1d-9c0a-2a651157abc7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:09.508691 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d130b82c-404a-4e1d-9c0a-2a651157abc7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:09.515630 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d130b82c-404a-4e1d-9c0a-2a651157abc7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:09.516073 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d130b82c-404a-4e1d-9c0a-2a651157abc7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:09.516821 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d130b82c-404a-4e1d-9c0a-2a651157abc7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:09.517248 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d130b82c-404a-4e1d-9c0a-2a651157abc7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:09.580029 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ef3a355a-8877-4a39-b87a-4dec2a051015 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:09.580779 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ef3a355a-8877-4a39-b87a-4dec2a051015 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:09.587207 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef3a355a-8877-4a39-b87a-4dec2a051015 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:09.587757 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef3a355a-8877-4a39-b87a-4dec2a051015 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:09.588528 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef3a355a-8877-4a39-b87a-4dec2a051015 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:09.588961 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef3a355a-8877-4a39-b87a-4dec2a051015 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:09.653849 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d130b82c-404a-4e1d-9c0a-2a651157abc7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:09.662653 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d130b82c-404a-4e1d-9c0a-2a651157abc7 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.158569 Jul 26 07:47:09.663224 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1009/2061] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:09 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:09.730582 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ef3a355a-8877-4a39-b87a-4dec2a051015 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:09.739176 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ef3a355a-8877-4a39-b87a-4dec2a051015 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.163628 Jul 26 07:47:09.739634 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1053/2062] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:09 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:10.187259 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-43451874-e62c-4578-ab77-5bbdd802c2e0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:10.187857 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-43451874-e62c-4578-ab77-5bbdd802c2e0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:10.194562 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-43451874-e62c-4578-ab77-5bbdd802c2e0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:10.195004 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-43451874-e62c-4578-ab77-5bbdd802c2e0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:10.195759 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-43451874-e62c-4578-ab77-5bbdd802c2e0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:10.196212 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-43451874-e62c-4578-ab77-5bbdd802c2e0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:10.258959 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-43451874-e62c-4578-ab77-5bbdd802c2e0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:10.272099 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-43451874-e62c-4578-ab77-5bbdd802c2e0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:10.273611 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-43451874-e62c-4578-ab77-5bbdd802c2e0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:10.275132 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-43451874-e62c-4578-ab77-5bbdd802c2e0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.092979 Jul 26 07:47:10.275889 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1010/2063] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:10 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:10.684266 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3c5db80e-7c1f-44b9-a1ee-57dec12ceedc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:10.684932 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3c5db80e-7c1f-44b9-a1ee-57dec12ceedc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:10.695366 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3c5db80e-7c1f-44b9-a1ee-57dec12ceedc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:10.695856 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3c5db80e-7c1f-44b9-a1ee-57dec12ceedc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:10.696902 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3c5db80e-7c1f-44b9-a1ee-57dec12ceedc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:10.697383 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3c5db80e-7c1f-44b9-a1ee-57dec12ceedc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:10.760912 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c08a1fa7-9e9d-4e23-914c-62bf3578be2a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:10.761538 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c08a1fa7-9e9d-4e23-914c-62bf3578be2a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:10.768676 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c08a1fa7-9e9d-4e23-914c-62bf3578be2a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:10.769123 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c08a1fa7-9e9d-4e23-914c-62bf3578be2a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:10.769938 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c08a1fa7-9e9d-4e23-914c-62bf3578be2a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:10.770520 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c08a1fa7-9e9d-4e23-914c-62bf3578be2a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:10.830208 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3c5db80e-7c1f-44b9-a1ee-57dec12ceedc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:10.838551 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3c5db80e-7c1f-44b9-a1ee-57dec12ceedc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.158278 Jul 26 07:47:10.839121 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1054/2064] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:10 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:11.009723 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-c08a1fa7-9e9d-4e23-914c-62bf3578be2a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:11.017915 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c08a1fa7-9e9d-4e23-914c-62bf3578be2a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.261443 Jul 26 07:47:11.018474 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1011/2065] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:10 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:11.299217 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-413ea491-237f-463b-9edb-e28a896cef30 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:11.299820 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-413ea491-237f-463b-9edb-e28a896cef30 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:11.306246 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-413ea491-237f-463b-9edb-e28a896cef30 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:11.306692 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-413ea491-237f-463b-9edb-e28a896cef30 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:11.307446 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-413ea491-237f-463b-9edb-e28a896cef30 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:11.307874 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-413ea491-237f-463b-9edb-e28a896cef30 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:11.373325 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-413ea491-237f-463b-9edb-e28a896cef30 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:11.385960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-413ea491-237f-463b-9edb-e28a896cef30 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:11.388189 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-413ea491-237f-463b-9edb-e28a896cef30 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:11.389456 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-413ea491-237f-463b-9edb-e28a896cef30 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.094232 Jul 26 07:47:11.390044 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1055/2066] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:11 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:11.862217 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-bd978647-1e49-49b0-b251-918759c536f4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:11.862856 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-bd978647-1e49-49b0-b251-918759c536f4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:11.871792 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bd978647-1e49-49b0-b251-918759c536f4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:11.872281 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bd978647-1e49-49b0-b251-918759c536f4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:11.873438 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bd978647-1e49-49b0-b251-918759c536f4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:11.874004 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bd978647-1e49-49b0-b251-918759c536f4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:12.008749 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-bd978647-1e49-49b0-b251-918759c536f4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:12.017198 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-bd978647-1e49-49b0-b251-918759c536f4 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.160155 Jul 26 07:47:12.017874 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1012/2067] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:11 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:12.043100 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-801e5f60-c603-4365-b1a0-c634a6f5df64 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:12.043100 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-801e5f60-c603-4365-b1a0-c634a6f5df64 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:12.047083 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-801e5f60-c603-4365-b1a0-c634a6f5df64 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:12.047529 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-801e5f60-c603-4365-b1a0-c634a6f5df64 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:12.048311 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-801e5f60-c603-4365-b1a0-c634a6f5df64 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:12.048725 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-801e5f60-c603-4365-b1a0-c634a6f5df64 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:12.182917 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-801e5f60-c603-4365-b1a0-c634a6f5df64 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:12.195151 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-801e5f60-c603-4365-b1a0-c634a6f5df64 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.159284 Jul 26 07:47:12.195894 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1056/2068] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:12 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:12.416370 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-3be2c02b-7f74-46f6-baf0-3ef0be971693 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:12.417159 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-3be2c02b-7f74-46f6-baf0-3ef0be971693 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:12.427010 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3be2c02b-7f74-46f6-baf0-3ef0be971693 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:12.427676 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3be2c02b-7f74-46f6-baf0-3ef0be971693 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:12.428927 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3be2c02b-7f74-46f6-baf0-3ef0be971693 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:12.429602 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3be2c02b-7f74-46f6-baf0-3ef0be971693 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:12.500752 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-3be2c02b-7f74-46f6-baf0-3ef0be971693 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:12.513300 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-3be2c02b-7f74-46f6-baf0-3ef0be971693 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:12.515318 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-3be2c02b-7f74-46f6-baf0-3ef0be971693 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:12.517009 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-3be2c02b-7f74-46f6-baf0-3ef0be971693 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.107098 Jul 26 07:47:12.517687 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1013/2069] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:12 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:13.041361 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-878748c6-0a7c-4796-a336-056efb12e6aa tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:13.042230 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-878748c6-0a7c-4796-a336-056efb12e6aa tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:13.051605 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-878748c6-0a7c-4796-a336-056efb12e6aa tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:13.052296 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-878748c6-0a7c-4796-a336-056efb12e6aa tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:13.053044 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-878748c6-0a7c-4796-a336-056efb12e6aa tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:13.053611 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-878748c6-0a7c-4796-a336-056efb12e6aa tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:13.187278 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-878748c6-0a7c-4796-a336-056efb12e6aa tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:13.195672 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-878748c6-0a7c-4796-a336-056efb12e6aa tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.159882 Jul 26 07:47:13.196261 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1057/2070] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:13 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:13.216544 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6df1720e-d40e-42f9-97c9-d5c4fe31d211 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:13.217165 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6df1720e-d40e-42f9-97c9-d5c4fe31d211 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:13.224204 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6df1720e-d40e-42f9-97c9-d5c4fe31d211 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:13.224638 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6df1720e-d40e-42f9-97c9-d5c4fe31d211 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:13.225388 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6df1720e-d40e-42f9-97c9-d5c4fe31d211 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:13.225865 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6df1720e-d40e-42f9-97c9-d5c4fe31d211 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:13.367077 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6df1720e-d40e-42f9-97c9-d5c4fe31d211 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:13.375680 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6df1720e-d40e-42f9-97c9-d5c4fe31d211 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.163043 Jul 26 07:47:13.376250 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1014/2071] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:13 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:13.543943 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-2108cfba-3140-4907-a7b3-0b5ff18a4a6e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:13.544583 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2108cfba-3140-4907-a7b3-0b5ff18a4a6e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:13.551102 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2108cfba-3140-4907-a7b3-0b5ff18a4a6e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:13.551554 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2108cfba-3140-4907-a7b3-0b5ff18a4a6e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:13.552331 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2108cfba-3140-4907-a7b3-0b5ff18a4a6e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:13.552761 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2108cfba-3140-4907-a7b3-0b5ff18a4a6e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:13.621661 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2108cfba-3140-4907-a7b3-0b5ff18a4a6e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:13.630547 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2108cfba-3140-4907-a7b3-0b5ff18a4a6e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:13.632040 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2108cfba-3140-4907-a7b3-0b5ff18a4a6e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:13.633227 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-2108cfba-3140-4907-a7b3-0b5ff18a4a6e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.093355 Jul 26 07:47:13.633777 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1058/2072] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:13 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:14.218731 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-157800c9-f39d-4f7e-85ac-15fe588c74d8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:14.219545 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-157800c9-f39d-4f7e-85ac-15fe588c74d8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:14.228627 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-157800c9-f39d-4f7e-85ac-15fe588c74d8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:14.229197 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-157800c9-f39d-4f7e-85ac-15fe588c74d8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:14.230298 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-157800c9-f39d-4f7e-85ac-15fe588c74d8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:14.230919 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-157800c9-f39d-4f7e-85ac-15fe588c74d8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:14.368285 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-157800c9-f39d-4f7e-85ac-15fe588c74d8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:14.376492 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-157800c9-f39d-4f7e-85ac-15fe588c74d8 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.162995 Jul 26 07:47:14.377077 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1015/2073] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:14 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:14.396643 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6953a967-87be-4d53-b6f2-cd93a4dbb890 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:14.397223 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-6953a967-87be-4d53-b6f2-cd93a4dbb890 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:14.403905 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6953a967-87be-4d53-b6f2-cd93a4dbb890 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:14.404351 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6953a967-87be-4d53-b6f2-cd93a4dbb890 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:14.405102 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6953a967-87be-4d53-b6f2-cd93a4dbb890 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:14.405529 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6953a967-87be-4d53-b6f2-cd93a4dbb890 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:14.546780 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-6953a967-87be-4d53-b6f2-cd93a4dbb890 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:14.558963 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6953a967-87be-4d53-b6f2-cd93a4dbb890 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.165879 Jul 26 07:47:14.559804 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1059/2074] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:14 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:14.658292 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-355c491e-abea-4076-adb2-6c70e2bce4b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:14.658929 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-355c491e-abea-4076-adb2-6c70e2bce4b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:14.665534 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-355c491e-abea-4076-adb2-6c70e2bce4b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:14.665534 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-355c491e-abea-4076-adb2-6c70e2bce4b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:14.666926 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-355c491e-abea-4076-adb2-6c70e2bce4b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:14.667180 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-355c491e-abea-4076-adb2-6c70e2bce4b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:14.733797 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-355c491e-abea-4076-adb2-6c70e2bce4b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:14.746726 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-355c491e-abea-4076-adb2-6c70e2bce4b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:14.748858 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-355c491e-abea-4076-adb2-6c70e2bce4b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:14.750047 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-355c491e-abea-4076-adb2-6c70e2bce4b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.096565 Jul 26 07:47:14.750612 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1016/2075] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:14 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:15.401193 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-af869bcf-fff6-47a4-abba-dbf9c1a753ad tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:15.401977 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-af869bcf-fff6-47a4-abba-dbf9c1a753ad tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:15.410215 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-af869bcf-fff6-47a4-abba-dbf9c1a753ad tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:15.410674 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-af869bcf-fff6-47a4-abba-dbf9c1a753ad tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:15.411441 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-af869bcf-fff6-47a4-abba-dbf9c1a753ad tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:15.411877 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-af869bcf-fff6-47a4-abba-dbf9c1a753ad tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:15.556741 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-af869bcf-fff6-47a4-abba-dbf9c1a753ad tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:15.565252 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-af869bcf-fff6-47a4-abba-dbf9c1a753ad tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.169955 Jul 26 07:47:15.566356 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1060/2076] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:15 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:15.580892 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-4938b86f-e73e-45ec-a6d3-f18f6ea12c32 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:15.581486 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-4938b86f-e73e-45ec-a6d3-f18f6ea12c32 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:15.588534 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4938b86f-e73e-45ec-a6d3-f18f6ea12c32 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:15.588980 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4938b86f-e73e-45ec-a6d3-f18f6ea12c32 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:15.589755 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4938b86f-e73e-45ec-a6d3-f18f6ea12c32 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:15.590202 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4938b86f-e73e-45ec-a6d3-f18f6ea12c32 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:15.721075 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-4938b86f-e73e-45ec-a6d3-f18f6ea12c32 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:15.733512 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-4938b86f-e73e-45ec-a6d3-f18f6ea12c32 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.156327 Jul 26 07:47:15.734231 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1017/2077] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:15 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:15.776856 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8252db35-f251-44c9-b365-6836e78816e1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:15.777824 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8252db35-f251-44c9-b365-6836e78816e1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:15.787336 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8252db35-f251-44c9-b365-6836e78816e1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:15.788052 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8252db35-f251-44c9-b365-6836e78816e1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:15.789234 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8252db35-f251-44c9-b365-6836e78816e1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:15.789947 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8252db35-f251-44c9-b365-6836e78816e1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:15.856777 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8252db35-f251-44c9-b365-6836e78816e1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:15.865642 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8252db35-f251-44c9-b365-6836e78816e1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:15.867157 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8252db35-f251-44c9-b365-6836e78816e1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:15.868306 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8252db35-f251-44c9-b365-6836e78816e1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.098281 Jul 26 07:47:15.868872 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1061/2078] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:15 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:16.588816 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d15bdcb0-f077-46e7-84d1-4c4b37384bad tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:16.589423 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d15bdcb0-f077-46e7-84d1-4c4b37384bad tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:16.596137 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d15bdcb0-f077-46e7-84d1-4c4b37384bad tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:16.596614 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d15bdcb0-f077-46e7-84d1-4c4b37384bad tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:16.597355 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d15bdcb0-f077-46e7-84d1-4c4b37384bad tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:16.597791 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d15bdcb0-f077-46e7-84d1-4c4b37384bad tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:16.739271 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d15bdcb0-f077-46e7-84d1-4c4b37384bad tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:16.747920 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d15bdcb0-f077-46e7-84d1-4c4b37384bad tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.162959 Jul 26 07:47:16.748536 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1018/2079] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:16 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:16.756019 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ec17dd4c-0474-47ba-a940-627810685880 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:16.756609 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ec17dd4c-0474-47ba-a940-627810685880 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:16.764547 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ec17dd4c-0474-47ba-a940-627810685880 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:16.765233 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ec17dd4c-0474-47ba-a940-627810685880 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:16.766443 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ec17dd4c-0474-47ba-a940-627810685880 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:16.767025 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ec17dd4c-0474-47ba-a940-627810685880 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:16.891399 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-891ea3b9-c510-4079-bdc5-5b0cef6f3399 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:16.892009 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-891ea3b9-c510-4079-bdc5-5b0cef6f3399 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:16.898315 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-891ea3b9-c510-4079-bdc5-5b0cef6f3399 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:16.898757 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-891ea3b9-c510-4079-bdc5-5b0cef6f3399 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:16.899542 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-891ea3b9-c510-4079-bdc5-5b0cef6f3399 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:16.899991 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-891ea3b9-c510-4079-bdc5-5b0cef6f3399 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:16.918508 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:47:16.966814 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-891ea3b9-c510-4079-bdc5-5b0cef6f3399 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:16.975543 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-891ea3b9-c510-4079-bdc5-5b0cef6f3399 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:16.977056 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-891ea3b9-c510-4079-bdc5-5b0cef6f3399 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:16.978287 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-891ea3b9-c510-4079-bdc5-5b0cef6f3399 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.090844 Jul 26 07:47:16.978842 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1019/2080] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:16 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:17.029558 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ec17dd4c-0474-47ba-a940-627810685880 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:17.037898 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ec17dd4c-0474-47ba-a940-627810685880 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.286104 Jul 26 07:47:17.039874 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1062/2081] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:16 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:17.675112 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 07:47:17.675890 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Tue Jul 26 07:47:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 07:47:17.769105 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a77efc21-5f8c-4f77-85a9-06ad4680f9ec tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:17.769775 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a77efc21-5f8c-4f77-85a9-06ad4680f9ec tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:17.776895 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a77efc21-5f8c-4f77-85a9-06ad4680f9ec tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:17.777340 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a77efc21-5f8c-4f77-85a9-06ad4680f9ec tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:17.778131 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a77efc21-5f8c-4f77-85a9-06ad4680f9ec tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:17.778559 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a77efc21-5f8c-4f77-85a9-06ad4680f9ec tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:17.928001 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a77efc21-5f8c-4f77-85a9-06ad4680f9ec tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:17.935982 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a77efc21-5f8c-4f77-85a9-06ad4680f9ec tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.170824 Jul 26 07:47:17.936545 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1020/2082] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:17 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:18.000868 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e5061fa6-44c8-487f-8a3f-1fa9dfdded1b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:18.001476 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e5061fa6-44c8-487f-8a3f-1fa9dfdded1b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:18.008608 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e5061fa6-44c8-487f-8a3f-1fa9dfdded1b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:18.009015 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e5061fa6-44c8-487f-8a3f-1fa9dfdded1b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:18.009830 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e5061fa6-44c8-487f-8a3f-1fa9dfdded1b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:18.010258 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e5061fa6-44c8-487f-8a3f-1fa9dfdded1b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:18.063407 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-57cf28e3-f422-43f3-bbf1-89f0763b375a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:18.064043 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-57cf28e3-f422-43f3-bbf1-89f0763b375a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:18.070549 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-57cf28e3-f422-43f3-bbf1-89f0763b375a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:18.071013 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-57cf28e3-f422-43f3-bbf1-89f0763b375a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:18.071778 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-57cf28e3-f422-43f3-bbf1-89f0763b375a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:18.072220 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-57cf28e3-f422-43f3-bbf1-89f0763b375a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:18.072779 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-e5061fa6-44c8-487f-8a3f-1fa9dfdded1b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:18.082292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-e5061fa6-44c8-487f-8a3f-1fa9dfdded1b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:18.083888 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-e5061fa6-44c8-487f-8a3f-1fa9dfdded1b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:18.085047 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e5061fa6-44c8-487f-8a3f-1fa9dfdded1b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.088057 Jul 26 07:47:18.085619 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1063/2083] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:17 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:18.207612 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-57cf28e3-f422-43f3-bbf1-89f0763b375a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:18.215884 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-57cf28e3-f422-43f3-bbf1-89f0763b375a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.156402 Jul 26 07:47:18.216445 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1021/2084] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:18 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:18.958968 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-44f8cc22-2bf7-4288-8543-cbed08d93ba5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:18.959611 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-44f8cc22-2bf7-4288-8543-cbed08d93ba5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:18.967518 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-44f8cc22-2bf7-4288-8543-cbed08d93ba5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:18.968068 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-44f8cc22-2bf7-4288-8543-cbed08d93ba5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:18.969092 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-44f8cc22-2bf7-4288-8543-cbed08d93ba5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:18.969617 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-44f8cc22-2bf7-4288-8543-cbed08d93ba5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:19.107838 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6776c735-6a4b-4434-935e-4df3c0491f3e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:19.108437 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6776c735-6a4b-4434-935e-4df3c0491f3e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:19.116203 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-44f8cc22-2bf7-4288-8543-cbed08d93ba5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:19.116839 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6776c735-6a4b-4434-935e-4df3c0491f3e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:19.117492 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6776c735-6a4b-4434-935e-4df3c0491f3e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:19.118657 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6776c735-6a4b-4434-935e-4df3c0491f3e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:19.119166 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6776c735-6a4b-4434-935e-4df3c0491f3e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:19.127024 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-44f8cc22-2bf7-4288-8543-cbed08d93ba5 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.172823 Jul 26 07:47:19.127602 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1064/2085] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:18 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:19.199054 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6776c735-6a4b-4434-935e-4df3c0491f3e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:19.213405 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6776c735-6a4b-4434-935e-4df3c0491f3e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:19.215788 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6776c735-6a4b-4434-935e-4df3c0491f3e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:19.217646 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6776c735-6a4b-4434-935e-4df3c0491f3e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.113486 Jul 26 07:47:19.218401 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1022/2086] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:19 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:19.236452 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7cb2ac5c-6d10-4747-85ce-9930ef8be9b8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:19.237068 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7cb2ac5c-6d10-4747-85ce-9930ef8be9b8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:19.243266 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7cb2ac5c-6d10-4747-85ce-9930ef8be9b8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:19.243712 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7cb2ac5c-6d10-4747-85ce-9930ef8be9b8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:19.244458 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7cb2ac5c-6d10-4747-85ce-9930ef8be9b8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:19.244885 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7cb2ac5c-6d10-4747-85ce-9930ef8be9b8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:19.380157 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7cb2ac5c-6d10-4747-85ce-9930ef8be9b8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:19.391468 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7cb2ac5c-6d10-4747-85ce-9930ef8be9b8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.158780 Jul 26 07:47:19.392036 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1065/2087] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:19 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:20.152714 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9470726b-d6e5-4bc8-a92f-7f70dd09c5bc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:20.153671 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-9470726b-d6e5-4bc8-a92f-7f70dd09c5bc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:20.164594 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9470726b-d6e5-4bc8-a92f-7f70dd09c5bc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:20.165349 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9470726b-d6e5-4bc8-a92f-7f70dd09c5bc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:20.166637 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9470726b-d6e5-4bc8-a92f-7f70dd09c5bc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:20.167349 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9470726b-d6e5-4bc8-a92f-7f70dd09c5bc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:20.241396 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-392bb9c7-adab-466f-870f-680ba7dc1ab0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:20.242041 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-392bb9c7-adab-466f-870f-680ba7dc1ab0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:20.249171 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-392bb9c7-adab-466f-870f-680ba7dc1ab0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:20.249825 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-392bb9c7-adab-466f-870f-680ba7dc1ab0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:20.250428 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-392bb9c7-adab-466f-870f-680ba7dc1ab0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:20.250954 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-392bb9c7-adab-466f-870f-680ba7dc1ab0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:20.308602 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-9470726b-d6e5-4bc8-a92f-7f70dd09c5bc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:20.318367 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-9470726b-d6e5-4bc8-a92f-7f70dd09c5bc tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.171861 Jul 26 07:47:20.319158 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1023/2088] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:20 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:20.319610 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-392bb9c7-adab-466f-870f-680ba7dc1ab0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:20.329062 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-392bb9c7-adab-466f-870f-680ba7dc1ab0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:20.330616 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-392bb9c7-adab-466f-870f-680ba7dc1ab0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:20.331759 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-392bb9c7-adab-466f-870f-680ba7dc1ab0 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.094832 Jul 26 07:47:20.332334 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1066/2089] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:20 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:20.415313 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-18826747-44e6-428d-8c3a-edaa7d207e96 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:20.416015 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-18826747-44e6-428d-8c3a-edaa7d207e96 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:20.423948 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-18826747-44e6-428d-8c3a-edaa7d207e96 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:20.424382 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-18826747-44e6-428d-8c3a-edaa7d207e96 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:20.425141 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-18826747-44e6-428d-8c3a-edaa7d207e96 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:20.425565 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-18826747-44e6-428d-8c3a-edaa7d207e96 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:20.557105 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-18826747-44e6-428d-8c3a-edaa7d207e96 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:20.565772 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-18826747-44e6-428d-8c3a-edaa7d207e96 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.156313 Jul 26 07:47:20.566385 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1024/2090] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:20 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:21.344019 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c5fb81df-1e5b-430d-a357-e90d177c28fd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:21.344614 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c5fb81df-1e5b-430d-a357-e90d177c28fd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:21.351786 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c5fb81df-1e5b-430d-a357-e90d177c28fd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:21.352237 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c5fb81df-1e5b-430d-a357-e90d177c28fd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:21.353003 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c5fb81df-1e5b-430d-a357-e90d177c28fd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:21.353299 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-62a84635-bebf-47cc-9eb7-fa6d5c1dba4b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:21.353781 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c5fb81df-1e5b-430d-a357-e90d177c28fd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:21.353916 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-62a84635-bebf-47cc-9eb7-fa6d5c1dba4b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:21.360928 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-62a84635-bebf-47cc-9eb7-fa6d5c1dba4b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:21.361377 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-62a84635-bebf-47cc-9eb7-fa6d5c1dba4b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:21.362185 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-62a84635-bebf-47cc-9eb7-fa6d5c1dba4b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:21.362630 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-62a84635-bebf-47cc-9eb7-fa6d5c1dba4b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:21.424010 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-62a84635-bebf-47cc-9eb7-fa6d5c1dba4b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:21.433371 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-62a84635-bebf-47cc-9eb7-fa6d5c1dba4b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:21.435396 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-62a84635-bebf-47cc-9eb7-fa6d5c1dba4b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:21.436646 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-62a84635-bebf-47cc-9eb7-fa6d5c1dba4b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.087206 Jul 26 07:47:21.437467 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1025/2091] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:21 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:21.488324 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c5fb81df-1e5b-430d-a357-e90d177c28fd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:21.496474 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c5fb81df-1e5b-430d-a357-e90d177c28fd tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.158410 Jul 26 07:47:21.497043 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1067/2092] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:21 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:21.587239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-22013641-b26a-4f17-aecf-b0d065df48ac tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:21.587853 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-22013641-b26a-4f17-aecf-b0d065df48ac tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:21.594747 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-22013641-b26a-4f17-aecf-b0d065df48ac tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:21.595127 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-22013641-b26a-4f17-aecf-b0d065df48ac tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:21.595889 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-22013641-b26a-4f17-aecf-b0d065df48ac tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:21.596399 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-22013641-b26a-4f17-aecf-b0d065df48ac tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:21.734215 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-22013641-b26a-4f17-aecf-b0d065df48ac tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:21.742981 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-22013641-b26a-4f17-aecf-b0d065df48ac tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.159704 Jul 26 07:47:21.743558 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1026/2093] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:21 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:22.460533 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a42af98f-8f71-428f-a877-099a2757f025 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:22.461144 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a42af98f-8f71-428f-a877-099a2757f025 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:22.468272 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a42af98f-8f71-428f-a877-099a2757f025 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:22.468730 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a42af98f-8f71-428f-a877-099a2757f025 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:22.469492 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a42af98f-8f71-428f-a877-099a2757f025 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:22.469985 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a42af98f-8f71-428f-a877-099a2757f025 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:22.489888 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:47:22.517992 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-45aadd7c-dedf-40ed-b85e-ff07e5151271 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:22.518786 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-45aadd7c-dedf-40ed-b85e-ff07e5151271 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:22.525615 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-45aadd7c-dedf-40ed-b85e-ff07e5151271 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:22.526199 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-45aadd7c-dedf-40ed-b85e-ff07e5151271 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:22.527038 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-45aadd7c-dedf-40ed-b85e-ff07e5151271 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:22.527484 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-45aadd7c-dedf-40ed-b85e-ff07e5151271 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:22.535293 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-a42af98f-8f71-428f-a877-099a2757f025 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:22.544198 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-a42af98f-8f71-428f-a877-099a2757f025 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:22.545681 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-a42af98f-8f71-428f-a877-099a2757f025 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:22.546939 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a42af98f-8f71-428f-a877-099a2757f025 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.090482 Jul 26 07:47:22.547502 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1068/2094] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:22 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:22.667054 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-45aadd7c-dedf-40ed-b85e-ff07e5151271 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:22.675676 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-45aadd7c-dedf-40ed-b85e-ff07e5151271 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.161744 Jul 26 07:47:22.676247 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1027/2095] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:22 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:22.766955 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-20ef86c0-3236-45c6-8cfa-0b149feca2bd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:22.767794 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-20ef86c0-3236-45c6-8cfa-0b149feca2bd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:22.776570 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-20ef86c0-3236-45c6-8cfa-0b149feca2bd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:22.777228 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-20ef86c0-3236-45c6-8cfa-0b149feca2bd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:22.778362 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-20ef86c0-3236-45c6-8cfa-0b149feca2bd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:22.778945 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-20ef86c0-3236-45c6-8cfa-0b149feca2bd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:22.911363 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-20ef86c0-3236-45c6-8cfa-0b149feca2bd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:22.919528 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-20ef86c0-3236-45c6-8cfa-0b149feca2bd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.158448 Jul 26 07:47:22.920126 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1069/2096] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:22 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:23.569538 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-5eb7df63-8455-4773-84af-cee91fed4c44 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:23.570325 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-5eb7df63-8455-4773-84af-cee91fed4c44 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:23.577764 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5eb7df63-8455-4773-84af-cee91fed4c44 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:23.578217 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5eb7df63-8455-4773-84af-cee91fed4c44 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:23.578981 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5eb7df63-8455-4773-84af-cee91fed4c44 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:23.579405 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5eb7df63-8455-4773-84af-cee91fed4c44 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:23.648942 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-5eb7df63-8455-4773-84af-cee91fed4c44 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:23.658086 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-5eb7df63-8455-4773-84af-cee91fed4c44 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:23.659565 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-5eb7df63-8455-4773-84af-cee91fed4c44 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:23.660712 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-5eb7df63-8455-4773-84af-cee91fed4c44 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.095223 Jul 26 07:47:23.661266 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1028/2097] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:23 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:23.698917 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ec7dcd09-31df-4372-bbf4-fd7c1cf39df6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:23.699453 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ec7dcd09-31df-4372-bbf4-fd7c1cf39df6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] [instance: 8c87e5af-1321-4b95-86a4-6e094fa1d61f] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:23.706760 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ec7dcd09-31df-4372-bbf4-fd7c1cf39df6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:23.707199 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ec7dcd09-31df-4372-bbf4-fd7c1cf39df6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:23.707944 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ec7dcd09-31df-4372-bbf4-fd7c1cf39df6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:23.708370 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ec7dcd09-31df-4372-bbf4-fd7c1cf39df6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:23.847021 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ec7dcd09-31df-4372-bbf4-fd7c1cf39df6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c394476504af4c1d8bea462a5113cebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc12ef80ee841f5af4bc2d56966cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:23.859231 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ec7dcd09-31df-4372-bbf4-fd7c1cf39df6 tempest-VolumesSnapshotTestJSON-1328426109 tempest-VolumesSnapshotTestJSON-1328426109-project] 10.222.0.39 "GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f" status: 200 len: 1559 microversion: 2.1 time: 0.164250 Jul 26 07:47:23.859806 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1070/2098] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:23 2022] GET /compute/v2.1/servers/8c87e5af-1321-4b95-86a4-6e094fa1d61f => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:23.940980 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9cb16f4b-9854-4f03-833a-76298b56fbdb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:23.941583 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-9cb16f4b-9854-4f03-833a-76298b56fbdb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:23.947956 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9cb16f4b-9854-4f03-833a-76298b56fbdb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:23.948400 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9cb16f4b-9854-4f03-833a-76298b56fbdb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:23.949234 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9cb16f4b-9854-4f03-833a-76298b56fbdb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:23.949578 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9cb16f4b-9854-4f03-833a-76298b56fbdb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:24.079344 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-9cb16f4b-9854-4f03-833a-76298b56fbdb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:24.088055 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-9cb16f4b-9854-4f03-833a-76298b56fbdb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.150928 Jul 26 07:47:24.088636 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1029/2099] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:23 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:24.686646 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-2ba5e1fe-3c35-4536-9eb7-0c4179979173 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:24.687288 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2ba5e1fe-3c35-4536-9eb7-0c4179979173 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:24.696207 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2ba5e1fe-3c35-4536-9eb7-0c4179979173 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:24.696700 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2ba5e1fe-3c35-4536-9eb7-0c4179979173 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:24.697806 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2ba5e1fe-3c35-4536-9eb7-0c4179979173 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:24.698382 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2ba5e1fe-3c35-4536-9eb7-0c4179979173 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:24.765372 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2ba5e1fe-3c35-4536-9eb7-0c4179979173 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:24.778430 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2ba5e1fe-3c35-4536-9eb7-0c4179979173 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:24.780845 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2ba5e1fe-3c35-4536-9eb7-0c4179979173 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:24.782612 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-2ba5e1fe-3c35-4536-9eb7-0c4179979173 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.101884 Jul 26 07:47:24.783363 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1071/2100] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:24 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:25.111789 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-3278e336-7b92-40ed-a12d-2ac391f7c5aa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:25.112422 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-3278e336-7b92-40ed-a12d-2ac391f7c5aa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:25.122551 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3278e336-7b92-40ed-a12d-2ac391f7c5aa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:25.123126 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3278e336-7b92-40ed-a12d-2ac391f7c5aa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:25.124087 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3278e336-7b92-40ed-a12d-2ac391f7c5aa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:25.124449 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3278e336-7b92-40ed-a12d-2ac391f7c5aa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:25.277835 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-3278e336-7b92-40ed-a12d-2ac391f7c5aa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:25.288829 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-3278e336-7b92-40ed-a12d-2ac391f7c5aa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.182591 Jul 26 07:47:25.289699 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1030/2101] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:25 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:25.805088 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-11483e50-ec7c-4138-bda3-0fad0b716e1a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:25.805770 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-11483e50-ec7c-4138-bda3-0fad0b716e1a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:25.814881 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-11483e50-ec7c-4138-bda3-0fad0b716e1a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:25.815411 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-11483e50-ec7c-4138-bda3-0fad0b716e1a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:25.816513 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-11483e50-ec7c-4138-bda3-0fad0b716e1a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:25.817096 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-11483e50-ec7c-4138-bda3-0fad0b716e1a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:25.879413 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-11483e50-ec7c-4138-bda3-0fad0b716e1a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:25.893123 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-11483e50-ec7c-4138-bda3-0fad0b716e1a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:25.895463 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-11483e50-ec7c-4138-bda3-0fad0b716e1a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:25.897227 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-11483e50-ec7c-4138-bda3-0fad0b716e1a tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.095924 Jul 26 07:47:25.898164 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1072/2102] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:25 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:26.318976 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6a8de7e1-b163-4fb3-82cc-5dc30cd34dfd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:26.319609 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6a8de7e1-b163-4fb3-82cc-5dc30cd34dfd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:26.326301 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6a8de7e1-b163-4fb3-82cc-5dc30cd34dfd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:26.327113 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6a8de7e1-b163-4fb3-82cc-5dc30cd34dfd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:26.327886 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6a8de7e1-b163-4fb3-82cc-5dc30cd34dfd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:26.328413 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6a8de7e1-b163-4fb3-82cc-5dc30cd34dfd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:26.461782 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6a8de7e1-b163-4fb3-82cc-5dc30cd34dfd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:26.470393 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6a8de7e1-b163-4fb3-82cc-5dc30cd34dfd tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.155643 Jul 26 07:47:26.470958 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1031/2103] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:26 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:26.924460 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f7974a44-40fd-4fce-9ef4-ffd40d7b4dfb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:26.925077 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f7974a44-40fd-4fce-9ef4-ffd40d7b4dfb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:26.931980 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f7974a44-40fd-4fce-9ef4-ffd40d7b4dfb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:26.932422 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f7974a44-40fd-4fce-9ef4-ffd40d7b4dfb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:26.933173 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f7974a44-40fd-4fce-9ef4-ffd40d7b4dfb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:26.933601 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f7974a44-40fd-4fce-9ef4-ffd40d7b4dfb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:26.995760 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f7974a44-40fd-4fce-9ef4-ffd40d7b4dfb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:27.004993 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f7974a44-40fd-4fce-9ef4-ffd40d7b4dfb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:27.006542 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f7974a44-40fd-4fce-9ef4-ffd40d7b4dfb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:27.007704 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f7974a44-40fd-4fce-9ef4-ffd40d7b4dfb tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.087751 Jul 26 07:47:27.008231 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1073/2104] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:26 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:27.492418 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9f9ee27b-122f-47cc-93ff-feca8ff8ec19 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:27.493024 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-9f9ee27b-122f-47cc-93ff-feca8ff8ec19 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:27.495417 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=78 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:47:27.500952 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9f9ee27b-122f-47cc-93ff-feca8ff8ec19 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:27.501354 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9f9ee27b-122f-47cc-93ff-feca8ff8ec19 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:27.502109 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9f9ee27b-122f-47cc-93ff-feca8ff8ec19 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:27.502567 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9f9ee27b-122f-47cc-93ff-feca8ff8ec19 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:27.638080 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-9f9ee27b-122f-47cc-93ff-feca8ff8ec19 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:27.647052 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-9f9ee27b-122f-47cc-93ff-feca8ff8ec19 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.158518 Jul 26 07:47:27.647626 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1032/2105] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:27 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:28.034589 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-2d67967c-6329-428c-93bb-5d7b393a92f3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:28.035232 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2d67967c-6329-428c-93bb-5d7b393a92f3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:28.037535 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=72 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:47:28.043204 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2d67967c-6329-428c-93bb-5d7b393a92f3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:28.043651 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2d67967c-6329-428c-93bb-5d7b393a92f3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:28.044400 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2d67967c-6329-428c-93bb-5d7b393a92f3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:28.044827 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2d67967c-6329-428c-93bb-5d7b393a92f3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:28.115963 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2d67967c-6329-428c-93bb-5d7b393a92f3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:28.124987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2d67967c-6329-428c-93bb-5d7b393a92f3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:28.126566 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2d67967c-6329-428c-93bb-5d7b393a92f3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:28.127696 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-2d67967c-6329-428c-93bb-5d7b393a92f3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.097813 Jul 26 07:47:28.128247 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1074/2106] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:28 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:28.675914 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-3e1074bc-9c97-4e99-9994-b14d3d6b8a0b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:28.676647 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-3e1074bc-9c97-4e99-9994-b14d3d6b8a0b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:28.683553 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3e1074bc-9c97-4e99-9994-b14d3d6b8a0b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:28.684000 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3e1074bc-9c97-4e99-9994-b14d3d6b8a0b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:28.684759 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3e1074bc-9c97-4e99-9994-b14d3d6b8a0b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:28.685192 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3e1074bc-9c97-4e99-9994-b14d3d6b8a0b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:28.829848 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-3e1074bc-9c97-4e99-9994-b14d3d6b8a0b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:28.842740 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-3e1074bc-9c97-4e99-9994-b14d3d6b8a0b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.170681 Jul 26 07:47:28.843677 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1033/2107] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:28 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:29.150982 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f88e8232-6172-4001-b14d-bea4723dcc9b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:29.151677 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f88e8232-6172-4001-b14d-bea4723dcc9b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:29.158816 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f88e8232-6172-4001-b14d-bea4723dcc9b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:29.159262 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f88e8232-6172-4001-b14d-bea4723dcc9b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:29.160015 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f88e8232-6172-4001-b14d-bea4723dcc9b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:29.160448 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f88e8232-6172-4001-b14d-bea4723dcc9b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:29.227846 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f88e8232-6172-4001-b14d-bea4723dcc9b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:29.236902 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f88e8232-6172-4001-b14d-bea4723dcc9b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:29.238421 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f88e8232-6172-4001-b14d-bea4723dcc9b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:29.239562 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f88e8232-6172-4001-b14d-bea4723dcc9b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.092672 Jul 26 07:47:29.240106 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1075/2108] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:29 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:29.865070 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8b6aec58-6064-4fce-8723-d46bcbcde9a6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:29.865847 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8b6aec58-6064-4fce-8723-d46bcbcde9a6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:29.872508 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8b6aec58-6064-4fce-8723-d46bcbcde9a6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:29.872953 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8b6aec58-6064-4fce-8723-d46bcbcde9a6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:29.873848 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8b6aec58-6064-4fce-8723-d46bcbcde9a6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:29.874196 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8b6aec58-6064-4fce-8723-d46bcbcde9a6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:30.012350 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8b6aec58-6064-4fce-8723-d46bcbcde9a6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:30.022046 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8b6aec58-6064-4fce-8723-d46bcbcde9a6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.160836 Jul 26 07:47:30.022651 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1034/2109] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:29 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:30.266385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7cf05f46-8aae-417f-be89-afca61824d34 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:30.267093 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7cf05f46-8aae-417f-be89-afca61824d34 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:30.274384 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7cf05f46-8aae-417f-be89-afca61824d34 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:30.274831 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7cf05f46-8aae-417f-be89-afca61824d34 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:30.275583 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7cf05f46-8aae-417f-be89-afca61824d34 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:30.276016 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7cf05f46-8aae-417f-be89-afca61824d34 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:30.344146 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7cf05f46-8aae-417f-be89-afca61824d34 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:30.352762 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7cf05f46-8aae-417f-be89-afca61824d34 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:30.354287 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7cf05f46-8aae-417f-be89-afca61824d34 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:30.355422 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7cf05f46-8aae-417f-be89-afca61824d34 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.094739 Jul 26 07:47:30.355999 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1076/2110] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:30 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:31.047098 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-88ed09b9-91dd-42b1-97a2-58f36ab9158c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:31.047859 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-88ed09b9-91dd-42b1-97a2-58f36ab9158c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:31.058621 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-88ed09b9-91dd-42b1-97a2-58f36ab9158c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:31.059313 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-88ed09b9-91dd-42b1-97a2-58f36ab9158c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:31.060454 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-88ed09b9-91dd-42b1-97a2-58f36ab9158c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:31.061077 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-88ed09b9-91dd-42b1-97a2-58f36ab9158c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:31.203462 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-88ed09b9-91dd-42b1-97a2-58f36ab9158c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:31.215795 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-88ed09b9-91dd-42b1-97a2-58f36ab9158c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.174778 Jul 26 07:47:31.216550 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1035/2111] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:31 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:31.384250 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3026c284-23f4-494a-8f09-7a851b341436 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:31.385014 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3026c284-23f4-494a-8f09-7a851b341436 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:31.394148 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3026c284-23f4-494a-8f09-7a851b341436 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:31.394597 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3026c284-23f4-494a-8f09-7a851b341436 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:31.395363 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3026c284-23f4-494a-8f09-7a851b341436 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:31.395791 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3026c284-23f4-494a-8f09-7a851b341436 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:31.458521 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3026c284-23f4-494a-8f09-7a851b341436 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:31.467197 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3026c284-23f4-494a-8f09-7a851b341436 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:31.468706 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3026c284-23f4-494a-8f09-7a851b341436 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:31.469889 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3026c284-23f4-494a-8f09-7a851b341436 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.093868 Jul 26 07:47:31.470466 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1077/2112] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:31 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:32.238605 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-785ce847-e2b1-44aa-935f-a245caa2c41f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:32.239248 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-785ce847-e2b1-44aa-935f-a245caa2c41f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:32.246348 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-785ce847-e2b1-44aa-935f-a245caa2c41f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:32.246797 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-785ce847-e2b1-44aa-935f-a245caa2c41f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:32.247562 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-785ce847-e2b1-44aa-935f-a245caa2c41f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:32.247995 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-785ce847-e2b1-44aa-935f-a245caa2c41f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:32.251985 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:47:32.387198 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-785ce847-e2b1-44aa-935f-a245caa2c41f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:32.396448 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-785ce847-e2b1-44aa-935f-a245caa2c41f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.162246 Jul 26 07:47:32.397022 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1036/2113] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:32 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:32.496390 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7674774f-c243-49c7-9754-8365c9a5a1a5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:32.497074 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7674774f-c243-49c7-9754-8365c9a5a1a5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:32.505445 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7674774f-c243-49c7-9754-8365c9a5a1a5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:32.505939 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7674774f-c243-49c7-9754-8365c9a5a1a5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:32.506698 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7674774f-c243-49c7-9754-8365c9a5a1a5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:32.507126 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7674774f-c243-49c7-9754-8365c9a5a1a5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:32.571289 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7674774f-c243-49c7-9754-8365c9a5a1a5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:32.580813 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7674774f-c243-49c7-9754-8365c9a5a1a5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:32.582337 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7674774f-c243-49c7-9754-8365c9a5a1a5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:32.583486 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7674774f-c243-49c7-9754-8365c9a5a1a5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.093815 Jul 26 07:47:32.584049 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1078/2114] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:32 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:33.418264 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-70e4f9f6-a6fc-4aa1-b49a-cd205809f361 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:33.418858 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-70e4f9f6-a6fc-4aa1-b49a-cd205809f361 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:33.426920 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-70e4f9f6-a6fc-4aa1-b49a-cd205809f361 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:33.427371 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-70e4f9f6-a6fc-4aa1-b49a-cd205809f361 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:33.428164 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-70e4f9f6-a6fc-4aa1-b49a-cd205809f361 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:33.428600 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-70e4f9f6-a6fc-4aa1-b49a-cd205809f361 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:33.574687 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-70e4f9f6-a6fc-4aa1-b49a-cd205809f361 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:33.583621 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-70e4f9f6-a6fc-4aa1-b49a-cd205809f361 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.169444 Jul 26 07:47:33.584189 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1037/2115] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:33 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:33.605911 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ca222069-c06b-4e8e-8808-3128ece2490d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:33.606479 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ca222069-c06b-4e8e-8808-3128ece2490d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:33.613448 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ca222069-c06b-4e8e-8808-3128ece2490d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:33.613993 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ca222069-c06b-4e8e-8808-3128ece2490d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:33.614770 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ca222069-c06b-4e8e-8808-3128ece2490d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:33.615234 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ca222069-c06b-4e8e-8808-3128ece2490d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:33.676072 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ca222069-c06b-4e8e-8808-3128ece2490d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:33.684646 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ca222069-c06b-4e8e-8808-3128ece2490d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:33.686176 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ca222069-c06b-4e8e-8808-3128ece2490d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:33.687316 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ca222069-c06b-4e8e-8808-3128ece2490d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.085473 Jul 26 07:47:33.687886 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1079/2116] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:33 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 07:47:34.604446 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-4b21ae78-3572-48ed-a1e1-e5e0a6cc46ca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:34.605059 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-4b21ae78-3572-48ed-a1e1-e5e0a6cc46ca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:34.612158 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4b21ae78-3572-48ed-a1e1-e5e0a6cc46ca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:34.612603 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4b21ae78-3572-48ed-a1e1-e5e0a6cc46ca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:34.613361 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4b21ae78-3572-48ed-a1e1-e5e0a6cc46ca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:34.613819 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4b21ae78-3572-48ed-a1e1-e5e0a6cc46ca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:34.711267 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-19f46e59-3c1b-449e-99f8-13dfcade584e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:34.711842 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-19f46e59-3c1b-449e-99f8-13dfcade584e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:34.718770 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-19f46e59-3c1b-449e-99f8-13dfcade584e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:34.719289 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-19f46e59-3c1b-449e-99f8-13dfcade584e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:34.720049 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-19f46e59-3c1b-449e-99f8-13dfcade584e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:34.720478 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-19f46e59-3c1b-449e-99f8-13dfcade584e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:34.743544 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-4b21ae78-3572-48ed-a1e1-e5e0a6cc46ca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:34.751826 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-4b21ae78-3572-48ed-a1e1-e5e0a6cc46ca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.151390 Jul 26 07:47:34.752403 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1038/2117] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:34 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:34.781975 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-19f46e59-3c1b-449e-99f8-13dfcade584e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:34.790339 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-19f46e59-3c1b-449e-99f8-13dfcade584e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:34.791838 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-19f46e59-3c1b-449e-99f8-13dfcade584e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:34.792957 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-19f46e59-3c1b-449e-99f8-13dfcade584e tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.085597 Jul 26 07:47:34.793500 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1080/2118] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:34 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:35.773198 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ea85f2f6-86ea-432f-ab82-7702d07bfbde tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:35.773798 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ea85f2f6-86ea-432f-ab82-7702d07bfbde tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:35.780856 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ea85f2f6-86ea-432f-ab82-7702d07bfbde tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:35.781303 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ea85f2f6-86ea-432f-ab82-7702d07bfbde tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:35.782191 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ea85f2f6-86ea-432f-ab82-7702d07bfbde tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:35.782622 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ea85f2f6-86ea-432f-ab82-7702d07bfbde tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:35.815502 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f29ff342-4ebc-4b0b-8c28-be1570ca45b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:35.816099 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f29ff342-4ebc-4b0b-8c28-be1570ca45b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:35.823265 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f29ff342-4ebc-4b0b-8c28-be1570ca45b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:35.823791 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f29ff342-4ebc-4b0b-8c28-be1570ca45b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:35.824557 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f29ff342-4ebc-4b0b-8c28-be1570ca45b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:35.824988 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f29ff342-4ebc-4b0b-8c28-be1570ca45b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:35.886633 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f29ff342-4ebc-4b0b-8c28-be1570ca45b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:35.895875 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f29ff342-4ebc-4b0b-8c28-be1570ca45b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:35.897361 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f29ff342-4ebc-4b0b-8c28-be1570ca45b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:35.898526 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f29ff342-4ebc-4b0b-8c28-be1570ca45b2 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.087037 Jul 26 07:47:35.899077 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1081/2119] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:35 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:35.915076 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ea85f2f6-86ea-432f-ab82-7702d07bfbde tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:35.923400 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ea85f2f6-86ea-432f-ab82-7702d07bfbde tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.154217 Jul 26 07:47:35.923962 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1039/2120] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:35 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:36.924073 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-2918d5fe-b4ae-45c7-9aa9-9dc0fe206fa8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:36.924696 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2918d5fe-b4ae-45c7-9aa9-9dc0fe206fa8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:36.931491 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2918d5fe-b4ae-45c7-9aa9-9dc0fe206fa8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:36.931943 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2918d5fe-b4ae-45c7-9aa9-9dc0fe206fa8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:36.932700 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2918d5fe-b4ae-45c7-9aa9-9dc0fe206fa8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:36.933138 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2918d5fe-b4ae-45c7-9aa9-9dc0fe206fa8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:36.944537 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b15e3682-31ce-40fe-99f3-f36c3f20f207 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:36.945118 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-b15e3682-31ce-40fe-99f3-f36c3f20f207 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:36.952378 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b15e3682-31ce-40fe-99f3-f36c3f20f207 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:36.952867 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b15e3682-31ce-40fe-99f3-f36c3f20f207 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:36.953627 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b15e3682-31ce-40fe-99f3-f36c3f20f207 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:36.954106 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b15e3682-31ce-40fe-99f3-f36c3f20f207 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:37.006484 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2918d5fe-b4ae-45c7-9aa9-9dc0fe206fa8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:37.015215 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2918d5fe-b4ae-45c7-9aa9-9dc0fe206fa8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:37.016689 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2918d5fe-b4ae-45c7-9aa9-9dc0fe206fa8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:37.017899 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-2918d5fe-b4ae-45c7-9aa9-9dc0fe206fa8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.099637 Jul 26 07:47:37.018455 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1082/2121] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:36 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:37.090829 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-b15e3682-31ce-40fe-99f3-f36c3f20f207 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:37.099145 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b15e3682-31ce-40fe-99f3-f36c3f20f207 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.158471 Jul 26 07:47:37.099727 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1040/2122] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:36 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:38.044838 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-904068f1-7fd0-4461-83dc-51d39585c941 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:38.045856 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-904068f1-7fd0-4461-83dc-51d39585c941 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:38.056814 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-904068f1-7fd0-4461-83dc-51d39585c941 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:38.057568 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-904068f1-7fd0-4461-83dc-51d39585c941 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:38.059049 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-904068f1-7fd0-4461-83dc-51d39585c941 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:38.059824 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-904068f1-7fd0-4461-83dc-51d39585c941 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:38.120513 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-53710e18-5356-44ba-a731-2f4d97eae366 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:38.121188 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-53710e18-5356-44ba-a731-2f4d97eae366 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:38.128255 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-53710e18-5356-44ba-a731-2f4d97eae366 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:38.128400 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-53710e18-5356-44ba-a731-2f4d97eae366 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:38.129253 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-53710e18-5356-44ba-a731-2f4d97eae366 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:38.129689 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-53710e18-5356-44ba-a731-2f4d97eae366 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:38.130394 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-904068f1-7fd0-4461-83dc-51d39585c941 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:38.139186 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-904068f1-7fd0-4461-83dc-51d39585c941 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:38.140699 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-904068f1-7fd0-4461-83dc-51d39585c941 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:38.141960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-904068f1-7fd0-4461-83dc-51d39585c941 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.103633 Jul 26 07:47:38.142519 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1083/2123] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:38 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:38.260935 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-53710e18-5356-44ba-a731-2f4d97eae366 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:38.270136 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-53710e18-5356-44ba-a731-2f4d97eae366 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.153456 Jul 26 07:47:38.270750 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1041/2124] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:38 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:39.168774 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b1f1cbef-37d6-49ec-95ac-02a10316e1f8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:39.169791 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b1f1cbef-37d6-49ec-95ac-02a10316e1f8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:39.177709 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b1f1cbef-37d6-49ec-95ac-02a10316e1f8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:39.178198 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b1f1cbef-37d6-49ec-95ac-02a10316e1f8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:39.178961 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b1f1cbef-37d6-49ec-95ac-02a10316e1f8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:39.179395 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b1f1cbef-37d6-49ec-95ac-02a10316e1f8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:39.243399 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-b1f1cbef-37d6-49ec-95ac-02a10316e1f8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:39.254387 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-b1f1cbef-37d6-49ec-95ac-02a10316e1f8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:39.255872 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-b1f1cbef-37d6-49ec-95ac-02a10316e1f8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:39.257024 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b1f1cbef-37d6-49ec-95ac-02a10316e1f8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.094931 Jul 26 07:47:39.257584 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1084/2125] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:39 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:39.291159 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-16c14393-9328-4152-95a1-21a2d86a2369 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:39.291771 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-16c14393-9328-4152-95a1-21a2d86a2369 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:39.298964 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-16c14393-9328-4152-95a1-21a2d86a2369 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:39.299404 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-16c14393-9328-4152-95a1-21a2d86a2369 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:39.300161 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-16c14393-9328-4152-95a1-21a2d86a2369 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:39.300593 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-16c14393-9328-4152-95a1-21a2d86a2369 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:39.440250 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-16c14393-9328-4152-95a1-21a2d86a2369 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:39.448590 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-16c14393-9328-4152-95a1-21a2d86a2369 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.161264 Jul 26 07:47:39.449153 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1042/2126] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:39 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:40.284276 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-0dbd4569-fdc1-4fed-a78f-a69dc8011f80 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:40.285220 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-0dbd4569-fdc1-4fed-a78f-a69dc8011f80 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:40.296316 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0dbd4569-fdc1-4fed-a78f-a69dc8011f80 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:40.297062 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0dbd4569-fdc1-4fed-a78f-a69dc8011f80 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:40.298371 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0dbd4569-fdc1-4fed-a78f-a69dc8011f80 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:40.299080 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0dbd4569-fdc1-4fed-a78f-a69dc8011f80 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:40.305578 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:47:40.368596 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-0dbd4569-fdc1-4fed-a78f-a69dc8011f80 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:40.377503 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-0dbd4569-fdc1-4fed-a78f-a69dc8011f80 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:40.379042 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-0dbd4569-fdc1-4fed-a78f-a69dc8011f80 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:40.380233 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-0dbd4569-fdc1-4fed-a78f-a69dc8011f80 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.102701 Jul 26 07:47:40.380825 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1085/2127] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:40 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:40.470487 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-13181d24-07c6-441a-a30a-32e815fb6ee0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:40.471104 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-13181d24-07c6-441a-a30a-32e815fb6ee0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:40.478082 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-13181d24-07c6-441a-a30a-32e815fb6ee0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:40.478509 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-13181d24-07c6-441a-a30a-32e815fb6ee0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:40.479301 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-13181d24-07c6-441a-a30a-32e815fb6ee0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:40.479743 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-13181d24-07c6-441a-a30a-32e815fb6ee0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:40.615085 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-13181d24-07c6-441a-a30a-32e815fb6ee0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:40.627686 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-13181d24-07c6-441a-a30a-32e815fb6ee0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.160924 Jul 26 07:47:40.628464 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1043/2128] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:40 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:41.408093 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-fdfb7242-3a37-455c-b763-9d237123b49f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:41.408666 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-fdfb7242-3a37-455c-b763-9d237123b49f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:41.415549 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fdfb7242-3a37-455c-b763-9d237123b49f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:41.416014 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fdfb7242-3a37-455c-b763-9d237123b49f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:41.416773 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fdfb7242-3a37-455c-b763-9d237123b49f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:41.417203 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fdfb7242-3a37-455c-b763-9d237123b49f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:41.481881 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-fdfb7242-3a37-455c-b763-9d237123b49f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:41.491060 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-fdfb7242-3a37-455c-b763-9d237123b49f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:41.492569 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-fdfb7242-3a37-455c-b763-9d237123b49f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:41.493771 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-fdfb7242-3a37-455c-b763-9d237123b49f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 200 len: 1444 microversion: 2.20 time: 0.092577 Jul 26 07:47:41.494344 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1086/2129] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:41 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:41.516737 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f3ca4d58-c165-416b-9a82-2f9f11c28730 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '.version_select at 0x7f7f0279d310>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:41.545282 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f3ca4d58-c165-416b-9a82-2f9f11c28730 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1391012606" status: 204 len: 0 microversion: 2.20 time: 0.032038 Jul 26 07:47:41.546007 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1044/2130] 10.222.0.39 () {60 vars in 1262 bytes} [Tue Jul 26 07:47:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1391012606 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 07:47:41.648737 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6d1562e1-3c40-4523-bf46-3c2fd9f6e624 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:41.649345 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-6d1562e1-3c40-4523-bf46-3c2fd9f6e624 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:41.655561 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6d1562e1-3c40-4523-bf46-3c2fd9f6e624 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:41.656008 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6d1562e1-3c40-4523-bf46-3c2fd9f6e624 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:41.656753 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6d1562e1-3c40-4523-bf46-3c2fd9f6e624 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:41.657183 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6d1562e1-3c40-4523-bf46-3c2fd9f6e624 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:41.807156 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-6d1562e1-3c40-4523-bf46-3c2fd9f6e624 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:41.815299 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6d1562e1-3c40-4523-bf46-3c2fd9f6e624 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.170421 Jul 26 07:47:41.815866 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1087/2131] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:41 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:42.377537 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-21fda26d-c30b-4f18-acfe-59cc546df9b3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Action: 'create', calling method: .version_select at 0x7f7f0264b940>, body: {"keypair": {"name": "tempest-keypair-889100571", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNEoYW1/eO6lXKsCb46dw9QxpeZKlhedneH8rz2cuGGDwaVyfnLkAUyR1Vg2RuTzM+IqWK1RF3umF9570RV+BcmjNCxAMyNRq5Wd4Bspw0mUbTcRnZjtN0HSVy6JnZtBg=="}} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:47:42.394447 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.quota [None req-21fda26d-c30b-4f18-acfe-59cc546df9b3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Getting quotas for project 0874292e3f8f4db98adc2b9672f840c4. Resources: {'key_pairs'} {{(pid=117716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 07:47:42.398865 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.quota [None req-21fda26d-c30b-4f18-acfe-59cc546df9b3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Getting quotas for user 08c4ec6a688c4608aa75aaf046933eec and project 0874292e3f8f4db98adc2b9672f840c4. Resources: {'key_pairs'} {{(pid=117716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 07:47:42.423991 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-21fda26d-c30b-4f18-acfe-59cc546df9b3 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.050767 Jul 26 07:47:42.424786 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1045/2132] 10.222.0.39 () {62 vars in 1200 bytes} [Tue Jul 26 07:47:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 07:47:42.836696 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-1bd3f21e-c0b6-4b88-ac7a-8e9900fee070 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:42.837909 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-1bd3f21e-c0b6-4b88-ac7a-8e9900fee070 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:42.844398 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1bd3f21e-c0b6-4b88-ac7a-8e9900fee070 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:42.844850 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1bd3f21e-c0b6-4b88-ac7a-8e9900fee070 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:42.845654 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1bd3f21e-c0b6-4b88-ac7a-8e9900fee070 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:42.846116 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1bd3f21e-c0b6-4b88-ac7a-8e9900fee070 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:43.311448 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-1bd3f21e-c0b6-4b88-ac7a-8e9900fee070 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:43.319938 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-1bd3f21e-c0b6-4b88-ac7a-8e9900fee070 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.486968 Jul 26 07:47:43.320890 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1088/2133] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:42 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:44.063964 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-162c6e6c-0ec6-443c-a90e-6c2a6ba62106 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-600043569", "imageRef": "b9589773-813f-42af-846a-43bcf9d4d002", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3eb2f1c7-e108-4848-b461-2e7a2b4e4128"}], "security_groups": [{"name": "tempest-securitygroup--1001412919"}], "key_name": "tempest-keypair-889100571", "user_data": "}} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:47:44.172068 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.network.neutron [None req-162c6e6c-0ec6-443c-a90e-6c2a6ba62106 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] validate_networks() for [('3eb2f1c7-e108-4848-b461-2e7a2b4e4128', None, None, None, None, None)] {{(pid=117716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 07:47:44.342346 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-93fba069-7a05-4b16-9f86-8d4598ebcf1e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:44.342939 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-93fba069-7a05-4b16-9f86-8d4598ebcf1e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:44.349712 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-93fba069-7a05-4b16-9f86-8d4598ebcf1e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:44.350753 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-93fba069-7a05-4b16-9f86-8d4598ebcf1e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:44.350958 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-93fba069-7a05-4b16-9f86-8d4598ebcf1e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:44.351616 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-93fba069-7a05-4b16-9f86-8d4598ebcf1e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:44.484784 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-93fba069-7a05-4b16-9f86-8d4598ebcf1e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:44.493165 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-93fba069-7a05-4b16-9f86-8d4598ebcf1e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.154834 Jul 26 07:47:44.493844 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1089/2134] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:44 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:44.597554 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-162c6e6c-0ec6-443c-a90e-6c2a6ba62106 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Flavor limits 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 07:47:44.598012 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-162c6e6c-0ec6-443c-a90e-6c2a6ba62106 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Image limits 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 07:47:44.598479 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-162c6e6c-0ec6-443c-a90e-6c2a6ba62106 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Flavor pref 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 07:47:44.598905 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-162c6e6c-0ec6-443c-a90e-6c2a6ba62106 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Image pref 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 07:47:44.599287 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-162c6e6c-0ec6-443c-a90e-6c2a6ba62106 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 07:47:44.608350 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-162c6e6c-0ec6-443c-a90e-6c2a6ba62106 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:44.608821 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-162c6e6c-0ec6-443c-a90e-6c2a6ba62106 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:44.609617 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-162c6e6c-0ec6-443c-a90e-6c2a6ba62106 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:44.610089 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-162c6e6c-0ec6-443c-a90e-6c2a6ba62106 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:44.626772 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.quota [None req-162c6e6c-0ec6-443c-a90e-6c2a6ba62106 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Getting quotas for project 0874292e3f8f4db98adc2b9672f840c4. Resources: {'instances', 'cores', 'ram'} {{(pid=117716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 07:47:44.630786 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.quota [None req-162c6e6c-0ec6-443c-a90e-6c2a6ba62106 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Getting quotas for user 08c4ec6a688c4608aa75aaf046933eec and project 0874292e3f8f4db98adc2b9672f840c4. Resources: {'instances', 'cores', 'ram'} {{(pid=117716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 07:47:44.641892 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-162c6e6c-0ec6-443c-a90e-6c2a6ba62106 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Going to run 1 instances... {{(pid=117716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 07:47:44.644125 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-162c6e6c-0ec6-443c-a90e-6c2a6ba62106 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: f0b6d555-ab62-4953-8aba-15a44bcfd3cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9589773-813f-42af-846a-43bcf9d4d002',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 07:47:44.693448 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-162c6e6c-0ec6-443c-a90e-6c2a6ba62106 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.634456 Jul 26 07:47:44.694128 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1046/2135] 10.222.0.39 () {62 vars in 1188 bytes} [Tue Jul 26 07:47:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 07:47:44.705502 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c4524c6c-e672-473b-8613-5f3ee345d190 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:44.706140 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c4524c6c-e672-473b-8613-5f3ee345d190 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: f0b6d555-ab62-4953-8aba-15a44bcfd3cb] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:44.758782 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c4524c6c-e672-473b-8613-5f3ee345d190 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:44.766349 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c4524c6c-e672-473b-8613-5f3ee345d190 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:44.767923 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c4524c6c-e672-473b-8613-5f3ee345d190 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:44.769042 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c4524c6c-e672-473b-8613-5f3ee345d190 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/f0b6d555-ab62-4953-8aba-15a44bcfd3cb" status: 200 len: 1280 microversion: 2.20 time: 0.067919 Jul 26 07:47:44.769612 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1090/2136] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:44 2022] GET /compute/v2.1/servers/f0b6d555-ab62-4953-8aba-15a44bcfd3cb => generated 1280 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:45.519710 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-cbc0ba8f-8a1f-488b-bafa-ea925933d813 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:45.520715 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-cbc0ba8f-8a1f-488b-bafa-ea925933d813 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:45.532371 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cbc0ba8f-8a1f-488b-bafa-ea925933d813 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:45.533208 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cbc0ba8f-8a1f-488b-bafa-ea925933d813 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:45.534005 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cbc0ba8f-8a1f-488b-bafa-ea925933d813 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:45.534443 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cbc0ba8f-8a1f-488b-bafa-ea925933d813 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:45.667961 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-cbc0ba8f-8a1f-488b-bafa-ea925933d813 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:45.676397 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-cbc0ba8f-8a1f-488b-bafa-ea925933d813 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.164153 Jul 26 07:47:45.676974 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1047/2137] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:45 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:45.791828 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-63300080-0414-484b-8b51-d7f098556485 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:45.793183 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-63300080-0414-484b-8b51-d7f098556485 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: f0b6d555-ab62-4953-8aba-15a44bcfd3cb] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:45.799854 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-63300080-0414-484b-8b51-d7f098556485 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:45.800569 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-63300080-0414-484b-8b51-d7f098556485 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:45.801341 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-63300080-0414-484b-8b51-d7f098556485 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:45.801804 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-63300080-0414-484b-8b51-d7f098556485 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:45.869777 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-63300080-0414-484b-8b51-d7f098556485 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:45.878643 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-63300080-0414-484b-8b51-d7f098556485 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:45.881277 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-63300080-0414-484b-8b51-d7f098556485 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:45.882430 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-63300080-0414-484b-8b51-d7f098556485 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/f0b6d555-ab62-4953-8aba-15a44bcfd3cb" status: 200 len: 1350 microversion: 2.20 time: 0.095039 Jul 26 07:47:45.897384 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1091/2138] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:45 2022] GET /compute/v2.1/servers/f0b6d555-ab62-4953-8aba-15a44bcfd3cb => generated 1350 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:46.699876 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-815a3dfa-3bcb-4bbf-864e-d30ff5245467 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:46.700475 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-815a3dfa-3bcb-4bbf-864e-d30ff5245467 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:46.707825 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-815a3dfa-3bcb-4bbf-864e-d30ff5245467 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:46.708254 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-815a3dfa-3bcb-4bbf-864e-d30ff5245467 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:46.709086 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-815a3dfa-3bcb-4bbf-864e-d30ff5245467 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:46.709532 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-815a3dfa-3bcb-4bbf-864e-d30ff5245467 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:46.904691 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-faf5efcf-8e0c-40e4-a24a-ca912955bde8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:46.905429 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-faf5efcf-8e0c-40e4-a24a-ca912955bde8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: f0b6d555-ab62-4953-8aba-15a44bcfd3cb] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:46.912417 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-faf5efcf-8e0c-40e4-a24a-ca912955bde8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:46.912863 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-faf5efcf-8e0c-40e4-a24a-ca912955bde8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:46.913632 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-faf5efcf-8e0c-40e4-a24a-ca912955bde8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:46.914167 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-faf5efcf-8e0c-40e4-a24a-ca912955bde8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:46.930620 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-815a3dfa-3bcb-4bbf-864e-d30ff5245467 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:46.939779 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-815a3dfa-3bcb-4bbf-864e-d30ff5245467 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.243644 Jul 26 07:47:46.941197 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1048/2139] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:46 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:47.065042 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-faf5efcf-8e0c-40e4-a24a-ca912955bde8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:47.091586 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-faf5efcf-8e0c-40e4-a24a-ca912955bde8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:47.099533 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-faf5efcf-8e0c-40e4-a24a-ca912955bde8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:47.100923 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-faf5efcf-8e0c-40e4-a24a-ca912955bde8 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/f0b6d555-ab62-4953-8aba-15a44bcfd3cb" status: 200 len: 1406 microversion: 2.20 time: 0.200256 Jul 26 07:47:47.102752 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1092/2140] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:46 2022] GET /compute/v2.1/servers/f0b6d555-ab62-4953-8aba-15a44bcfd3cb => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:47.278939 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-c756544e-bb25-4168-aaf5-30f352fd606a req-08725161-b51f-42c6-8a1e-dd121e434e1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0b6d555-ab62-4953-8aba-15a44bcfd3cb", "tag": "f9a41384-2f3f-4a98-92c3-9954d24c34c5"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:47:47.291347 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-c756544e-bb25-4168-aaf5-30f352fd606a req-08725161-b51f-42c6-8a1e-dd121e434e1b service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:47.291839 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-c756544e-bb25-4168-aaf5-30f352fd606a req-08725161-b51f-42c6-8a1e-dd121e434e1b service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:47.305533 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-c756544e-bb25-4168-aaf5-30f352fd606a req-08725161-b51f-42c6-8a1e-dd121e434e1b service nova] Creating event network-changed:f9a41384-2f3f-4a98-92c3-9954d24c34c5 for instance f0b6d555-ab62-4953-8aba-15a44bcfd3cb on hv-cinder-85083 Jul 26 07:47:47.315771 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-c756544e-bb25-4168-aaf5-30f352fd606a req-08725161-b51f-42c6-8a1e-dd121e434e1b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040871 Jul 26 07:47:47.316390 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1049/2141] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:47:47.962502 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8fc38d11-08c1-44bb-9015-92b8a0e79658 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:47.963062 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8fc38d11-08c1-44bb-9015-92b8a0e79658 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:47.969709 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8fc38d11-08c1-44bb-9015-92b8a0e79658 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:47.970308 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8fc38d11-08c1-44bb-9015-92b8a0e79658 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:47.971072 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8fc38d11-08c1-44bb-9015-92b8a0e79658 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:47.971506 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8fc38d11-08c1-44bb-9015-92b8a0e79658 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:48.101774 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-8fc38d11-08c1-44bb-9015-92b8a0e79658 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:48.110175 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8fc38d11-08c1-44bb-9015-92b8a0e79658 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.151663 Jul 26 07:47:48.110731 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1093/2142] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:47 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:48.124505 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-bfebe390-9e05-4bb4-8fc3-7f7a2b50bd64 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:48.125176 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-bfebe390-9e05-4bb4-8fc3-7f7a2b50bd64 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: f0b6d555-ab62-4953-8aba-15a44bcfd3cb] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:48.132452 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bfebe390-9e05-4bb4-8fc3-7f7a2b50bd64 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:48.132897 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bfebe390-9e05-4bb4-8fc3-7f7a2b50bd64 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:48.133650 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bfebe390-9e05-4bb4-8fc3-7f7a2b50bd64 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:48.134118 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bfebe390-9e05-4bb4-8fc3-7f7a2b50bd64 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:48.285194 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-bfebe390-9e05-4bb4-8fc3-7f7a2b50bd64 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:48.293452 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-bfebe390-9e05-4bb4-8fc3-7f7a2b50bd64 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:48.294990 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-bfebe390-9e05-4bb4-8fc3-7f7a2b50bd64 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:48.296109 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-bfebe390-9e05-4bb4-8fc3-7f7a2b50bd64 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/f0b6d555-ab62-4953-8aba-15a44bcfd3cb" status: 200 len: 1406 microversion: 2.20 time: 0.175899 Jul 26 07:47:48.296669 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1050/2143] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:48 2022] GET /compute/v2.1/servers/f0b6d555-ab62-4953-8aba-15a44bcfd3cb => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:49.137542 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7d81b740-f5d1-4847-a0a1-e32489a95c81 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:49.138584 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7d81b740-f5d1-4847-a0a1-e32489a95c81 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:49.149587 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7d81b740-f5d1-4847-a0a1-e32489a95c81 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:49.150389 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7d81b740-f5d1-4847-a0a1-e32489a95c81 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:49.151623 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7d81b740-f5d1-4847-a0a1-e32489a95c81 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:49.152341 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7d81b740-f5d1-4847-a0a1-e32489a95c81 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:49.302903 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7d81b740-f5d1-4847-a0a1-e32489a95c81 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:49.311344 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7d81b740-f5d1-4847-a0a1-e32489a95c81 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.180283 Jul 26 07:47:49.311951 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1094/2144] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:49 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:49.318387 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-24ce995d-be14-4bdf-a9a0-3fa90c197657 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:49.319011 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-24ce995d-be14-4bdf-a9a0-3fa90c197657 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: f0b6d555-ab62-4953-8aba-15a44bcfd3cb] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:49.325895 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-24ce995d-be14-4bdf-a9a0-3fa90c197657 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:49.326349 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-24ce995d-be14-4bdf-a9a0-3fa90c197657 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:49.327440 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-24ce995d-be14-4bdf-a9a0-3fa90c197657 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:49.327873 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-24ce995d-be14-4bdf-a9a0-3fa90c197657 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:49.467802 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-24ce995d-be14-4bdf-a9a0-3fa90c197657 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:49.476093 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-24ce995d-be14-4bdf-a9a0-3fa90c197657 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:49.477622 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-24ce995d-be14-4bdf-a9a0-3fa90c197657 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:49.478766 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-24ce995d-be14-4bdf-a9a0-3fa90c197657 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/f0b6d555-ab62-4953-8aba-15a44bcfd3cb" status: 200 len: 1406 microversion: 2.20 time: 0.164282 Jul 26 07:47:49.479336 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1051/2145] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:49 2022] GET /compute/v2.1/servers/f0b6d555-ab62-4953-8aba-15a44bcfd3cb => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:50.332675 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-4bca026a-c5df-415d-a1bb-1773a2d13d06 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:50.333294 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-4bca026a-c5df-415d-a1bb-1773a2d13d06 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:50.339960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4bca026a-c5df-415d-a1bb-1773a2d13d06 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:50.340404 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4bca026a-c5df-415d-a1bb-1773a2d13d06 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:50.341151 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4bca026a-c5df-415d-a1bb-1773a2d13d06 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:50.341577 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4bca026a-c5df-415d-a1bb-1773a2d13d06 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:50.476011 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-4bca026a-c5df-415d-a1bb-1773a2d13d06 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:50.484139 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-4bca026a-c5df-415d-a1bb-1773a2d13d06 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.155455 Jul 26 07:47:50.484714 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1095/2146] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:50 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:50.500975 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-40a433ab-19a2-4d2a-acf4-e0f1cb56f711 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:50.501653 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-40a433ab-19a2-4d2a-acf4-e0f1cb56f711 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: f0b6d555-ab62-4953-8aba-15a44bcfd3cb] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:50.508547 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-40a433ab-19a2-4d2a-acf4-e0f1cb56f711 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:50.508998 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-40a433ab-19a2-4d2a-acf4-e0f1cb56f711 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:50.509788 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-40a433ab-19a2-4d2a-acf4-e0f1cb56f711 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:50.510224 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-40a433ab-19a2-4d2a-acf4-e0f1cb56f711 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:50.922357 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-40a433ab-19a2-4d2a-acf4-e0f1cb56f711 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:50.930955 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-40a433ab-19a2-4d2a-acf4-e0f1cb56f711 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:50.932439 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-40a433ab-19a2-4d2a-acf4-e0f1cb56f711 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:50.933528 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-40a433ab-19a2-4d2a-acf4-e0f1cb56f711 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/f0b6d555-ab62-4953-8aba-15a44bcfd3cb" status: 200 len: 1406 microversion: 2.20 time: 0.436490 Jul 26 07:47:50.934162 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1052/2147] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:50 2022] GET /compute/v2.1/servers/f0b6d555-ab62-4953-8aba-15a44bcfd3cb => generated 1406 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:51.508018 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-64111927-8367-45bc-8aa7-2caf4bc99226 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:51.508998 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-64111927-8367-45bc-8aa7-2caf4bc99226 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:51.519367 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-64111927-8367-45bc-8aa7-2caf4bc99226 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:51.520061 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-64111927-8367-45bc-8aa7-2caf4bc99226 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:51.521223 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-64111927-8367-45bc-8aa7-2caf4bc99226 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:51.521939 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-64111927-8367-45bc-8aa7-2caf4bc99226 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:51.664690 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-64111927-8367-45bc-8aa7-2caf4bc99226 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:51.673193 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-64111927-8367-45bc-8aa7-2caf4bc99226 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.171231 Jul 26 07:47:51.673906 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1096/2148] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:51 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:51.876983 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-6e3ea1ae-b962-4ed1-8010-de1074c19087 req-5a5e63cc-181b-492f-951d-7803f0c4cb40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0b6d555-ab62-4953-8aba-15a44bcfd3cb", "name": "network-vif-plugged", "status": "completed", "tag": "f9a41384-2f3f-4a98-92c3-9954d24c34c5"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:47:51.886235 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-6e3ea1ae-b962-4ed1-8010-de1074c19087 req-5a5e63cc-181b-492f-951d-7803f0c4cb40 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:51.886675 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-6e3ea1ae-b962-4ed1-8010-de1074c19087 req-5a5e63cc-181b-492f-951d-7803f0c4cb40 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:51.897353 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-6e3ea1ae-b962-4ed1-8010-de1074c19087 req-5a5e63cc-181b-492f-951d-7803f0c4cb40 service nova] Creating event network-vif-plugged:f9a41384-2f3f-4a98-92c3-9954d24c34c5 for instance f0b6d555-ab62-4953-8aba-15a44bcfd3cb on hv-cinder-85083 Jul 26 07:47:51.902223 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-6e3ea1ae-b962-4ed1-8010-de1074c19087 req-5a5e63cc-181b-492f-951d-7803f0c4cb40 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091668 Jul 26 07:47:51.902796 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1053/2149] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:47:51.956931 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-fc0d6308-b97b-48b4-a02c-f384f0b8c1ad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:51.957540 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-fc0d6308-b97b-48b4-a02c-f384f0b8c1ad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: f0b6d555-ab62-4953-8aba-15a44bcfd3cb] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:51.964452 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fc0d6308-b97b-48b4-a02c-f384f0b8c1ad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:51.964911 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fc0d6308-b97b-48b4-a02c-f384f0b8c1ad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:51.965682 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fc0d6308-b97b-48b4-a02c-f384f0b8c1ad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:51.966454 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fc0d6308-b97b-48b4-a02c-f384f0b8c1ad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:52.105934 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-fc0d6308-b97b-48b4-a02c-f384f0b8c1ad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:52.114547 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-fc0d6308-b97b-48b4-a02c-f384f0b8c1ad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:52.116046 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-fc0d6308-b97b-48b4-a02c-f384f0b8c1ad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:52.117158 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-fc0d6308-b97b-48b4-a02c-f384f0b8c1ad tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/f0b6d555-ab62-4953-8aba-15a44bcfd3cb" status: 200 len: 1406 microversion: 2.20 time: 0.164199 Jul 26 07:47:52.117722 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1097/2150] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:51 2022] GET /compute/v2.1/servers/f0b6d555-ab62-4953-8aba-15a44bcfd3cb => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:52.697116 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-080e9834-4a0f-481c-9ee9-041436b56b08 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:52.697686 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-080e9834-4a0f-481c-9ee9-041436b56b08 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:52.706835 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-080e9834-4a0f-481c-9ee9-041436b56b08 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:52.707249 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-080e9834-4a0f-481c-9ee9-041436b56b08 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:52.708032 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-080e9834-4a0f-481c-9ee9-041436b56b08 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:52.708457 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-080e9834-4a0f-481c-9ee9-041436b56b08 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:52.854080 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-080e9834-4a0f-481c-9ee9-041436b56b08 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:52.863018 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-080e9834-4a0f-481c-9ee9-041436b56b08 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.171316 Jul 26 07:47:52.863779 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1054/2151] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:52 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:47:53.142806 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-5e2c02f1-86b0-46c5-bcc8-84a9456ca29b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:53.143369 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-5e2c02f1-86b0-46c5-bcc8-84a9456ca29b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: f0b6d555-ab62-4953-8aba-15a44bcfd3cb] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:53.150757 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5e2c02f1-86b0-46c5-bcc8-84a9456ca29b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:53.151217 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5e2c02f1-86b0-46c5-bcc8-84a9456ca29b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:53.151966 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5e2c02f1-86b0-46c5-bcc8-84a9456ca29b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:53.152396 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5e2c02f1-86b0-46c5-bcc8-84a9456ca29b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:53.293479 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-5e2c02f1-86b0-46c5-bcc8-84a9456ca29b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:53.302043 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-5e2c02f1-86b0-46c5-bcc8-84a9456ca29b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:53.303513 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-5e2c02f1-86b0-46c5-bcc8-84a9456ca29b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:53.304614 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-5e2c02f1-86b0-46c5-bcc8-84a9456ca29b tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/f0b6d555-ab62-4953-8aba-15a44bcfd3cb" status: 200 len: 1406 microversion: 2.20 time: 0.166042 Jul 26 07:47:53.305171 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1098/2152] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:53 2022] GET /compute/v2.1/servers/f0b6d555-ab62-4953-8aba-15a44bcfd3cb => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:53.887567 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-69d50327-0e68-49ca-ae38-97256d6fc3ff tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:53.888667 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-69d50327-0e68-49ca-ae38-97256d6fc3ff tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:53.897263 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-69d50327-0e68-49ca-ae38-97256d6fc3ff tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:53.897647 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-69d50327-0e68-49ca-ae38-97256d6fc3ff tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:53.898414 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-69d50327-0e68-49ca-ae38-97256d6fc3ff tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:53.898883 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-69d50327-0e68-49ca-ae38-97256d6fc3ff tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:54.030386 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-69d50327-0e68-49ca-ae38-97256d6fc3ff tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:54.038682 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-69d50327-0e68-49ca-ae38-97256d6fc3ff tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.157721 Jul 26 07:47:54.039260 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1055/2153] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:53 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:54.331483 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ebe5c2ca-d679-461a-bd0c-c82961a4650c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:54.332415 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ebe5c2ca-d679-461a-bd0c-c82961a4650c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: f0b6d555-ab62-4953-8aba-15a44bcfd3cb] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:54.342993 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ebe5c2ca-d679-461a-bd0c-c82961a4650c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:54.343738 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ebe5c2ca-d679-461a-bd0c-c82961a4650c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:54.344974 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ebe5c2ca-d679-461a-bd0c-c82961a4650c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:54.345682 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ebe5c2ca-d679-461a-bd0c-c82961a4650c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:54.478943 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ebe5c2ca-d679-461a-bd0c-c82961a4650c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:54.486929 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ebe5c2ca-d679-461a-bd0c-c82961a4650c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:54.488404 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ebe5c2ca-d679-461a-bd0c-c82961a4650c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:54.489553 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ebe5c2ca-d679-461a-bd0c-c82961a4650c tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/f0b6d555-ab62-4953-8aba-15a44bcfd3cb" status: 200 len: 1598 microversion: 2.20 time: 0.165003 Jul 26 07:47:54.490138 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1099/2154] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:47:54 2022] GET /compute/v2.1/servers/f0b6d555-ab62-4953-8aba-15a44bcfd3cb => generated 1598 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:47:54.511614 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-316c2a4d-7c4e-4be1-aea0-243134ca0cd4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:54.512106 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-316c2a4d-7c4e-4be1-aea0-243134ca0cd4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: f0b6d555-ab62-4953-8aba-15a44bcfd3cb] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:54.518330 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-316c2a4d-7c4e-4be1-aea0-243134ca0cd4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:54.518773 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-316c2a4d-7c4e-4be1-aea0-243134ca0cd4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:54.519520 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-316c2a4d-7c4e-4be1-aea0-243134ca0cd4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:54.519952 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-316c2a4d-7c4e-4be1-aea0-243134ca0cd4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:54.601026 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-316c2a4d-7c4e-4be1-aea0-243134ca0cd4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/f0b6d555-ab62-4953-8aba-15a44bcfd3cb/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093340 Jul 26 07:47:54.601766 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1056/2155] 10.222.0.39 () {60 vars in 1316 bytes} [Tue Jul 26 07:47:54 2022] GET /compute/v2.1/servers/f0b6d555-ab62-4953-8aba-15a44bcfd3cb/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 07:47:55.059771 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c10bc7e4-0403-4969-8027-0690e6f3a6f5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:55.060392 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c10bc7e4-0403-4969-8027-0690e6f3a6f5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:55.063530 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell0:SELECT=2 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:47:55.068341 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c10bc7e4-0403-4969-8027-0690e6f3a6f5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:55.068783 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c10bc7e4-0403-4969-8027-0690e6f3a6f5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:55.069563 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c10bc7e4-0403-4969-8027-0690e6f3a6f5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:55.070032 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c10bc7e4-0403-4969-8027-0690e6f3a6f5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:55.209040 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c10bc7e4-0403-4969-8027-0690e6f3a6f5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:55.219651 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c10bc7e4-0403-4969-8027-0690e6f3a6f5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.162635 Jul 26 07:47:55.220501 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1100/2156] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:55 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:55.546311 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell0:SELECT=2 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:47:55.547447 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell0:SELECT=10 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:47:55.552356 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-7a4e16c6-c7f2-483a-8fa5-e9074bce67a1 req-3d2fa494-f56b-4216-bd2b-eb3351a4fab8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0b6d555-ab62-4953-8aba-15a44bcfd3cb", "tag": "f9a41384-2f3f-4a98-92c3-9954d24c34c5"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:47:55.562837 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-7a4e16c6-c7f2-483a-8fa5-e9074bce67a1 req-3d2fa494-f56b-4216-bd2b-eb3351a4fab8 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:55.563276 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-7a4e16c6-c7f2-483a-8fa5-e9074bce67a1 req-3d2fa494-f56b-4216-bd2b-eb3351a4fab8 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:55.566978 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=100 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:47:55.575458 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-7a4e16c6-c7f2-483a-8fa5-e9074bce67a1 req-3d2fa494-f56b-4216-bd2b-eb3351a4fab8 service nova] Creating event network-changed:f9a41384-2f3f-4a98-92c3-9954d24c34c5 for instance f0b6d555-ab62-4953-8aba-15a44bcfd3cb on hv-cinder-85083 Jul 26 07:47:55.581149 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-7a4e16c6-c7f2-483a-8fa5-e9074bce67a1 req-3d2fa494-f56b-4216-bd2b-eb3351a4fab8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035558 Jul 26 07:47:55.581851 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1057/2157] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:47:56.242101 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-76f738f1-7351-474e-aa7e-37db25a8eb4c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:56.242720 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-76f738f1-7351-474e-aa7e-37db25a8eb4c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:56.249597 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-76f738f1-7351-474e-aa7e-37db25a8eb4c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:56.250098 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-76f738f1-7351-474e-aa7e-37db25a8eb4c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:56.250855 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-76f738f1-7351-474e-aa7e-37db25a8eb4c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:56.251285 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-76f738f1-7351-474e-aa7e-37db25a8eb4c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:56.389661 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-76f738f1-7351-474e-aa7e-37db25a8eb4c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:56.398273 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-76f738f1-7351-474e-aa7e-37db25a8eb4c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.160216 Jul 26 07:47:56.398871 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1101/2158] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:56 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:57.425537 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-4bf0f51e-ba34-48db-8e63-fc493298b989 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:57.426621 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-4bf0f51e-ba34-48db-8e63-fc493298b989 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:57.437386 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4bf0f51e-ba34-48db-8e63-fc493298b989 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:57.438187 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4bf0f51e-ba34-48db-8e63-fc493298b989 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:57.439451 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4bf0f51e-ba34-48db-8e63-fc493298b989 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:57.439887 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4bf0f51e-ba34-48db-8e63-fc493298b989 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:57.582621 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-4bf0f51e-ba34-48db-8e63-fc493298b989 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:57.590836 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-4bf0f51e-ba34-48db-8e63-fc493298b989 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.173460 Jul 26 07:47:57.591382 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1058/2159] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:57 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:58.612372 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6c2f89ac-2ab8-468d-8b33-866a7e7c1b5e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:58.612982 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-6c2f89ac-2ab8-468d-8b33-866a7e7c1b5e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:58.615433 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=58 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:47:58.620783 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6c2f89ac-2ab8-468d-8b33-866a7e7c1b5e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:58.621239 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6c2f89ac-2ab8-468d-8b33-866a7e7c1b5e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:58.622033 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6c2f89ac-2ab8-468d-8b33-866a7e7c1b5e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:58.622469 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6c2f89ac-2ab8-468d-8b33-866a7e7c1b5e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:58.754296 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-6c2f89ac-2ab8-468d-8b33-866a7e7c1b5e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:58.757897 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=100 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:47:58.763007 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6c2f89ac-2ab8-468d-8b33-866a7e7c1b5e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.154789 Jul 26 07:47:58.763591 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1102/2160] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:58 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:47:59.788552 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ea77d259-9522-47d6-b83d-9c42e716c0b6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:47:59.789580 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ea77d259-9522-47d6-b83d-9c42e716c0b6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:47:59.793453 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:47:59.801109 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ea77d259-9522-47d6-b83d-9c42e716c0b6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:59.801552 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ea77d259-9522-47d6-b83d-9c42e716c0b6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:59.802335 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ea77d259-9522-47d6-b83d-9c42e716c0b6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:47:59.802770 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ea77d259-9522-47d6-b83d-9c42e716c0b6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:47:59.934764 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ea77d259-9522-47d6-b83d-9c42e716c0b6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:47:59.946712 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ea77d259-9522-47d6-b83d-9c42e716c0b6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.164514 Jul 26 07:47:59.947448 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1059/2161] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:47:59 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:00.974783 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-da07737e-11fc-425c-a87c-92bc4425e44c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:00.975504 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-da07737e-11fc-425c-a87c-92bc4425e44c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:00.989793 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-da07737e-11fc-425c-a87c-92bc4425e44c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:00.990566 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-da07737e-11fc-425c-a87c-92bc4425e44c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:00.991312 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-da07737e-11fc-425c-a87c-92bc4425e44c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:00.991842 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-da07737e-11fc-425c-a87c-92bc4425e44c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:01.124796 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-da07737e-11fc-425c-a87c-92bc4425e44c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:01.132971 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-da07737e-11fc-425c-a87c-92bc4425e44c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.164297 Jul 26 07:48:01.133538 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1103/2162] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:00 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:02.156334 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2812f4bd-97ed-455a-b231-5e0965fceb22 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:02.157258 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2812f4bd-97ed-455a-b231-5e0965fceb22 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:02.167916 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2812f4bd-97ed-455a-b231-5e0965fceb22 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:02.168625 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2812f4bd-97ed-455a-b231-5e0965fceb22 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:02.169818 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2812f4bd-97ed-455a-b231-5e0965fceb22 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:02.170536 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2812f4bd-97ed-455a-b231-5e0965fceb22 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:02.313530 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2812f4bd-97ed-455a-b231-5e0965fceb22 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:02.321763 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2812f4bd-97ed-455a-b231-5e0965fceb22 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.171326 Jul 26 07:48:02.322361 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1060/2163] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:02 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:03.347533 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-09f92131-01b3-45ba-9886-e666a8b904ec tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:03.348472 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-09f92131-01b3-45ba-9886-e666a8b904ec tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:03.359620 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-09f92131-01b3-45ba-9886-e666a8b904ec tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:03.360389 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-09f92131-01b3-45ba-9886-e666a8b904ec tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:03.361652 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-09f92131-01b3-45ba-9886-e666a8b904ec tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:03.362421 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-09f92131-01b3-45ba-9886-e666a8b904ec tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:03.506886 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-09f92131-01b3-45ba-9886-e666a8b904ec tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:03.515209 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-09f92131-01b3-45ba-9886-e666a8b904ec tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.174479 Jul 26 07:48:03.515776 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1104/2164] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:03 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:04.540941 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-edee2b33-113b-4e7d-b5d2-95680246311c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:04.541607 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-edee2b33-113b-4e7d-b5d2-95680246311c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:04.549056 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-edee2b33-113b-4e7d-b5d2-95680246311c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:04.549519 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-edee2b33-113b-4e7d-b5d2-95680246311c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:04.550357 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-edee2b33-113b-4e7d-b5d2-95680246311c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:04.550804 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-edee2b33-113b-4e7d-b5d2-95680246311c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:04.696978 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-edee2b33-113b-4e7d-b5d2-95680246311c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:04.705680 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-edee2b33-113b-4e7d-b5d2-95680246311c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.168908 Jul 26 07:48:04.706281 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1061/2165] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:04 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:05.727209 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-0385164d-087c-4e23-a422-24b46d4650e7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:05.727795 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-0385164d-087c-4e23-a422-24b46d4650e7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:05.734962 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0385164d-087c-4e23-a422-24b46d4650e7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:05.735390 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0385164d-087c-4e23-a422-24b46d4650e7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:05.736148 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0385164d-087c-4e23-a422-24b46d4650e7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:05.736579 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0385164d-087c-4e23-a422-24b46d4650e7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:05.870364 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-0385164d-087c-4e23-a422-24b46d4650e7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:05.882884 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-0385164d-087c-4e23-a422-24b46d4650e7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.159339 Jul 26 07:48:05.883600 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1105/2166] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:05 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:06.910493 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-31f7c148-f03f-46fd-9437-f29067da2920 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:06.911175 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-31f7c148-f03f-46fd-9437-f29067da2920 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:06.918900 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-31f7c148-f03f-46fd-9437-f29067da2920 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:06.919404 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-31f7c148-f03f-46fd-9437-f29067da2920 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:06.920240 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-31f7c148-f03f-46fd-9437-f29067da2920 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:06.920717 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-31f7c148-f03f-46fd-9437-f29067da2920 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:07.058367 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-31f7c148-f03f-46fd-9437-f29067da2920 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:07.067384 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-31f7c148-f03f-46fd-9437-f29067da2920 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.162315 Jul 26 07:48:07.067980 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1062/2167] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:06 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:08.093529 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-92bfef8a-7db8-401f-a567-50b1e2f90f32 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:08.097526 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-92bfef8a-7db8-401f-a567-50b1e2f90f32 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:08.105585 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-92bfef8a-7db8-401f-a567-50b1e2f90f32 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:08.106386 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-92bfef8a-7db8-401f-a567-50b1e2f90f32 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:08.107637 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-92bfef8a-7db8-401f-a567-50b1e2f90f32 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:08.108358 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-92bfef8a-7db8-401f-a567-50b1e2f90f32 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:08.253253 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-92bfef8a-7db8-401f-a567-50b1e2f90f32 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:08.261906 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-92bfef8a-7db8-401f-a567-50b1e2f90f32 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.174810 Jul 26 07:48:08.262476 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1106/2168] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:08 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:09.287328 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6e952fef-0ede-4ca4-84a8-bef1820cde49 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:09.288396 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6e952fef-0ede-4ca4-84a8-bef1820cde49 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:09.299357 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6e952fef-0ede-4ca4-84a8-bef1820cde49 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:09.300095 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6e952fef-0ede-4ca4-84a8-bef1820cde49 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:09.301321 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6e952fef-0ede-4ca4-84a8-bef1820cde49 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:09.302110 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6e952fef-0ede-4ca4-84a8-bef1820cde49 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:09.451026 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6e952fef-0ede-4ca4-84a8-bef1820cde49 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:09.459760 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6e952fef-0ede-4ca4-84a8-bef1820cde49 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.179025 Jul 26 07:48:09.460337 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1063/2169] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:09 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:10.480771 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f36ae67c-9956-414d-bb53-54103cb8856f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:10.481375 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f36ae67c-9956-414d-bb53-54103cb8856f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:10.488334 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f36ae67c-9956-414d-bb53-54103cb8856f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:10.488782 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f36ae67c-9956-414d-bb53-54103cb8856f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:10.489539 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f36ae67c-9956-414d-bb53-54103cb8856f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:10.490009 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f36ae67c-9956-414d-bb53-54103cb8856f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:10.622439 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f36ae67c-9956-414d-bb53-54103cb8856f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:10.630606 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f36ae67c-9956-414d-bb53-54103cb8856f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.153811 Jul 26 07:48:10.631177 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1107/2170] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:10 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:11.656072 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-57cdb687-9890-4d89-9f6e-eb7dec146ced tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:11.657028 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-57cdb687-9890-4d89-9f6e-eb7dec146ced tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:11.664441 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-57cdb687-9890-4d89-9f6e-eb7dec146ced tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:11.664896 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-57cdb687-9890-4d89-9f6e-eb7dec146ced tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:11.665656 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-57cdb687-9890-4d89-9f6e-eb7dec146ced tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:11.666198 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-57cdb687-9890-4d89-9f6e-eb7dec146ced tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:11.810509 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-57cdb687-9890-4d89-9f6e-eb7dec146ced tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:11.819098 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-57cdb687-9890-4d89-9f6e-eb7dec146ced tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.169563 Jul 26 07:48:11.819669 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1064/2171] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:11 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:12.844563 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-4b5b613e-69f9-4c98-85a1-94cb63b5d7ba tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:12.845537 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-4b5b613e-69f9-4c98-85a1-94cb63b5d7ba tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:12.856524 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4b5b613e-69f9-4c98-85a1-94cb63b5d7ba tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:12.857297 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4b5b613e-69f9-4c98-85a1-94cb63b5d7ba tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:12.858583 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4b5b613e-69f9-4c98-85a1-94cb63b5d7ba tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:12.859295 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4b5b613e-69f9-4c98-85a1-94cb63b5d7ba tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:13.006838 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-4b5b613e-69f9-4c98-85a1-94cb63b5d7ba tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:13.018958 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-4b5b613e-69f9-4c98-85a1-94cb63b5d7ba tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.180846 Jul 26 07:48:13.019673 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1108/2172] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:12 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:14.044479 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-215604da-6ea3-450d-99e7-ce001a041b52 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:14.045447 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-215604da-6ea3-450d-99e7-ce001a041b52 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:14.055208 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-215604da-6ea3-450d-99e7-ce001a041b52 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:14.055700 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-215604da-6ea3-450d-99e7-ce001a041b52 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:14.056680 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-215604da-6ea3-450d-99e7-ce001a041b52 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:14.057237 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-215604da-6ea3-450d-99e7-ce001a041b52 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:14.203901 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-215604da-6ea3-450d-99e7-ce001a041b52 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:14.212537 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-215604da-6ea3-450d-99e7-ce001a041b52 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.174661 Jul 26 07:48:14.213155 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1065/2173] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:14 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:15.246031 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a3b6d2d2-9e8b-44f8-9122-022c262fc1e0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:15.246979 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a3b6d2d2-9e8b-44f8-9122-022c262fc1e0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:15.255734 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a3b6d2d2-9e8b-44f8-9122-022c262fc1e0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:15.256177 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a3b6d2d2-9e8b-44f8-9122-022c262fc1e0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:15.256924 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a3b6d2d2-9e8b-44f8-9122-022c262fc1e0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:15.257350 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a3b6d2d2-9e8b-44f8-9122-022c262fc1e0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:15.406124 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-a3b6d2d2-9e8b-44f8-9122-022c262fc1e0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:15.414895 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a3b6d2d2-9e8b-44f8-9122-022c262fc1e0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.175405 Jul 26 07:48:15.415459 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1109/2174] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:15 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:16.440139 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8266adb8-54df-43d6-9d93-43556c741e5a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:16.441162 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8266adb8-54df-43d6-9d93-43556c741e5a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:16.452559 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8266adb8-54df-43d6-9d93-43556c741e5a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:16.453302 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8266adb8-54df-43d6-9d93-43556c741e5a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:16.454708 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8266adb8-54df-43d6-9d93-43556c741e5a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:16.455151 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8266adb8-54df-43d6-9d93-43556c741e5a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:16.587904 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8266adb8-54df-43d6-9d93-43556c741e5a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:16.599570 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8266adb8-54df-43d6-9d93-43556c741e5a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.165666 Jul 26 07:48:16.600408 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1066/2175] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:16 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:17.625447 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-cadcebb1-f19d-4dfb-9dfc-4c0c54939e5c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:17.626615 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-cadcebb1-f19d-4dfb-9dfc-4c0c54939e5c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:17.634788 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cadcebb1-f19d-4dfb-9dfc-4c0c54939e5c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:17.635343 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cadcebb1-f19d-4dfb-9dfc-4c0c54939e5c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:17.636207 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cadcebb1-f19d-4dfb-9dfc-4c0c54939e5c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:17.636719 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cadcebb1-f19d-4dfb-9dfc-4c0c54939e5c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:17.789595 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-cadcebb1-f19d-4dfb-9dfc-4c0c54939e5c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:17.800282 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-cadcebb1-f19d-4dfb-9dfc-4c0c54939e5c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.181350 Jul 26 07:48:17.800826 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1110/2176] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:17 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:18.834593 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-986d6b16-f9c1-4467-a178-ab622992d54a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:18.835540 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-986d6b16-f9c1-4467-a178-ab622992d54a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:18.846787 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-986d6b16-f9c1-4467-a178-ab622992d54a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:18.847579 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-986d6b16-f9c1-4467-a178-ab622992d54a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:18.848808 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-986d6b16-f9c1-4467-a178-ab622992d54a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:18.849524 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-986d6b16-f9c1-4467-a178-ab622992d54a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:18.985509 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-986d6b16-f9c1-4467-a178-ab622992d54a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:18.993962 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-986d6b16-f9c1-4467-a178-ab622992d54a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.166297 Jul 26 07:48:18.994540 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1067/2177] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:18 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:20.019463 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-014e4274-fbb2-42ab-8630-bae5f30832c6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:20.020413 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-014e4274-fbb2-42ab-8630-bae5f30832c6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:20.031772 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-014e4274-fbb2-42ab-8630-bae5f30832c6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:20.032522 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-014e4274-fbb2-42ab-8630-bae5f30832c6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:20.033506 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-014e4274-fbb2-42ab-8630-bae5f30832c6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:20.033974 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-014e4274-fbb2-42ab-8630-bae5f30832c6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:20.170139 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-014e4274-fbb2-42ab-8630-bae5f30832c6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:20.178918 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-014e4274-fbb2-42ab-8630-bae5f30832c6 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.166079 Jul 26 07:48:20.179493 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1111/2178] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:20 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:21.204780 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-732c912c-1356-456c-bb21-22f6bad7bb61 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:21.205883 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-732c912c-1356-456c-bb21-22f6bad7bb61 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:21.216925 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-732c912c-1356-456c-bb21-22f6bad7bb61 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:21.217678 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-732c912c-1356-456c-bb21-22f6bad7bb61 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:21.218994 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-732c912c-1356-456c-bb21-22f6bad7bb61 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:21.219722 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-732c912c-1356-456c-bb21-22f6bad7bb61 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:21.354088 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-732c912c-1356-456c-bb21-22f6bad7bb61 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:21.362587 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-732c912c-1356-456c-bb21-22f6bad7bb61 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.164811 Jul 26 07:48:21.363401 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1068/2179] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:21 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:22.388023 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ec35a476-5a77-4921-aee5-a303d97f51d1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:22.388986 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ec35a476-5a77-4921-aee5-a303d97f51d1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:22.396970 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ec35a476-5a77-4921-aee5-a303d97f51d1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:22.397409 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ec35a476-5a77-4921-aee5-a303d97f51d1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:22.398206 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ec35a476-5a77-4921-aee5-a303d97f51d1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:22.398637 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ec35a476-5a77-4921-aee5-a303d97f51d1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:22.534938 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ec35a476-5a77-4921-aee5-a303d97f51d1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:22.545987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ec35a476-5a77-4921-aee5-a303d97f51d1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.164066 Jul 26 07:48:22.546693 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1112/2180] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:22 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:23.571175 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-85d273a5-b3c7-4ed7-bf8c-4344447c9227 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:23.572170 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-85d273a5-b3c7-4ed7-bf8c-4344447c9227 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:23.584121 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-85d273a5-b3c7-4ed7-bf8c-4344447c9227 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:23.584851 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-85d273a5-b3c7-4ed7-bf8c-4344447c9227 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:23.586168 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-85d273a5-b3c7-4ed7-bf8c-4344447c9227 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:23.586879 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-85d273a5-b3c7-4ed7-bf8c-4344447c9227 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:23.727741 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-85d273a5-b3c7-4ed7-bf8c-4344447c9227 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:23.740014 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-85d273a5-b3c7-4ed7-bf8c-4344447c9227 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.175123 Jul 26 07:48:23.741144 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1069/2181] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:23 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:24.766176 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a5e0fbae-4cb4-4e4f-ad77-bf9fed771334 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:24.766989 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a5e0fbae-4cb4-4e4f-ad77-bf9fed771334 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:24.773345 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a5e0fbae-4cb4-4e4f-ad77-bf9fed771334 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:24.773835 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a5e0fbae-4cb4-4e4f-ad77-bf9fed771334 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:24.774591 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a5e0fbae-4cb4-4e4f-ad77-bf9fed771334 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:24.775027 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a5e0fbae-4cb4-4e4f-ad77-bf9fed771334 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:24.912080 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-a5e0fbae-4cb4-4e4f-ad77-bf9fed771334 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:24.920672 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a5e0fbae-4cb4-4e4f-ad77-bf9fed771334 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.158528 Jul 26 07:48:24.921227 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1113/2182] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:24 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:25.946354 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f9d8d8bf-fc7e-4672-8a96-5f95816b8f20 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:25.947277 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-f9d8d8bf-fc7e-4672-8a96-5f95816b8f20 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:25.958165 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f9d8d8bf-fc7e-4672-8a96-5f95816b8f20 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:25.958898 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f9d8d8bf-fc7e-4672-8a96-5f95816b8f20 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:25.960126 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f9d8d8bf-fc7e-4672-8a96-5f95816b8f20 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:25.960837 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f9d8d8bf-fc7e-4672-8a96-5f95816b8f20 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:25.965028 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=73 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:48:26.096797 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-f9d8d8bf-fc7e-4672-8a96-5f95816b8f20 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:26.108980 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f9d8d8bf-fc7e-4672-8a96-5f95816b8f20 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.168790 Jul 26 07:48:26.109731 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1070/2183] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:25 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:27.131216 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-a8ff06a6-6d41-4c14-b25c-72ddad02a657 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:27.131827 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-a8ff06a6-6d41-4c14-b25c-72ddad02a657 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:27.138737 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a8ff06a6-6d41-4c14-b25c-72ddad02a657 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:27.139187 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a8ff06a6-6d41-4c14-b25c-72ddad02a657 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:27.139953 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a8ff06a6-6d41-4c14-b25c-72ddad02a657 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:27.140409 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-a8ff06a6-6d41-4c14-b25c-72ddad02a657 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:27.277679 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-a8ff06a6-6d41-4c14-b25c-72ddad02a657 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:27.286377 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-a8ff06a6-6d41-4c14-b25c-72ddad02a657 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.159121 Jul 26 07:48:27.286943 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1114/2184] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:27 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:28.311828 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-da65230b-89f8-4157-9dfa-c26a6e6c1dc8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:28.312801 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-da65230b-89f8-4157-9dfa-c26a6e6c1dc8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:28.323879 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-da65230b-89f8-4157-9dfa-c26a6e6c1dc8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:28.324621 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-da65230b-89f8-4157-9dfa-c26a6e6c1dc8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:28.325917 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-da65230b-89f8-4157-9dfa-c26a6e6c1dc8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:28.327021 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-da65230b-89f8-4157-9dfa-c26a6e6c1dc8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:28.460545 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-da65230b-89f8-4157-9dfa-c26a6e6c1dc8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:28.468851 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-da65230b-89f8-4157-9dfa-c26a6e6c1dc8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.163760 Jul 26 07:48:28.469426 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1071/2185] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:28 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:29.494320 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-35864dc8-747b-40c2-a7be-4626a7aee036 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:29.495332 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-35864dc8-747b-40c2-a7be-4626a7aee036 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:29.499279 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=26 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:48:29.505702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-35864dc8-747b-40c2-a7be-4626a7aee036 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:29.506177 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-35864dc8-747b-40c2-a7be-4626a7aee036 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:29.506927 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-35864dc8-747b-40c2-a7be-4626a7aee036 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:29.507361 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-35864dc8-747b-40c2-a7be-4626a7aee036 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:29.648874 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-35864dc8-747b-40c2-a7be-4626a7aee036 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:29.657305 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-35864dc8-747b-40c2-a7be-4626a7aee036 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.169570 Jul 26 07:48:29.657954 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1115/2186] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:29 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:30.682805 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-3f18985f-e2bc-4f6e-a34f-a1807fabf046 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:30.683842 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-3f18985f-e2bc-4f6e-a34f-a1807fabf046 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:30.687793 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=26 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:48:30.697107 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3f18985f-e2bc-4f6e-a34f-a1807fabf046 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:30.697798 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3f18985f-e2bc-4f6e-a34f-a1807fabf046 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:30.699093 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3f18985f-e2bc-4f6e-a34f-a1807fabf046 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:30.699814 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3f18985f-e2bc-4f6e-a34f-a1807fabf046 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:30.842135 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-3f18985f-e2bc-4f6e-a34f-a1807fabf046 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:30.850539 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-3f18985f-e2bc-4f6e-a34f-a1807fabf046 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.174211 Jul 26 07:48:30.851107 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1072/2187] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:30 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:31.418321 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-47cb0ef5-a5cb-4f4b-ac65-c606fc736fc5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:31.418892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-47cb0ef5-a5cb-4f4b-ac65-c606fc736fc5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: f0b6d555-ab62-4953-8aba-15a44bcfd3cb] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:31.426217 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-47cb0ef5-a5cb-4f4b-ac65-c606fc736fc5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:31.426665 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-47cb0ef5-a5cb-4f4b-ac65-c606fc736fc5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:31.427423 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-47cb0ef5-a5cb-4f4b-ac65-c606fc736fc5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:31.427890 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-47cb0ef5-a5cb-4f4b-ac65-c606fc736fc5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:31.430355 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=79 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:48:31.452637 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-47cb0ef5-a5cb-4f4b-ac65-c606fc736fc5 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/f0b6d555-ab62-4953-8aba-15a44bcfd3cb/ips" status: 200 len: 152 microversion: 2.20 time: 0.038570 Jul 26 07:48:31.453209 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1116/2188] 10.222.0.39 () {60 vars in 1289 bytes} [Tue Jul 26 07:48:31 2022] GET /compute/v2.1/servers/f0b6d555-ab62-4953-8aba-15a44bcfd3cb/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 07:48:31.875913 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-76759565-c655-4b0b-8535-4b9bdcbd079e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:31.876968 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-76759565-c655-4b0b-8535-4b9bdcbd079e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:31.885408 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-76759565-c655-4b0b-8535-4b9bdcbd079e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:31.886024 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-76759565-c655-4b0b-8535-4b9bdcbd079e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:31.886964 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-76759565-c655-4b0b-8535-4b9bdcbd079e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:31.887507 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-76759565-c655-4b0b-8535-4b9bdcbd079e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:32.029153 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-76759565-c655-4b0b-8535-4b9bdcbd079e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:32.037510 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-76759565-c655-4b0b-8535-4b9bdcbd079e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.168260 Jul 26 07:48:32.038118 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1073/2189] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:31 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:33.062850 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6d6d30bf-86c8-4820-8244-17376bdd0865 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:33.063804 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-6d6d30bf-86c8-4820-8244-17376bdd0865 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:33.075103 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6d6d30bf-86c8-4820-8244-17376bdd0865 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:33.075857 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6d6d30bf-86c8-4820-8244-17376bdd0865 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:33.077509 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6d6d30bf-86c8-4820-8244-17376bdd0865 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:33.078281 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6d6d30bf-86c8-4820-8244-17376bdd0865 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:33.209647 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-6d6d30bf-86c8-4820-8244-17376bdd0865 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:33.217707 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6d6d30bf-86c8-4820-8244-17376bdd0865 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.161474 Jul 26 07:48:33.218296 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1117/2190] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:33 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:34.239951 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0335e582-9ae1-4a5e-8e82-5e3d9e38e417 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:34.240589 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0335e582-9ae1-4a5e-8e82-5e3d9e38e417 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:34.247900 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0335e582-9ae1-4a5e-8e82-5e3d9e38e417 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:34.248354 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0335e582-9ae1-4a5e-8e82-5e3d9e38e417 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:34.249109 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0335e582-9ae1-4a5e-8e82-5e3d9e38e417 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:34.249544 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0335e582-9ae1-4a5e-8e82-5e3d9e38e417 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:34.385147 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0335e582-9ae1-4a5e-8e82-5e3d9e38e417 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:34.393772 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0335e582-9ae1-4a5e-8e82-5e3d9e38e417 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.157853 Jul 26 07:48:34.394380 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1074/2191] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:34 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:35.419499 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-011352ec-35f0-41b7-8060-f070e3bebc6e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:35.420328 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-011352ec-35f0-41b7-8060-f070e3bebc6e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:35.431502 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-011352ec-35f0-41b7-8060-f070e3bebc6e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:35.432261 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-011352ec-35f0-41b7-8060-f070e3bebc6e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:35.433528 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-011352ec-35f0-41b7-8060-f070e3bebc6e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:35.434306 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-011352ec-35f0-41b7-8060-f070e3bebc6e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:35.569271 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-011352ec-35f0-41b7-8060-f070e3bebc6e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:35.577967 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-011352ec-35f0-41b7-8060-f070e3bebc6e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.165159 Jul 26 07:48:35.578539 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1118/2192] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:35 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:36.607936 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-65423110-7188-45e8-8a49-66b56fe25c5c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:36.608921 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-65423110-7188-45e8-8a49-66b56fe25c5c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:36.616663 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-65423110-7188-45e8-8a49-66b56fe25c5c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:36.617106 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-65423110-7188-45e8-8a49-66b56fe25c5c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:36.617892 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-65423110-7188-45e8-8a49-66b56fe25c5c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:36.618318 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-65423110-7188-45e8-8a49-66b56fe25c5c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:36.752704 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-65423110-7188-45e8-8a49-66b56fe25c5c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:36.761092 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-65423110-7188-45e8-8a49-66b56fe25c5c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.159794 Jul 26 07:48:36.761705 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1075/2193] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:36 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:37.786105 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3cc1d882-302f-4537-bf6e-c85a0ca7b00c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:37.787129 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3cc1d882-302f-4537-bf6e-c85a0ca7b00c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:37.798384 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3cc1d882-302f-4537-bf6e-c85a0ca7b00c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:37.799163 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3cc1d882-302f-4537-bf6e-c85a0ca7b00c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:37.800412 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3cc1d882-302f-4537-bf6e-c85a0ca7b00c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:37.801082 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3cc1d882-302f-4537-bf6e-c85a0ca7b00c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:37.939824 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3cc1d882-302f-4537-bf6e-c85a0ca7b00c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:37.947894 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3cc1d882-302f-4537-bf6e-c85a0ca7b00c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.168409 Jul 26 07:48:37.948463 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1119/2194] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:37 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:38.972717 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-3129ea5c-8644-4a72-8551-e63d5d05d76f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:38.973672 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-3129ea5c-8644-4a72-8551-e63d5d05d76f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:38.984869 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3129ea5c-8644-4a72-8551-e63d5d05d76f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:38.985763 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3129ea5c-8644-4a72-8551-e63d5d05d76f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:38.986566 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3129ea5c-8644-4a72-8551-e63d5d05d76f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:38.987001 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3129ea5c-8644-4a72-8551-e63d5d05d76f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:39.117010 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-3129ea5c-8644-4a72-8551-e63d5d05d76f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:39.125196 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-3129ea5c-8644-4a72-8551-e63d5d05d76f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.159100 Jul 26 07:48:39.125772 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1076/2195] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:38 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:40.156944 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-46cbb0c6-e3bc-4da8-bc1b-ffa5949097d9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:40.157959 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-46cbb0c6-e3bc-4da8-bc1b-ffa5949097d9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:40.166053 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-46cbb0c6-e3bc-4da8-bc1b-ffa5949097d9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:40.166587 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-46cbb0c6-e3bc-4da8-bc1b-ffa5949097d9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:40.167476 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-46cbb0c6-e3bc-4da8-bc1b-ffa5949097d9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:40.167989 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-46cbb0c6-e3bc-4da8-bc1b-ffa5949097d9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:40.299423 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-46cbb0c6-e3bc-4da8-bc1b-ffa5949097d9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:40.307474 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-46cbb0c6-e3bc-4da8-bc1b-ffa5949097d9 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.157133 Jul 26 07:48:40.308034 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1120/2196] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:40 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:41.333310 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6c09e836-57e5-4341-9519-0c2576ef6854 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:41.334334 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6c09e836-57e5-4341-9519-0c2576ef6854 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:41.345568 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6c09e836-57e5-4341-9519-0c2576ef6854 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:41.346342 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6c09e836-57e5-4341-9519-0c2576ef6854 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:41.347620 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6c09e836-57e5-4341-9519-0c2576ef6854 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:41.348339 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6c09e836-57e5-4341-9519-0c2576ef6854 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:41.492477 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6c09e836-57e5-4341-9519-0c2576ef6854 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:41.500660 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6c09e836-57e5-4341-9519-0c2576ef6854 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.174508 Jul 26 07:48:41.501232 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1077/2197] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:41 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:42.526047 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-412466ed-e018-4595-bb30-8555ca6b70d8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:42.527106 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-412466ed-e018-4595-bb30-8555ca6b70d8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:42.538221 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-412466ed-e018-4595-bb30-8555ca6b70d8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:42.538971 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-412466ed-e018-4595-bb30-8555ca6b70d8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:42.540251 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-412466ed-e018-4595-bb30-8555ca6b70d8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:42.541145 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-412466ed-e018-4595-bb30-8555ca6b70d8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:42.676213 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-412466ed-e018-4595-bb30-8555ca6b70d8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:42.686125 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-412466ed-e018-4595-bb30-8555ca6b70d8 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.166440 Jul 26 07:48:42.686985 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1121/2198] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:42 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:43.712579 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-3421a439-2a64-4a2a-a09b-588165fef43a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:43.713464 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-3421a439-2a64-4a2a-a09b-588165fef43a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:43.723797 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3421a439-2a64-4a2a-a09b-588165fef43a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:43.724241 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3421a439-2a64-4a2a-a09b-588165fef43a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:43.724989 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3421a439-2a64-4a2a-a09b-588165fef43a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:43.725407 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3421a439-2a64-4a2a-a09b-588165fef43a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:43.864116 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-3421a439-2a64-4a2a-a09b-588165fef43a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:43.876331 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-3421a439-2a64-4a2a-a09b-588165fef43a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.170194 Jul 26 07:48:43.877068 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1078/2199] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:43 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:44.902432 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-df9d35db-a7e4-4251-9326-2cdbca57bc50 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:44.903451 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-df9d35db-a7e4-4251-9326-2cdbca57bc50 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:44.914413 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-df9d35db-a7e4-4251-9326-2cdbca57bc50 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:44.915167 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-df9d35db-a7e4-4251-9326-2cdbca57bc50 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:44.916427 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-df9d35db-a7e4-4251-9326-2cdbca57bc50 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:44.917138 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-df9d35db-a7e4-4251-9326-2cdbca57bc50 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:45.052906 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-df9d35db-a7e4-4251-9326-2cdbca57bc50 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:45.061012 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-df9d35db-a7e4-4251-9326-2cdbca57bc50 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.165093 Jul 26 07:48:45.061564 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1122/2200] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:44 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:46.086426 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-894530b5-df91-4afe-951e-31cd0ce7fbfa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:46.087373 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-894530b5-df91-4afe-951e-31cd0ce7fbfa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:46.098085 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-894530b5-df91-4afe-951e-31cd0ce7fbfa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:46.098531 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-894530b5-df91-4afe-951e-31cd0ce7fbfa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:46.099280 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-894530b5-df91-4afe-951e-31cd0ce7fbfa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:46.099707 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-894530b5-df91-4afe-951e-31cd0ce7fbfa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:46.229727 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-894530b5-df91-4afe-951e-31cd0ce7fbfa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:46.237784 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-894530b5-df91-4afe-951e-31cd0ce7fbfa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.157882 Jul 26 07:48:46.238443 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1079/2201] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:46 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:47.262559 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e3b89522-1930-420a-a4c7-bb8109bae19a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:47.263668 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e3b89522-1930-420a-a4c7-bb8109bae19a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:47.272713 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e3b89522-1930-420a-a4c7-bb8109bae19a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:47.273160 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e3b89522-1930-420a-a4c7-bb8109bae19a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:47.273958 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e3b89522-1930-420a-a4c7-bb8109bae19a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:47.274391 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e3b89522-1930-420a-a4c7-bb8109bae19a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:47.402281 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-e3b89522-1930-420a-a4c7-bb8109bae19a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:47.410449 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e3b89522-1930-420a-a4c7-bb8109bae19a tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.154454 Jul 26 07:48:47.411009 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1123/2202] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:47 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:48.435681 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ea502557-6f1d-4ee3-b723-5a39716aeb63 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:48.436744 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ea502557-6f1d-4ee3-b723-5a39716aeb63 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:48.445557 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ea502557-6f1d-4ee3-b723-5a39716aeb63 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:48.446319 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ea502557-6f1d-4ee3-b723-5a39716aeb63 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:48.447624 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ea502557-6f1d-4ee3-b723-5a39716aeb63 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:48.448428 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ea502557-6f1d-4ee3-b723-5a39716aeb63 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:48.591170 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-ea502557-6f1d-4ee3-b723-5a39716aeb63 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:48.600396 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ea502557-6f1d-4ee3-b723-5a39716aeb63 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.171248 Jul 26 07:48:48.601398 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1080/2203] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:48 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:49.627423 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6064479e-e1e6-4d48-8bec-04e22122e254 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:49.628379 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-6064479e-e1e6-4d48-8bec-04e22122e254 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:49.635549 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6064479e-e1e6-4d48-8bec-04e22122e254 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:49.635998 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6064479e-e1e6-4d48-8bec-04e22122e254 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:49.636764 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6064479e-e1e6-4d48-8bec-04e22122e254 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:49.637196 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6064479e-e1e6-4d48-8bec-04e22122e254 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:49.779399 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-6064479e-e1e6-4d48-8bec-04e22122e254 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:49.787837 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6064479e-e1e6-4d48-8bec-04e22122e254 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.166995 Jul 26 07:48:49.788371 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1124/2204] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:49 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:50.328698 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 07:48:50.329148 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Tue Jul 26 07:48:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 07:48:50.812666 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-54cf3d99-9678-4ce3-9b53-96a7600a89ed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:50.813694 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-54cf3d99-9678-4ce3-9b53-96a7600a89ed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:50.824669 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-54cf3d99-9678-4ce3-9b53-96a7600a89ed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:50.825426 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-54cf3d99-9678-4ce3-9b53-96a7600a89ed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:50.827114 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-54cf3d99-9678-4ce3-9b53-96a7600a89ed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:50.827842 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-54cf3d99-9678-4ce3-9b53-96a7600a89ed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:50.960973 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-54cf3d99-9678-4ce3-9b53-96a7600a89ed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:50.969111 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-54cf3d99-9678-4ce3-9b53-96a7600a89ed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.162981 Jul 26 07:48:50.969677 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1081/2205] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:50 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:51.997811 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-207d2c76-c3f1-47cd-bd4b-866f1c2776f5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:51.998443 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-207d2c76-c3f1-47cd-bd4b-866f1c2776f5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:52.006959 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-207d2c76-c3f1-47cd-bd4b-866f1c2776f5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:52.007410 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-207d2c76-c3f1-47cd-bd4b-866f1c2776f5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:52.008167 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-207d2c76-c3f1-47cd-bd4b-866f1c2776f5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:52.008601 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-207d2c76-c3f1-47cd-bd4b-866f1c2776f5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:52.138239 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-207d2c76-c3f1-47cd-bd4b-866f1c2776f5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:52.147360 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-207d2c76-c3f1-47cd-bd4b-866f1c2776f5 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.153792 Jul 26 07:48:52.147937 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1125/2206] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:51 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:53.171481 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c4aa1de2-c6a8-4663-baf0-771845e5b6cb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:53.172224 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c4aa1de2-c6a8-4663-baf0-771845e5b6cb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:53.179800 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c4aa1de2-c6a8-4663-baf0-771845e5b6cb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:53.180245 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c4aa1de2-c6a8-4663-baf0-771845e5b6cb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:53.180994 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c4aa1de2-c6a8-4663-baf0-771845e5b6cb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:53.181415 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c4aa1de2-c6a8-4663-baf0-771845e5b6cb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:53.313087 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-c4aa1de2-c6a8-4663-baf0-771845e5b6cb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:53.321154 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c4aa1de2-c6a8-4663-baf0-771845e5b6cb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.154264 Jul 26 07:48:53.321696 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1082/2207] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:53 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:54.342835 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-bfcc90dd-cbc2-4f50-b144-94f0ad99d120 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:54.343463 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-bfcc90dd-cbc2-4f50-b144-94f0ad99d120 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:54.351623 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bfcc90dd-cbc2-4f50-b144-94f0ad99d120 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:54.352104 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bfcc90dd-cbc2-4f50-b144-94f0ad99d120 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:54.352860 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bfcc90dd-cbc2-4f50-b144-94f0ad99d120 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:54.353292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bfcc90dd-cbc2-4f50-b144-94f0ad99d120 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:54.489762 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-bfcc90dd-cbc2-4f50-b144-94f0ad99d120 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:54.498152 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-bfcc90dd-cbc2-4f50-b144-94f0ad99d120 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.159428 Jul 26 07:48:54.498714 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1126/2208] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:54 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:55.523358 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6741e685-113b-4843-b37c-9cc523438795 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:55.524364 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6741e685-113b-4843-b37c-9cc523438795 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:55.534621 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6741e685-113b-4843-b37c-9cc523438795 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:55.535360 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6741e685-113b-4843-b37c-9cc523438795 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:55.536606 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6741e685-113b-4843-b37c-9cc523438795 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:55.537320 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6741e685-113b-4843-b37c-9cc523438795 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:55.673818 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6741e685-113b-4843-b37c-9cc523438795 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:55.682324 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6741e685-113b-4843-b37c-9cc523438795 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.165894 Jul 26 07:48:55.682911 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1083/2209] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:55 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:56.708046 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-70f5a666-10a5-4aa2-bf37-4b1ad198bf83 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:56.708612 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-70f5a666-10a5-4aa2-bf37-4b1ad198bf83 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:56.718302 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-70f5a666-10a5-4aa2-bf37-4b1ad198bf83 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:56.718956 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-70f5a666-10a5-4aa2-bf37-4b1ad198bf83 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:56.720105 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-70f5a666-10a5-4aa2-bf37-4b1ad198bf83 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:56.720752 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-70f5a666-10a5-4aa2-bf37-4b1ad198bf83 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:56.859588 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-70f5a666-10a5-4aa2-bf37-4b1ad198bf83 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:56.867947 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-70f5a666-10a5-4aa2-bf37-4b1ad198bf83 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.164909 Jul 26 07:48:56.868540 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1127/2210] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:56 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:57.892887 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-776816ec-fd86-417a-8c8b-94d4ac78fbd1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:57.893946 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-776816ec-fd86-417a-8c8b-94d4ac78fbd1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:57.904962 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-776816ec-fd86-417a-8c8b-94d4ac78fbd1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:57.905711 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-776816ec-fd86-417a-8c8b-94d4ac78fbd1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:57.907008 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-776816ec-fd86-417a-8c8b-94d4ac78fbd1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:57.907729 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-776816ec-fd86-417a-8c8b-94d4ac78fbd1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:57.911289 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=84 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:48:57.994939 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 07:48:57.995493 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Tue Jul 26 07:48:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 07:48:58.042048 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-776816ec-fd86-417a-8c8b-94d4ac78fbd1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:58.050341 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-776816ec-fd86-417a-8c8b-94d4ac78fbd1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.164022 Jul 26 07:48:58.050908 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1084/2211] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:57 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:48:59.076330 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f80211ac-d12d-4445-98e0-274d694a4a39 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:48:59.077592 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f80211ac-d12d-4445-98e0-274d694a4a39 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:48:59.086602 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f80211ac-d12d-4445-98e0-274d694a4a39 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:59.087050 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f80211ac-d12d-4445-98e0-274d694a4a39 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:59.087800 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f80211ac-d12d-4445-98e0-274d694a4a39 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:48:59.088227 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f80211ac-d12d-4445-98e0-274d694a4a39 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:48:59.228191 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f80211ac-d12d-4445-98e0-274d694a4a39 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:48:59.236752 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f80211ac-d12d-4445-98e0-274d694a4a39 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.167483 Jul 26 07:48:59.237312 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1128/2212] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:48:59 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:49:00.262246 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-3dca0427-17b2-40bb-86e0-cf09e9e863d2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:00.263218 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-3dca0427-17b2-40bb-86e0-cf09e9e863d2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:00.274216 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3dca0427-17b2-40bb-86e0-cf09e9e863d2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:00.274947 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3dca0427-17b2-40bb-86e0-cf09e9e863d2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:00.276180 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3dca0427-17b2-40bb-86e0-cf09e9e863d2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:00.276884 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3dca0427-17b2-40bb-86e0-cf09e9e863d2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:00.408664 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-3dca0427-17b2-40bb-86e0-cf09e9e863d2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:00.416968 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-3dca0427-17b2-40bb-86e0-cf09e9e863d2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.161319 Jul 26 07:49:00.417530 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1085/2213] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:49:00 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:49:01.442360 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-fe2ce248-8fc3-49b6-9183-f6b335d0cfc1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:01.443246 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-fe2ce248-8fc3-49b6-9183-f6b335d0cfc1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:01.446880 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=28 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:49:01.456332 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fe2ce248-8fc3-49b6-9183-f6b335d0cfc1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:01.457086 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fe2ce248-8fc3-49b6-9183-f6b335d0cfc1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:01.457896 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fe2ce248-8fc3-49b6-9183-f6b335d0cfc1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:01.458324 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fe2ce248-8fc3-49b6-9183-f6b335d0cfc1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:01.461044 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=76 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:49:01.594129 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-fe2ce248-8fc3-49b6-9183-f6b335d0cfc1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:01.603342 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-fe2ce248-8fc3-49b6-9183-f6b335d0cfc1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.167644 Jul 26 07:49:01.603877 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1129/2214] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:49:01 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:49:02.629069 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d61fd837-a90a-4f5f-9549-8c68938e90cc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:02.629728 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d61fd837-a90a-4f5f-9549-8c68938e90cc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:02.632317 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=28 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:49:02.638396 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d61fd837-a90a-4f5f-9549-8c68938e90cc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:02.638887 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d61fd837-a90a-4f5f-9549-8c68938e90cc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:02.639725 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d61fd837-a90a-4f5f-9549-8c68938e90cc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:02.640206 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d61fd837-a90a-4f5f-9549-8c68938e90cc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:02.777935 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d61fd837-a90a-4f5f-9549-8c68938e90cc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:02.787106 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d61fd837-a90a-4f5f-9549-8c68938e90cc tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.164629 Jul 26 07:49:02.787680 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1086/2215] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:49:02 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:49:03.812653 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7a1b6e7a-10ef-467b-8ac1-f4a277181e76 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:03.813626 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7a1b6e7a-10ef-467b-8ac1-f4a277181e76 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:03.825236 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7a1b6e7a-10ef-467b-8ac1-f4a277181e76 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:03.826417 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7a1b6e7a-10ef-467b-8ac1-f4a277181e76 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:03.827677 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7a1b6e7a-10ef-467b-8ac1-f4a277181e76 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:03.828379 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7a1b6e7a-10ef-467b-8ac1-f4a277181e76 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:03.968329 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7a1b6e7a-10ef-467b-8ac1-f4a277181e76 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:03.976585 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7a1b6e7a-10ef-467b-8ac1-f4a277181e76 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.170862 Jul 26 07:49:03.977138 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1130/2216] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:49:03 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:49:05.002221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d5253a58-c8a2-4e5f-a733-54612684c9d1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:05.003215 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d5253a58-c8a2-4e5f-a733-54612684c9d1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:05.014443 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d5253a58-c8a2-4e5f-a733-54612684c9d1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:05.015183 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d5253a58-c8a2-4e5f-a733-54612684c9d1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:05.017190 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d5253a58-c8a2-4e5f-a733-54612684c9d1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:05.017997 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d5253a58-c8a2-4e5f-a733-54612684c9d1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:05.149550 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d5253a58-c8a2-4e5f-a733-54612684c9d1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:05.157968 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d5253a58-c8a2-4e5f-a733-54612684c9d1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.162374 Jul 26 07:49:05.158549 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1087/2217] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:49:04 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:49:06.183744 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d322ffe8-820d-486f-b533-ebb5acb8a830 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:06.184760 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d322ffe8-820d-486f-b533-ebb5acb8a830 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:06.194268 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d322ffe8-820d-486f-b533-ebb5acb8a830 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:06.194730 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d322ffe8-820d-486f-b533-ebb5acb8a830 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:06.195493 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d322ffe8-820d-486f-b533-ebb5acb8a830 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:06.195932 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d322ffe8-820d-486f-b533-ebb5acb8a830 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:06.339317 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d322ffe8-820d-486f-b533-ebb5acb8a830 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:06.347919 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d322ffe8-820d-486f-b533-ebb5acb8a830 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.170744 Jul 26 07:49:06.348483 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1131/2218] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:49:06 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:49:07.372915 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-026875c6-c820-4564-a42d-edebf705a9f3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:07.373897 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-026875c6-c820-4564-a42d-edebf705a9f3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:07.384954 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-026875c6-c820-4564-a42d-edebf705a9f3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:07.385713 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-026875c6-c820-4564-a42d-edebf705a9f3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:07.387033 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-026875c6-c820-4564-a42d-edebf705a9f3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:07.387764 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-026875c6-c820-4564-a42d-edebf705a9f3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:07.529899 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-026875c6-c820-4564-a42d-edebf705a9f3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:07.538613 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-026875c6-c820-4564-a42d-edebf705a9f3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.172402 Jul 26 07:49:07.539190 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1088/2219] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:49:07 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:49:08.564026 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-696c9ed4-5cac-4680-9c2b-4b60bb35e50b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:08.565038 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-696c9ed4-5cac-4680-9c2b-4b60bb35e50b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:08.572743 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-696c9ed4-5cac-4680-9c2b-4b60bb35e50b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:08.573193 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-696c9ed4-5cac-4680-9c2b-4b60bb35e50b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:08.573997 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-696c9ed4-5cac-4680-9c2b-4b60bb35e50b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:08.574434 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-696c9ed4-5cac-4680-9c2b-4b60bb35e50b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:08.704299 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-696c9ed4-5cac-4680-9c2b-4b60bb35e50b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:08.712799 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-696c9ed4-5cac-4680-9c2b-4b60bb35e50b tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.155385 Jul 26 07:49:08.713383 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1132/2220] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:49:08 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:49:09.738144 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-46108537-eb56-433e-80d7-da6fa5acdf7d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:09.738853 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-46108537-eb56-433e-80d7-da6fa5acdf7d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:09.747841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-46108537-eb56-433e-80d7-da6fa5acdf7d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:09.748435 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-46108537-eb56-433e-80d7-da6fa5acdf7d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:09.749423 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-46108537-eb56-433e-80d7-da6fa5acdf7d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:09.750040 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-46108537-eb56-433e-80d7-da6fa5acdf7d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:09.898956 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-46108537-eb56-433e-80d7-da6fa5acdf7d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:09.907006 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-46108537-eb56-433e-80d7-da6fa5acdf7d tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.175677 Jul 26 07:49:09.907562 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1089/2221] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:49:09 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:49:10.932201 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b00be81a-03dc-45fe-86ad-0d7f93b5de89 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:10.933175 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b00be81a-03dc-45fe-86ad-0d7f93b5de89 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:10.943078 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b00be81a-03dc-45fe-86ad-0d7f93b5de89 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:10.943526 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b00be81a-03dc-45fe-86ad-0d7f93b5de89 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:10.944272 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b00be81a-03dc-45fe-86ad-0d7f93b5de89 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:10.944700 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b00be81a-03dc-45fe-86ad-0d7f93b5de89 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:11.077511 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-b00be81a-03dc-45fe-86ad-0d7f93b5de89 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:11.085631 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b00be81a-03dc-45fe-86ad-0d7f93b5de89 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.159926 Jul 26 07:49:11.086213 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1133/2222] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:49:10 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:49:12.114253 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0070d622-ca69-436b-be4f-ebcccc018cc7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:12.114883 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0070d622-ca69-436b-be4f-ebcccc018cc7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:12.122830 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0070d622-ca69-436b-be4f-ebcccc018cc7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:12.123311 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0070d622-ca69-436b-be4f-ebcccc018cc7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:12.124060 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0070d622-ca69-436b-be4f-ebcccc018cc7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:12.124491 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0070d622-ca69-436b-be4f-ebcccc018cc7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:12.254579 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0070d622-ca69-436b-be4f-ebcccc018cc7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:12.262985 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0070d622-ca69-436b-be4f-ebcccc018cc7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.153349 Jul 26 07:49:12.263557 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1090/2223] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:49:12 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:49:13.287737 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-985f2970-7f1a-45b0-8e0c-74d08b5a85e4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:13.288795 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-985f2970-7f1a-45b0-8e0c-74d08b5a85e4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:13.299825 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-985f2970-7f1a-45b0-8e0c-74d08b5a85e4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:13.300656 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-985f2970-7f1a-45b0-8e0c-74d08b5a85e4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:13.301418 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-985f2970-7f1a-45b0-8e0c-74d08b5a85e4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:13.301889 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-985f2970-7f1a-45b0-8e0c-74d08b5a85e4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:13.445218 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-985f2970-7f1a-45b0-8e0c-74d08b5a85e4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:13.457652 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-985f2970-7f1a-45b0-8e0c-74d08b5a85e4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.176444 Jul 26 07:49:13.458286 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1134/2224] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:49:13 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:49:14.479441 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-13759f84-536d-4705-867f-23d348a8c127 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:14.480070 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-13759f84-536d-4705-867f-23d348a8c127 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:14.487291 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-13759f84-536d-4705-867f-23d348a8c127 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:14.487746 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-13759f84-536d-4705-867f-23d348a8c127 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:14.488510 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-13759f84-536d-4705-867f-23d348a8c127 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:14.488949 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-13759f84-536d-4705-867f-23d348a8c127 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:14.630319 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-13759f84-536d-4705-867f-23d348a8c127 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:14.638959 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-13759f84-536d-4705-867f-23d348a8c127 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.163507 Jul 26 07:49:14.639529 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1091/2225] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:49:14 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:49:15.664338 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-0590cc89-af96-4a71-b89f-b6dddcc05bd3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:15.665278 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-0590cc89-af96-4a71-b89f-b6dddcc05bd3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:15.676359 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0590cc89-af96-4a71-b89f-b6dddcc05bd3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:15.676805 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0590cc89-af96-4a71-b89f-b6dddcc05bd3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:15.677553 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0590cc89-af96-4a71-b89f-b6dddcc05bd3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:15.678016 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0590cc89-af96-4a71-b89f-b6dddcc05bd3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:15.817625 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-0590cc89-af96-4a71-b89f-b6dddcc05bd3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:15.826705 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-0590cc89-af96-4a71-b89f-b6dddcc05bd3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.168905 Jul 26 07:49:15.827269 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1135/2226] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:49:15 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:49:16.687636 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 07:49:16.688971 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Tue Jul 26 07:49:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 07:49:16.851888 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-661c42fc-2641-4fc8-bdcf-75f8bd3cfd10 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:16.852914 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-661c42fc-2641-4fc8-bdcf-75f8bd3cfd10 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:16.863990 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-661c42fc-2641-4fc8-bdcf-75f8bd3cfd10 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:16.864736 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-661c42fc-2641-4fc8-bdcf-75f8bd3cfd10 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:16.866033 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-661c42fc-2641-4fc8-bdcf-75f8bd3cfd10 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:16.866760 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-661c42fc-2641-4fc8-bdcf-75f8bd3cfd10 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:17.001731 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-661c42fc-2641-4fc8-bdcf-75f8bd3cfd10 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:17.010027 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-661c42fc-2641-4fc8-bdcf-75f8bd3cfd10 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.164693 Jul 26 07:49:17.010608 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1092/2227] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:49:16 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:49:18.035464 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-af3193c3-9c4d-4e2c-af6d-80196060a268 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:18.036475 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-af3193c3-9c4d-4e2c-af6d-80196060a268 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:18.047597 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-af3193c3-9c4d-4e2c-af6d-80196060a268 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:18.048342 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-af3193c3-9c4d-4e2c-af6d-80196060a268 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:18.049575 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-af3193c3-9c4d-4e2c-af6d-80196060a268 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:18.050341 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-af3193c3-9c4d-4e2c-af6d-80196060a268 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:18.181389 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-af3193c3-9c4d-4e2c-af6d-80196060a268 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:18.189988 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-af3193c3-9c4d-4e2c-af6d-80196060a268 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.160998 Jul 26 07:49:18.190553 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1136/2228] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:49:18 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:49:19.214732 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a642f5c5-4c8d-4266-a9fe-4c26d65f2755 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:19.215921 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a642f5c5-4c8d-4266-a9fe-4c26d65f2755 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:19.226635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a642f5c5-4c8d-4266-a9fe-4c26d65f2755 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:19.227081 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a642f5c5-4c8d-4266-a9fe-4c26d65f2755 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:19.227827 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a642f5c5-4c8d-4266-a9fe-4c26d65f2755 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:19.228253 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-a642f5c5-4c8d-4266-a9fe-4c26d65f2755 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:19.366342 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a642f5c5-4c8d-4266-a9fe-4c26d65f2755 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:19.374625 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a642f5c5-4c8d-4266-a9fe-4c26d65f2755 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.166509 Jul 26 07:49:19.375227 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1093/2229] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:49:19 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:49:20.402687 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-22d2c653-713d-440e-8d64-f5ad88f21d89 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:20.403639 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-22d2c653-713d-440e-8d64-f5ad88f21d89 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:20.414660 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-22d2c653-713d-440e-8d64-f5ad88f21d89 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:20.415409 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-22d2c653-713d-440e-8d64-f5ad88f21d89 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:20.416652 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-22d2c653-713d-440e-8d64-f5ad88f21d89 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:20.417379 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-22d2c653-713d-440e-8d64-f5ad88f21d89 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:20.556823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-22d2c653-713d-440e-8d64-f5ad88f21d89 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:20.569384 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-22d2c653-713d-440e-8d64-f5ad88f21d89 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.172939 Jul 26 07:49:20.570130 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1137/2230] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:49:20 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:49:21.600614 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c60d3f4b-0396-4494-bb52-8683c19537d2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:21.601419 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c60d3f4b-0396-4494-bb52-8683c19537d2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:21.608301 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c60d3f4b-0396-4494-bb52-8683c19537d2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:21.608742 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c60d3f4b-0396-4494-bb52-8683c19537d2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:21.609491 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c60d3f4b-0396-4494-bb52-8683c19537d2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:21.609961 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c60d3f4b-0396-4494-bb52-8683c19537d2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:21.742428 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-c60d3f4b-0396-4494-bb52-8683c19537d2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:21.754773 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c60d3f4b-0396-4494-bb52-8683c19537d2 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.160342 Jul 26 07:49:21.755505 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1094/2231] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:49:21 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:49:22.778014 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-02662e0d-0af7-4feb-aabc-04d1c85f40a1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:22.778645 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-02662e0d-0af7-4feb-aabc-04d1c85f40a1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:22.784931 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-02662e0d-0af7-4feb-aabc-04d1c85f40a1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:22.785374 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-02662e0d-0af7-4feb-aabc-04d1c85f40a1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:22.786154 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-02662e0d-0af7-4feb-aabc-04d1c85f40a1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:22.786577 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-02662e0d-0af7-4feb-aabc-04d1c85f40a1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:22.928497 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-02662e0d-0af7-4feb-aabc-04d1c85f40a1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:22.940750 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-02662e0d-0af7-4feb-aabc-04d1c85f40a1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.166475 Jul 26 07:49:22.941489 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1138/2232] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:49:22 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:49:23.967616 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-bba28dc3-25ee-4e67-bd2c-e6f112099111 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:23.968618 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-bba28dc3-25ee-4e67-bd2c-e6f112099111 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:23.978305 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bba28dc3-25ee-4e67-bd2c-e6f112099111 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:23.978754 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bba28dc3-25ee-4e67-bd2c-e6f112099111 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:23.979508 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bba28dc3-25ee-4e67-bd2c-e6f112099111 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:23.979939 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bba28dc3-25ee-4e67-bd2c-e6f112099111 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:24.110458 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-bba28dc3-25ee-4e67-bd2c-e6f112099111 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:24.118819 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-bba28dc3-25ee-4e67-bd2c-e6f112099111 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.157807 Jul 26 07:49:24.119401 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1095/2233] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:49:23 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:49:25.150209 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e00d94f7-675d-4690-bad4-ad6288c07fed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:25.150895 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e00d94f7-675d-4690-bad4-ad6288c07fed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:25.157467 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e00d94f7-675d-4690-bad4-ad6288c07fed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:25.157981 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e00d94f7-675d-4690-bad4-ad6288c07fed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:25.158734 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e00d94f7-675d-4690-bad4-ad6288c07fed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:25.159166 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e00d94f7-675d-4690-bad4-ad6288c07fed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:25.295933 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-e00d94f7-675d-4690-bad4-ad6288c07fed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:25.303997 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e00d94f7-675d-4690-bad4-ad6288c07fed tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.159009 Jul 26 07:49:25.304567 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1139/2234] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:49:25 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:49:26.329548 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-32b8d3ad-24b7-4e5e-adc6-20183c6c0491 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:26.330583 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-32b8d3ad-24b7-4e5e-adc6-20183c6c0491 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:26.338832 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-32b8d3ad-24b7-4e5e-adc6-20183c6c0491 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:26.339279 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-32b8d3ad-24b7-4e5e-adc6-20183c6c0491 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:26.340028 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-32b8d3ad-24b7-4e5e-adc6-20183c6c0491 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:26.340463 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-32b8d3ad-24b7-4e5e-adc6-20183c6c0491 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:26.722182 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-32b8d3ad-24b7-4e5e-adc6-20183c6c0491 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:26.730684 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-32b8d3ad-24b7-4e5e-adc6-20183c6c0491 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.408233 Jul 26 07:49:26.731218 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1096/2235] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:49:26 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:49:27.755919 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-164fbeec-64ba-43ee-bb06-4682c90ef8e0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:27.756906 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-164fbeec-64ba-43ee-bb06-4682c90ef8e0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:27.764175 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-164fbeec-64ba-43ee-bb06-4682c90ef8e0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:27.764631 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-164fbeec-64ba-43ee-bb06-4682c90ef8e0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:27.765385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-164fbeec-64ba-43ee-bb06-4682c90ef8e0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:27.765921 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-164fbeec-64ba-43ee-bb06-4682c90ef8e0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:27.901891 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-164fbeec-64ba-43ee-bb06-4682c90ef8e0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:27.910653 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-164fbeec-64ba-43ee-bb06-4682c90ef8e0 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.161254 Jul 26 07:49:27.911207 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1140/2236] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:49:27 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:49:28.935624 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-10965fbf-4bfc-4e58-933c-d4ce9be40287 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:28.936671 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-10965fbf-4bfc-4e58-933c-d4ce9be40287 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:28.946603 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-10965fbf-4bfc-4e58-933c-d4ce9be40287 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:28.947046 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-10965fbf-4bfc-4e58-933c-d4ce9be40287 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:28.947791 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-10965fbf-4bfc-4e58-933c-d4ce9be40287 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:28.948218 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-10965fbf-4bfc-4e58-933c-d4ce9be40287 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:28.951096 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=78 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:49:29.086557 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-10965fbf-4bfc-4e58-933c-d4ce9be40287 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:29.094677 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-10965fbf-4bfc-4e58-933c-d4ce9be40287 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.165636 Jul 26 07:49:29.095218 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1097/2237] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:49:28 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:49:30.119474 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-dc3198a6-0aed-42a6-9a6d-489cff175914 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:30.120441 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-dc3198a6-0aed-42a6-9a6d-489cff175914 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:30.132785 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dc3198a6-0aed-42a6-9a6d-489cff175914 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:30.133530 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dc3198a6-0aed-42a6-9a6d-489cff175914 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:30.134939 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dc3198a6-0aed-42a6-9a6d-489cff175914 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:30.135860 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-dc3198a6-0aed-42a6-9a6d-489cff175914 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:30.279036 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-dc3198a6-0aed-42a6-9a6d-489cff175914 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:30.287206 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-dc3198a6-0aed-42a6-9a6d-489cff175914 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.174627 Jul 26 07:49:30.287774 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1141/2238] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:49:30 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:49:31.309790 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7713a29a-5ca5-42f8-afec-26c3bda40da7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:31.310504 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7713a29a-5ca5-42f8-afec-26c3bda40da7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:31.318177 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7713a29a-5ca5-42f8-afec-26c3bda40da7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:31.319138 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7713a29a-5ca5-42f8-afec-26c3bda40da7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:31.319595 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7713a29a-5ca5-42f8-afec-26c3bda40da7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:31.320019 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7713a29a-5ca5-42f8-afec-26c3bda40da7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:31.470100 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7713a29a-5ca5-42f8-afec-26c3bda40da7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:31.478791 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7713a29a-5ca5-42f8-afec-26c3bda40da7 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.173289 Jul 26 07:49:31.479352 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1098/2239] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:49:31 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:49:31.555799 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3ed908c5-2c97-4620-89a6-9e2e9c986bc1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:31.556370 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3ed908c5-2c97-4620-89a6-9e2e9c986bc1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: f0b6d555-ab62-4953-8aba-15a44bcfd3cb] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:31.558654 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=26 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:49:31.564408 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3ed908c5-2c97-4620-89a6-9e2e9c986bc1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:31.564853 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3ed908c5-2c97-4620-89a6-9e2e9c986bc1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:31.565609 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3ed908c5-2c97-4620-89a6-9e2e9c986bc1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:31.566062 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3ed908c5-2c97-4620-89a6-9e2e9c986bc1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:31.568781 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=78 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:49:31.596393 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3ed908c5-2c97-4620-89a6-9e2e9c986bc1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: f0b6d555-ab62-4953-8aba-15a44bcfd3cb] Going to try to terminate instance {{(pid=117715) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 07:49:31.698107 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3ed908c5-2c97-4620-89a6-9e2e9c986bc1 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f0b6d555-ab62-4953-8aba-15a44bcfd3cb" status: 204 len: 0 microversion: 2.20 time: 0.147516 Jul 26 07:49:31.698589 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1142/2240] 10.222.0.39 () {60 vars in 1280 bytes} [Tue Jul 26 07:49:31 2022] DELETE /compute/v2.1/servers/f0b6d555-ab62-4953-8aba-15a44bcfd3cb => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 07:49:31.708155 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d6594370-9e0d-416f-8bcc-0b1f9705e21f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:31.708765 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d6594370-9e0d-416f-8bcc-0b1f9705e21f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: f0b6d555-ab62-4953-8aba-15a44bcfd3cb] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:31.714994 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d6594370-9e0d-416f-8bcc-0b1f9705e21f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:31.715480 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d6594370-9e0d-416f-8bcc-0b1f9705e21f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:31.716249 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d6594370-9e0d-416f-8bcc-0b1f9705e21f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:31.716686 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d6594370-9e0d-416f-8bcc-0b1f9705e21f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:31.846025 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d6594370-9e0d-416f-8bcc-0b1f9705e21f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:31.858072 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d6594370-9e0d-416f-8bcc-0b1f9705e21f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:31.860394 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d6594370-9e0d-416f-8bcc-0b1f9705e21f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:31.862233 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d6594370-9e0d-416f-8bcc-0b1f9705e21f tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/f0b6d555-ab62-4953-8aba-15a44bcfd3cb" status: 200 len: 1723 microversion: 2.20 time: 0.157892 Jul 26 07:49:31.863010 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1099/2241] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:49:31 2022] GET /compute/v2.1/servers/f0b6d555-ab62-4953-8aba-15a44bcfd3cb => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 07:49:32.504795 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e673a72d-cd45-424d-a440-839652869292 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:32.506034 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e673a72d-cd45-424d-a440-839652869292 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:32.516118 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e673a72d-cd45-424d-a440-839652869292 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:32.516856 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e673a72d-cd45-424d-a440-839652869292 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:32.518155 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e673a72d-cd45-424d-a440-839652869292 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:32.518869 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e673a72d-cd45-424d-a440-839652869292 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:32.662818 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-e673a72d-cd45-424d-a440-839652869292 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:32.671148 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e673a72d-cd45-424d-a440-839652869292 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.173464 Jul 26 07:49:32.671746 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1143/2242] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:49:32 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:49:32.890274 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-41fdb516-eba9-433c-a491-90cacccffa5d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:32.891275 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-41fdb516-eba9-433c-a491-90cacccffa5d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: f0b6d555-ab62-4953-8aba-15a44bcfd3cb] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:32.894920 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=28 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:49:32.904015 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-41fdb516-eba9-433c-a491-90cacccffa5d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:32.904761 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-41fdb516-eba9-433c-a491-90cacccffa5d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:32.906081 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-41fdb516-eba9-433c-a491-90cacccffa5d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:32.906806 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-41fdb516-eba9-433c-a491-90cacccffa5d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:33.040461 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-41fdb516-eba9-433c-a491-90cacccffa5d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:33.052994 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-41fdb516-eba9-433c-a491-90cacccffa5d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:33.054848 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-41fdb516-eba9-433c-a491-90cacccffa5d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:33.056011 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-41fdb516-eba9-433c-a491-90cacccffa5d tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/f0b6d555-ab62-4953-8aba-15a44bcfd3cb" status: 200 len: 1723 microversion: 2.20 time: 0.172335 Jul 26 07:49:33.056576 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1100/2243] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:49:32 2022] GET /compute/v2.1/servers/f0b6d555-ab62-4953-8aba-15a44bcfd3cb => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:49:33.692791 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c8565b05-3fe6-49a3-b92a-c100211d692e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:33.693376 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c8565b05-3fe6-49a3-b92a-c100211d692e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:33.701665 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c8565b05-3fe6-49a3-b92a-c100211d692e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:33.702165 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c8565b05-3fe6-49a3-b92a-c100211d692e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:33.702901 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c8565b05-3fe6-49a3-b92a-c100211d692e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:33.703346 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c8565b05-3fe6-49a3-b92a-c100211d692e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:33.835580 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c8565b05-3fe6-49a3-b92a-c100211d692e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:33.844104 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c8565b05-3fe6-49a3-b92a-c100211d692e tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.155361 Jul 26 07:49:33.844719 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1144/2244] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:49:33 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:49:34.021833 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-55ba8169-e046-450a-9c71-f37b62c5e570 req-55ab2407-d7e8-4718-b427-3f937a5c6994 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0b6d555-ab62-4953-8aba-15a44bcfd3cb", "name": "network-vif-deleted", "tag": "f9a41384-2f3f-4a98-92c3-9954d24c34c5"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:49:34.036632 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-55ba8169-e046-450a-9c71-f37b62c5e570 req-55ab2407-d7e8-4718-b427-3f937a5c6994 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:34.037627 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-55ba8169-e046-450a-9c71-f37b62c5e570 req-55ab2407-d7e8-4718-b427-3f937a5c6994 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:34.051433 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-55ba8169-e046-450a-9c71-f37b62c5e570 req-55ab2407-d7e8-4718-b427-3f937a5c6994 service nova] Creating event network-vif-deleted:f9a41384-2f3f-4a98-92c3-9954d24c34c5 for instance f0b6d555-ab62-4953-8aba-15a44bcfd3cb on hv-cinder-85083 Jul 26 07:49:34.057501 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-55ba8169-e046-450a-9c71-f37b62c5e570 req-55ab2407-d7e8-4718-b427-3f937a5c6994 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107718 Jul 26 07:49:34.058515 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1101/2245] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:49:34.080937 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f0ba6ef2-06ea-4026-ad4b-6a46b7f4df48 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:34.082102 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f0ba6ef2-06ea-4026-ad4b-6a46b7f4df48 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: f0b6d555-ab62-4953-8aba-15a44bcfd3cb] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:34.091677 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f0ba6ef2-06ea-4026-ad4b-6a46b7f4df48 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:34.092317 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f0ba6ef2-06ea-4026-ad4b-6a46b7f4df48 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:34.093178 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f0ba6ef2-06ea-4026-ad4b-6a46b7f4df48 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:34.093683 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f0ba6ef2-06ea-4026-ad4b-6a46b7f4df48 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:34.130438 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f0ba6ef2-06ea-4026-ad4b-6a46b7f4df48 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:34.130868 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f0ba6ef2-06ea-4026-ad4b-6a46b7f4df48 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:34.131315 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.objects.instance [None req-f0ba6ef2-06ea-4026-ad4b-6a46b7f4df48 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lazy-loading 'fault' on Instance uuid f0b6d555-ab62-4953-8aba-15a44bcfd3cb {{(pid=117715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 07:49:34.173806 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f0ba6ef2-06ea-4026-ad4b-6a46b7f4df48 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:34.182759 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f0ba6ef2-06ea-4026-ad4b-6a46b7f4df48 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:34.184325 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f0ba6ef2-06ea-4026-ad4b-6a46b7f4df48 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08c4ec6a688c4608aa75aaf046933eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874292e3f8f4db98adc2b9672f840c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:34.185574 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f0ba6ef2-06ea-4026-ad4b-6a46b7f4df48 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/f0b6d555-ab62-4953-8aba-15a44bcfd3cb" status: 200 len: 1370 microversion: 2.20 time: 0.110851 Jul 26 07:49:34.186259 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1145/2246] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:49:34 2022] GET /compute/v2.1/servers/f0b6d555-ab62-4953-8aba-15a44bcfd3cb => generated 1370 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 07:49:34.866236 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9c727e6f-4eff-43e2-90ab-df9f9de0d9ca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:34.866828 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-9c727e6f-4eff-43e2-90ab-df9f9de0d9ca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:34.873525 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9c727e6f-4eff-43e2-90ab-df9f9de0d9ca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:34.874017 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9c727e6f-4eff-43e2-90ab-df9f9de0d9ca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:34.874735 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9c727e6f-4eff-43e2-90ab-df9f9de0d9ca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:34.875161 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9c727e6f-4eff-43e2-90ab-df9f9de0d9ca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:35.013475 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-9c727e6f-4eff-43e2-90ab-df9f9de0d9ca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:35.023751 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-9c727e6f-4eff-43e2-90ab-df9f9de0d9ca tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.161673 Jul 26 07:49:35.024611 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1102/2247] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:49:34 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:49:35.212851 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-34719a06-3031-4227-b4e6-caafcf3bd6bd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:35.213583 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-34719a06-3031-4227-b4e6-caafcf3bd6bd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: f0b6d555-ab62-4953-8aba-15a44bcfd3cb] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:35.220548 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-34719a06-3031-4227-b4e6-caafcf3bd6bd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:35.220990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-34719a06-3031-4227-b4e6-caafcf3bd6bd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:35.221758 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-34719a06-3031-4227-b4e6-caafcf3bd6bd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:35.222191 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-34719a06-3031-4227-b4e6-caafcf3bd6bd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:35.235686 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.wsgi [None req-34719a06-3031-4227-b4e6-caafcf3bd6bd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] HTTP exception thrown: Instance f0b6d555-ab62-4953-8aba-15a44bcfd3cb could not be found. Jul 26 07:49:35.237310 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-34719a06-3031-4227-b4e6-caafcf3bd6bd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Request method failure captured: Jul 26 07:49:35.237310 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: request: GET /compute/v2.1/servers/f0b6d555-ab62-4953-8aba-15a44bcfd3cb HTTP/1.1 Jul 26 07:49:35.237310 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept: application/json Jul 26 07:49:35.237310 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept-Encoding: identity Jul 26 07:49:35.237310 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Connection: close Jul 26 07:49:35.237310 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Length: 0 Jul 26 07:49:35.237310 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Type: application/json Jul 26 07:49:35.237310 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Host: 10.222.0.39 Jul 26 07:49:35.237310 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Openstack-System-Scope: None Jul 26 07:49:35.237310 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: User-Agent: python-urllib3/1.26.10 Jul 26 07:49:35.237310 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Auth-Token: gAAAAABi35bvGDNo9P2I4uW1-Shojh4HGO1Rppt9NzkCOBk7jC7Yg59Bks6D-2VdTptuPMptM5Wlsb1aJJ8KPWzzT7udn9SD16W5yQq0PzF9cVldZ_vRp9Ln10FG5oAEy3VoanisC8CMcBLVkhKXP_6slgnYPKdW7nxAdOhUTnLvYmW_g2eKqmk Jul 26 07:49:35.237310 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Id: None Jul 26 07:49:35.237310 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Name: None Jul 26 07:49:35.237310 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Identity-Status: Confirmed Jul 26 07:49:35.237310 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Is-Admin-Project: True Jul 26 07:49:35.237310 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 07:49:35.237310 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Id: default Jul 26 07:49:35.237310 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Name: Default Jul 26 07:49:35.237310 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Id: 0874292e3f8f4db98adc2b9672f840c4 Jul 26 07:49:35.237310 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-715304843 Jul 26 07:49:35.237310 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Role: member,reader Jul 26 07:49:35.237310 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Roles: member,reader Jul 26 07:49:35.239249 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0874292e3f8f4db98adc2b9672f840c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0874292e3f8f4db98adc2b9672f840c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0874292e3f8f4db98adc2b9672f840c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0874292e3f8f4db98adc2b9672f840c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:49:35.239249 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant: tempest-AttachVolumeShelveTestJSON-715304843 Jul 26 07:49:35.239249 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Id: 0874292e3f8f4db98adc2b9672f840c4 Jul 26 07:49:35.239249 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-715304843 Jul 26 07:49:35.239249 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User: tempest-AttachVolumeShelveTestJSON-715304843-project Jul 26 07:49:35.239249 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Id: default Jul 26 07:49:35.239249 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Name: Default Jul 26 07:49:35.239249 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Id: 08c4ec6a688c4608aa75aaf046933eec Jul 26 07:49:35.239249 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Name: tempest-AttachVolumeShelveTestJSON-715304843-project Jul 26 07:49:35.239249 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: method: > Jul 26 07:49:35.239249 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: exception: Instance f0b6d555-ab62-4953-8aba-15a44bcfd3cb could not be found. Jul 26 07:49:35.239249 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: action_args: {'id': 'f0b6d555-ab62-4953-8aba-15a44bcfd3cb'} Jul 26 07:49:35.240495 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:49:35.240495 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:49:35.240495 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 07:49:35.240495 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 07:49:35.240495 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 07:49:35.240495 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 07:49:35.240495 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 07:49:35.240495 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 07:49:35.240495 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 07:49:35.240495 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 07:49:35.240495 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0b6d555-ab62-4953-8aba-15a44bcfd3cb could not be found. Jul 26 07:49:35.240495 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:49:35.240495 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:49:35.240495 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:49:35.240495 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:49:35.240495 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:49:35.240495 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:49:35.240495 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:49:35.240495 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:49:35.240495 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:49:35.242361 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:49:35.242361 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 07:49:35.242361 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 07:49:35.242361 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 07:49:35.242361 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 07:49:35.242361 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 07:49:35.242361 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:49:35.242361 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0b6d555-ab62-4953-8aba-15a44bcfd3cb could not be found. Jul 26 07:49:35.242361 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:49:35.242361 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:49:35.242361 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:49:35.242361 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:49:35.242361 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:49:35.242361 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:49:35.242361 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:49:35.242361 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:49:35.242361 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0b6d555-ab62-4953-8aba-15a44bcfd3cb could not be found. Jul 26 07:49:35.242361 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:49:35.244079 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-34719a06-3031-4227-b4e6-caafcf3bd6bd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Returning 404 to user: Instance f0b6d555-ab62-4953-8aba-15a44bcfd3cb could not be found. {{(pid=117715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:49:35.244079 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-34719a06-3031-4227-b4e6-caafcf3bd6bd tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/f0b6d555-ab62-4953-8aba-15a44bcfd3cb" status: 404 len: 111 microversion: 2.20 time: 0.032221 Jul 26 07:49:35.244079 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1146/2248] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:49:35 2022] GET /compute/v2.1/servers/f0b6d555-ab62-4953-8aba-15a44bcfd3cb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 07:49:35.247697 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-3782e7dc-b221-4e7b-b278-ba7085081878 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '.version_select at 0x7f7f0278e1f0>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:35.270138 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-3782e7dc-b221-4e7b-b278-ba7085081878 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-889100571" status: 204 len: 0 microversion: 2.20 time: 0.026308 Jul 26 07:49:35.270689 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1103/2249] 10.222.0.39 () {60 vars in 1259 bytes} [Tue Jul 26 07:49:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-889100571 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 07:49:35.889008 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-5cc09364-b4eb-4f61-8753-207274388f74 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:35.889493 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-5cc09364-b4eb-4f61-8753-207274388f74 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: f0b6d555-ab62-4953-8aba-15a44bcfd3cb] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:35.895878 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5cc09364-b4eb-4f61-8753-207274388f74 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:35.896324 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5cc09364-b4eb-4f61-8753-207274388f74 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:35.897085 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5cc09364-b4eb-4f61-8753-207274388f74 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:35.897506 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5cc09364-b4eb-4f61-8753-207274388f74 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:35.911050 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.wsgi [None req-5cc09364-b4eb-4f61-8753-207274388f74 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] HTTP exception thrown: Instance f0b6d555-ab62-4953-8aba-15a44bcfd3cb could not be found. Jul 26 07:49:35.912645 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-5cc09364-b4eb-4f61-8753-207274388f74 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Request method failure captured: Jul 26 07:49:35.912645 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: request: DELETE /compute/v2.1/servers/f0b6d555-ab62-4953-8aba-15a44bcfd3cb HTTP/1.1 Jul 26 07:49:35.912645 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept: application/json Jul 26 07:49:35.912645 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept-Encoding: identity Jul 26 07:49:35.912645 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Connection: close Jul 26 07:49:35.912645 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Length: 0 Jul 26 07:49:35.912645 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Type: application/json Jul 26 07:49:35.912645 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Host: 10.222.0.39 Jul 26 07:49:35.912645 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Openstack-System-Scope: None Jul 26 07:49:35.912645 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: User-Agent: python-urllib3/1.26.10 Jul 26 07:49:35.912645 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Auth-Token: gAAAAABi35bvGDNo9P2I4uW1-Shojh4HGO1Rppt9NzkCOBk7jC7Yg59Bks6D-2VdTptuPMptM5Wlsb1aJJ8KPWzzT7udn9SD16W5yQq0PzF9cVldZ_vRp9Ln10FG5oAEy3VoanisC8CMcBLVkhKXP_6slgnYPKdW7nxAdOhUTnLvYmW_g2eKqmk Jul 26 07:49:35.912645 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Id: None Jul 26 07:49:35.912645 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Name: None Jul 26 07:49:35.912645 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Identity-Status: Confirmed Jul 26 07:49:35.912645 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Is-Admin-Project: True Jul 26 07:49:35.912645 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 07:49:35.912645 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Id: default Jul 26 07:49:35.912645 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Name: Default Jul 26 07:49:35.912645 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Id: 0874292e3f8f4db98adc2b9672f840c4 Jul 26 07:49:35.912645 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-715304843 Jul 26 07:49:35.912645 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Role: member,reader Jul 26 07:49:35.912645 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Roles: member,reader Jul 26 07:49:35.914502 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0874292e3f8f4db98adc2b9672f840c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0874292e3f8f4db98adc2b9672f840c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0874292e3f8f4db98adc2b9672f840c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0874292e3f8f4db98adc2b9672f840c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:49:35.914502 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant: tempest-AttachVolumeShelveTestJSON-715304843 Jul 26 07:49:35.914502 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Id: 0874292e3f8f4db98adc2b9672f840c4 Jul 26 07:49:35.914502 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-715304843 Jul 26 07:49:35.914502 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User: tempest-AttachVolumeShelveTestJSON-715304843-project Jul 26 07:49:35.914502 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Id: default Jul 26 07:49:35.914502 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Name: Default Jul 26 07:49:35.914502 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Id: 08c4ec6a688c4608aa75aaf046933eec Jul 26 07:49:35.914502 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Name: tempest-AttachVolumeShelveTestJSON-715304843-project Jul 26 07:49:35.914502 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: method: > Jul 26 07:49:35.914502 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: exception: Instance f0b6d555-ab62-4953-8aba-15a44bcfd3cb could not be found. Jul 26 07:49:35.914502 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: action_args: {'id': 'f0b6d555-ab62-4953-8aba-15a44bcfd3cb'} Jul 26 07:49:35.915707 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:49:35.915707 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:49:35.915707 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 07:49:35.915707 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 07:49:35.915707 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 07:49:35.915707 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 07:49:35.915707 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 07:49:35.915707 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 07:49:35.915707 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 07:49:35.915707 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 07:49:35.915707 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0b6d555-ab62-4953-8aba-15a44bcfd3cb could not be found. Jul 26 07:49:35.915707 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:49:35.915707 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:49:35.915707 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:49:35.915707 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:49:35.915707 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:49:35.915707 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:49:35.915707 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:49:35.915707 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:49:35.915707 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:49:35.917814 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:49:35.917814 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 07:49:35.917814 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 07:49:35.917814 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 07:49:35.917814 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 07:49:35.917814 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 07:49:35.917814 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 07:49:35.917814 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 07:49:35.917814 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:49:35.917814 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0b6d555-ab62-4953-8aba-15a44bcfd3cb could not be found. Jul 26 07:49:35.917814 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:49:35.917814 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:49:35.917814 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:49:35.917814 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:49:35.917814 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:49:35.917814 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:49:35.917814 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:49:35.917814 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:49:35.917814 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0b6d555-ab62-4953-8aba-15a44bcfd3cb could not be found. Jul 26 07:49:35.917814 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:49:35.919481 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-5cc09364-b4eb-4f61-8753-207274388f74 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Returning 404 to user: Instance f0b6d555-ab62-4953-8aba-15a44bcfd3cb could not be found. {{(pid=117715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:49:35.919481 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-5cc09364-b4eb-4f61-8753-207274388f74 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f0b6d555-ab62-4953-8aba-15a44bcfd3cb" status: 404 len: 111 microversion: 2.20 time: 0.029178 Jul 26 07:49:35.919481 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1147/2250] 10.222.0.39 () {60 vars in 1280 bytes} [Tue Jul 26 07:49:35 2022] DELETE /compute/v2.1/servers/f0b6d555-ab62-4953-8aba-15a44bcfd3cb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 07:49:35.923375 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-1286fa7d-c10e-4f68-939b-61920e9b2924 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:35.923976 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-1286fa7d-c10e-4f68-939b-61920e9b2924 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: f0b6d555-ab62-4953-8aba-15a44bcfd3cb] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:35.930156 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1286fa7d-c10e-4f68-939b-61920e9b2924 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:35.930600 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1286fa7d-c10e-4f68-939b-61920e9b2924 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:35.931342 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1286fa7d-c10e-4f68-939b-61920e9b2924 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:35.931779 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1286fa7d-c10e-4f68-939b-61920e9b2924 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:35.947317 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.wsgi [None req-1286fa7d-c10e-4f68-939b-61920e9b2924 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] HTTP exception thrown: Instance f0b6d555-ab62-4953-8aba-15a44bcfd3cb could not be found. Jul 26 07:49:35.948994 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-1286fa7d-c10e-4f68-939b-61920e9b2924 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Request method failure captured: Jul 26 07:49:35.948994 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: request: GET /compute/v2.1/servers/f0b6d555-ab62-4953-8aba-15a44bcfd3cb HTTP/1.1 Jul 26 07:49:35.948994 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept: application/json Jul 26 07:49:35.948994 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept-Encoding: identity Jul 26 07:49:35.948994 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Connection: close Jul 26 07:49:35.948994 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Length: 0 Jul 26 07:49:35.948994 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Type: application/json Jul 26 07:49:35.948994 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Host: 10.222.0.39 Jul 26 07:49:35.948994 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Openstack-System-Scope: None Jul 26 07:49:35.948994 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: User-Agent: python-urllib3/1.26.10 Jul 26 07:49:35.948994 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Auth-Token: gAAAAABi35bvGDNo9P2I4uW1-Shojh4HGO1Rppt9NzkCOBk7jC7Yg59Bks6D-2VdTptuPMptM5Wlsb1aJJ8KPWzzT7udn9SD16W5yQq0PzF9cVldZ_vRp9Ln10FG5oAEy3VoanisC8CMcBLVkhKXP_6slgnYPKdW7nxAdOhUTnLvYmW_g2eKqmk Jul 26 07:49:35.948994 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Id: None Jul 26 07:49:35.948994 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Name: None Jul 26 07:49:35.948994 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Identity-Status: Confirmed Jul 26 07:49:35.948994 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Is-Admin-Project: True Jul 26 07:49:35.948994 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 07:49:35.948994 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Id: default Jul 26 07:49:35.948994 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Name: Default Jul 26 07:49:35.948994 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Id: 0874292e3f8f4db98adc2b9672f840c4 Jul 26 07:49:35.948994 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-715304843 Jul 26 07:49:35.948994 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Role: member,reader Jul 26 07:49:35.948994 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Roles: member,reader Jul 26 07:49:35.951201 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0874292e3f8f4db98adc2b9672f840c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0874292e3f8f4db98adc2b9672f840c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0874292e3f8f4db98adc2b9672f840c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0874292e3f8f4db98adc2b9672f840c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:49:35.951201 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant: tempest-AttachVolumeShelveTestJSON-715304843 Jul 26 07:49:35.951201 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Id: 0874292e3f8f4db98adc2b9672f840c4 Jul 26 07:49:35.951201 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-715304843 Jul 26 07:49:35.951201 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User: tempest-AttachVolumeShelveTestJSON-715304843-project Jul 26 07:49:35.951201 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Id: default Jul 26 07:49:35.951201 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Name: Default Jul 26 07:49:35.951201 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Id: 08c4ec6a688c4608aa75aaf046933eec Jul 26 07:49:35.951201 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Name: tempest-AttachVolumeShelveTestJSON-715304843-project Jul 26 07:49:35.951201 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: method: > Jul 26 07:49:35.951201 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: exception: Instance f0b6d555-ab62-4953-8aba-15a44bcfd3cb could not be found. Jul 26 07:49:35.951201 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: action_args: {'id': 'f0b6d555-ab62-4953-8aba-15a44bcfd3cb'} Jul 26 07:49:35.955126 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:49:35.955126 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:49:35.955126 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 07:49:35.955126 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 07:49:35.955126 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 07:49:35.955126 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 07:49:35.955126 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 07:49:35.955126 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 07:49:35.955126 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 07:49:35.955126 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 07:49:35.955126 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0b6d555-ab62-4953-8aba-15a44bcfd3cb could not be found. Jul 26 07:49:35.955126 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:49:35.955126 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:49:35.955126 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:49:35.955126 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:49:35.955126 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:49:35.955126 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:49:35.955126 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:49:35.955126 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:49:35.955126 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:49:35.956743 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:49:35.956743 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 07:49:35.956743 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 07:49:35.956743 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 07:49:35.956743 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 07:49:35.956743 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 07:49:35.956743 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:49:35.956743 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0b6d555-ab62-4953-8aba-15a44bcfd3cb could not be found. Jul 26 07:49:35.956743 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:49:35.956743 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:49:35.956743 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:49:35.956743 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:49:35.956743 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:49:35.956743 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:49:35.956743 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:49:35.956743 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:49:35.956743 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0b6d555-ab62-4953-8aba-15a44bcfd3cb could not be found. Jul 26 07:49:35.956743 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:49:35.958225 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-1286fa7d-c10e-4f68-939b-61920e9b2924 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Returning 404 to user: Instance f0b6d555-ab62-4953-8aba-15a44bcfd3cb could not be found. {{(pid=117716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:49:35.958225 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-1286fa7d-c10e-4f68-939b-61920e9b2924 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/f0b6d555-ab62-4953-8aba-15a44bcfd3cb" status: 404 len: 111 microversion: 2.20 time: 0.031254 Jul 26 07:49:35.958225 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1104/2251] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:49:35 2022] GET /compute/v2.1/servers/f0b6d555-ab62-4953-8aba-15a44bcfd3cb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 07:49:36.050512 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-721285d3-e9b1-4d70-9680-1fcc083ce6e1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:36.051253 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-721285d3-e9b1-4d70-9680-1fcc083ce6e1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:36.060870 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-721285d3-e9b1-4d70-9680-1fcc083ce6e1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:36.061546 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-721285d3-e9b1-4d70-9680-1fcc083ce6e1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:36.062755 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-721285d3-e9b1-4d70-9680-1fcc083ce6e1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:36.063412 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-721285d3-e9b1-4d70-9680-1fcc083ce6e1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:36.216746 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-721285d3-e9b1-4d70-9680-1fcc083ce6e1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:36.225671 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-721285d3-e9b1-4d70-9680-1fcc083ce6e1 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.181196 Jul 26 07:49:36.226267 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1148/2252] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:49:36 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:49:37.250983 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-61f0fb91-339c-4a9f-93a7-f64cfd6d20bf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:37.251980 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-61f0fb91-339c-4a9f-93a7-f64cfd6d20bf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:37.262588 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-61f0fb91-339c-4a9f-93a7-f64cfd6d20bf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:37.263046 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-61f0fb91-339c-4a9f-93a7-f64cfd6d20bf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:37.263841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-61f0fb91-339c-4a9f-93a7-f64cfd6d20bf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:37.264277 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-61f0fb91-339c-4a9f-93a7-f64cfd6d20bf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:37.396410 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-61f0fb91-339c-4a9f-93a7-f64cfd6d20bf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:37.404569 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-61f0fb91-339c-4a9f-93a7-f64cfd6d20bf tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.160086 Jul 26 07:49:37.405064 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1105/2253] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:49:37 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:49:38.429359 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7f103f96-219b-4820-985c-3c48ee79fe48 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:38.430384 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7f103f96-219b-4820-985c-3c48ee79fe48 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:38.438598 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7f103f96-219b-4820-985c-3c48ee79fe48 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:38.439068 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7f103f96-219b-4820-985c-3c48ee79fe48 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:38.439834 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7f103f96-219b-4820-985c-3c48ee79fe48 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:38.440269 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7f103f96-219b-4820-985c-3c48ee79fe48 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:38.571498 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7f103f96-219b-4820-985c-3c48ee79fe48 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:38.580838 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7f103f96-219b-4820-985c-3c48ee79fe48 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.157879 Jul 26 07:49:38.581397 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1149/2254] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:49:38 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:49:39.605295 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-00fac6c1-0ebe-4a3a-b923-394e54e8cd5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:39.606359 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-00fac6c1-0ebe-4a3a-b923-394e54e8cd5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:39.617697 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-00fac6c1-0ebe-4a3a-b923-394e54e8cd5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:39.618525 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-00fac6c1-0ebe-4a3a-b923-394e54e8cd5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:39.619763 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-00fac6c1-0ebe-4a3a-b923-394e54e8cd5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:39.620489 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-00fac6c1-0ebe-4a3a-b923-394e54e8cd5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:39.755885 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-00fac6c1-0ebe-4a3a-b923-394e54e8cd5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:39.764102 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-00fac6c1-0ebe-4a3a-b923-394e54e8cd5f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.165405 Jul 26 07:49:39.764698 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1106/2255] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:49:39 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:49:40.789665 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-38857ac7-16de-4c0b-866a-4bec818c526f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:40.790690 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-38857ac7-16de-4c0b-866a-4bec818c526f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:40.799010 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-38857ac7-16de-4c0b-866a-4bec818c526f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:40.799460 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-38857ac7-16de-4c0b-866a-4bec818c526f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:40.800215 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-38857ac7-16de-4c0b-866a-4bec818c526f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:40.800640 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-38857ac7-16de-4c0b-866a-4bec818c526f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:40.939918 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-38857ac7-16de-4c0b-866a-4bec818c526f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:40.947942 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-38857ac7-16de-4c0b-866a-4bec818c526f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.164751 Jul 26 07:49:40.948471 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1150/2256] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:49:40 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:49:41.972958 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2df011bb-eb90-49e8-a131-343fa2ccb3f3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:41.973940 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2df011bb-eb90-49e8-a131-343fa2ccb3f3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:41.983779 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2df011bb-eb90-49e8-a131-343fa2ccb3f3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:41.984219 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2df011bb-eb90-49e8-a131-343fa2ccb3f3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:41.984967 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2df011bb-eb90-49e8-a131-343fa2ccb3f3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:41.985396 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2df011bb-eb90-49e8-a131-343fa2ccb3f3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:42.123320 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2df011bb-eb90-49e8-a131-343fa2ccb3f3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:42.135204 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2df011bb-eb90-49e8-a131-343fa2ccb3f3 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.168395 Jul 26 07:49:42.135930 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1107/2257] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:49:41 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:49:43.161378 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-71edff89-f18f-48a7-81b9-59efe453f325 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:43.162464 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-71edff89-f18f-48a7-81b9-59efe453f325 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 8172b67c-005b-4f1f-91f0-f6ce67a50ab1] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:49:43.173591 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-71edff89-f18f-48a7-81b9-59efe453f325 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:43.174394 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-71edff89-f18f-48a7-81b9-59efe453f325 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:43.175643 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-71edff89-f18f-48a7-81b9-59efe453f325 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:43.176358 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-71edff89-f18f-48a7-81b9-59efe453f325 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:43.310118 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-71edff89-f18f-48a7-81b9-59efe453f325 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:49:43.318672 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-71edff89-f18f-48a7-81b9-59efe453f325 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1" status: 200 len: 1735 microversion: 2.1 time: 0.163776 Jul 26 07:49:43.319226 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1151/2258] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:49:43 2022] GET /compute/v2.1/servers/8172b67c-005b-4f1f-91f0-f6ce67a50ab1 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:49:43.339670 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-4f6aaad6-5c43-46c7-b1fe-c03575de1855 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '.version_select at 0x7f7f025fcaf0>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:49:43.370312 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-4f6aaad6-5c43-46c7-b1fe-c03575de1855 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1015692343" status: 202 len: 0 microversion: 2.1 time: 0.034418 Jul 26 07:49:43.370860 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1108/2259] 10.222.0.39 () {58 vars in 1221 bytes} [Tue Jul 26 07:49:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1015692343 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 07:49:44.309232 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-89c86d73-bb56-412b-adbc-36f00badb10f req-7a3afc18-d331-4768-b8c8-b36174be6627 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8172b67c-005b-4f1f-91f0-f6ce67a50ab1", "tag": "643ec2f5-7bcc-4a3c-9ca2-bb545c332e35"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:49:44.320311 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-89c86d73-bb56-412b-adbc-36f00badb10f req-7a3afc18-d331-4768-b8c8-b36174be6627 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:49:44.320752 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-89c86d73-bb56-412b-adbc-36f00badb10f req-7a3afc18-d331-4768-b8c8-b36174be6627 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:49:44.333682 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-89c86d73-bb56-412b-adbc-36f00badb10f req-7a3afc18-d331-4768-b8c8-b36174be6627 service nova] Creating event network-changed:643ec2f5-7bcc-4a3c-9ca2-bb545c332e35 for instance 8172b67c-005b-4f1f-91f0-f6ce67a50ab1 on hv-cinder-85083 Jul 26 07:49:44.339257 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-89c86d73-bb56-412b-adbc-36f00badb10f req-7a3afc18-d331-4768-b8c8-b36174be6627 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033740 Jul 26 07:49:44.340453 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1152/2260] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:50:22.968526 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=51 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:50:22.969280 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=2 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:50:22.973350 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-77955687-d4e2-4f58-9954-7aaeb13aeef8 req-f66e5405-8654-4008-93d8-310412c276d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8172b67c-005b-4f1f-91f0-f6ce67a50ab1", "name": "network-vif-deleted", "tag": "643ec2f5-7bcc-4a3c-9ca2-bb545c332e35"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:50:22.985172 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-77955687-d4e2-4f58-9954-7aaeb13aeef8 req-f66e5405-8654-4008-93d8-310412c276d6 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:50:22.985941 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-77955687-d4e2-4f58-9954-7aaeb13aeef8 req-f66e5405-8654-4008-93d8-310412c276d6 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:50:22.996505 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-77955687-d4e2-4f58-9954-7aaeb13aeef8 req-f66e5405-8654-4008-93d8-310412c276d6 service nova] Creating event network-vif-deleted:643ec2f5-7bcc-4a3c-9ca2-bb545c332e35 for instance 8172b67c-005b-4f1f-91f0-f6ce67a50ab1 on hv-cinder-85083 Jul 26 07:50:23.001333 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-77955687-d4e2-4f58-9954-7aaeb13aeef8 req-f66e5405-8654-4008-93d8-310412c276d6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034301 Jul 26 07:50:23.001962 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1109/2261] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:50:47.249289 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 07:50:47.250325 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Tue Jul 26 07:50:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 07:52:10.342799 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 07:52:10.343785 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Tue Jul 26 07:52:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 07:52:17.689762 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 07:52:17.690650 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Tue Jul 26 07:52:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 07:52:18.005030 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 07:52:18.005876 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Tue Jul 26 07:52:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 07:52:22.199836 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cdf51fd0-56a6-4942-afed-0aacdf04f143] AMQP server on 10.222.0.39:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 26 07:52:22.200447 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:22.202000 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:22.206409 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-5b67cb55-1799-4b5e-a2b9-d2d6d513511d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:52:22.206994 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-5b67cb55-1799-4b5e-a2b9-d2d6d513511d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: f7e43c4a-c38a-4da6-9687-d675f7c28f9a] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:52:22.215180 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5b67cb55-1799-4b5e-a2b9-d2d6d513511d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:52:22.215752 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5b67cb55-1799-4b5e-a2b9-d2d6d513511d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:52:22.216722 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5b67cb55-1799-4b5e-a2b9-d2d6d513511d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:52:22.217204 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5b67cb55-1799-4b5e-a2b9-d2d6d513511d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:52:22.233720 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.wsgi [None req-5b67cb55-1799-4b5e-a2b9-d2d6d513511d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] HTTP exception thrown: Instance f7e43c4a-c38a-4da6-9687-d675f7c28f9a could not be found. Jul 26 07:52:22.235491 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-5b67cb55-1799-4b5e-a2b9-d2d6d513511d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Request method failure captured: Jul 26 07:52:22.235491 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: request: DELETE /compute/v2.1/servers/f7e43c4a-c38a-4da6-9687-d675f7c28f9a HTTP/1.1 Jul 26 07:52:22.235491 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept: application/json Jul 26 07:52:22.235491 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept-Encoding: identity Jul 26 07:52:22.235491 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Connection: close Jul 26 07:52:22.235491 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Length: 0 Jul 26 07:52:22.235491 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Type: application/json Jul 26 07:52:22.235491 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Host: 10.222.0.39 Jul 26 07:52:22.235491 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Openstack-System-Scope: None Jul 26 07:52:22.235491 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: User-Agent: python-urllib3/1.26.10 Jul 26 07:52:22.235491 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Auth-Token: gAAAAABi35bp-6MDlHFX6PqBP1JfjI-kDaErGZ8tS4CYMVgobtb4Gv-rSD0l-rBJa-iOQtbMEcv7gnFG6FuqSpAXwRcnDvooOo8YQBTuYFKMeWkJlsSVbvRshSqswhfLq3PM2Jh4Afd8RHIhCtF_ajjZyUKtQPL35KmYg8DZArwcVpy_HW9N5Qc Jul 26 07:52:22.235491 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Id: None Jul 26 07:52:22.235491 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Name: None Jul 26 07:52:22.235491 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Identity-Status: Confirmed Jul 26 07:52:22.235491 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Is-Admin-Project: True Jul 26 07:52:22.235491 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Id: default Jul 26 07:52:22.235491 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Name: Default Jul 26 07:52:22.235491 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Id: 4fa0c5574ef9497ebe29658f8164764c Jul 26 07:52:22.235491 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Name: tempest-AttachVolumeNegativeTest-1485570437 Jul 26 07:52:22.235491 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Role: member,reader Jul 26 07:52:22.235491 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Roles: member,reader Jul 26 07:52:22.237424 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:52:22.237424 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant: tempest-AttachVolumeNegativeTest-1485570437 Jul 26 07:52:22.237424 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Id: 4fa0c5574ef9497ebe29658f8164764c Jul 26 07:52:22.237424 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1485570437 Jul 26 07:52:22.237424 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User: tempest-AttachVolumeNegativeTest-1485570437-project Jul 26 07:52:22.237424 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Id: default Jul 26 07:52:22.237424 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Name: Default Jul 26 07:52:22.237424 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Id: 57029844165f4d83892176fe82594685 Jul 26 07:52:22.237424 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Name: tempest-AttachVolumeNegativeTest-1485570437-project Jul 26 07:52:22.237424 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: method: > Jul 26 07:52:22.237424 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: exception: Instance f7e43c4a-c38a-4da6-9687-d675f7c28f9a could not be found. Jul 26 07:52:22.237424 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: action_args: {'id': 'f7e43c4a-c38a-4da6-9687-d675f7c28f9a'} Jul 26 07:52:22.238529 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:52:22.238529 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:52:22.238529 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 07:52:22.238529 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 07:52:22.238529 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 07:52:22.238529 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 07:52:22.238529 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 07:52:22.238529 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 07:52:22.238529 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 07:52:22.238529 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 07:52:22.238529 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7e43c4a-c38a-4da6-9687-d675f7c28f9a could not be found. Jul 26 07:52:22.238529 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:52:22.238529 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:52:22.238529 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:52:22.238529 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:52:22.238529 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:52:22.238529 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:52:22.238529 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:52:22.238529 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:52:22.238529 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:52:22.240037 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:52:22.240037 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 07:52:22.240037 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 07:52:22.240037 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 07:52:22.240037 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 07:52:22.240037 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 07:52:22.240037 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 07:52:22.240037 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 07:52:22.240037 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:52:22.240037 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7e43c4a-c38a-4da6-9687-d675f7c28f9a could not be found. Jul 26 07:52:22.240037 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:52:22.240037 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:52:22.240037 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:52:22.240037 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:52:22.240037 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:52:22.240037 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:52:22.240037 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:52:22.240037 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:52:22.240037 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7e43c4a-c38a-4da6-9687-d675f7c28f9a could not be found. Jul 26 07:52:22.240037 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:52:22.241678 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-5b67cb55-1799-4b5e-a2b9-d2d6d513511d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Returning 404 to user: Instance f7e43c4a-c38a-4da6-9687-d675f7c28f9a could not be found. {{(pid=117715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:52:22.241678 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-5b67cb55-1799-4b5e-a2b9-d2d6d513511d tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f7e43c4a-c38a-4da6-9687-d675f7c28f9a" status: 404 len: 111 microversion: 2.1 time: 0.040771 Jul 26 07:52:22.241678 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1153/2262] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Jul 26 07:52:22 2022] DELETE /compute/v2.1/servers/f7e43c4a-c38a-4da6-9687-d675f7c28f9a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 07:52:22.244570 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=2 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:22.245313 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=2 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:22.251100 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-4937ac8c-567e-4fda-8d3b-a398573904f3 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:52:22.251809 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-4937ac8c-567e-4fda-8d3b-a398573904f3 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: f7e43c4a-c38a-4da6-9687-d675f7c28f9a] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:52:22.259715 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4937ac8c-567e-4fda-8d3b-a398573904f3 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:52:22.260162 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4937ac8c-567e-4fda-8d3b-a398573904f3 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:52:22.260912 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4937ac8c-567e-4fda-8d3b-a398573904f3 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:52:22.261376 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4937ac8c-567e-4fda-8d3b-a398573904f3 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:52:22.274655 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.wsgi [None req-4937ac8c-567e-4fda-8d3b-a398573904f3 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] HTTP exception thrown: Instance f7e43c4a-c38a-4da6-9687-d675f7c28f9a could not be found. Jul 26 07:52:22.276254 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-4937ac8c-567e-4fda-8d3b-a398573904f3 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Request method failure captured: Jul 26 07:52:22.276254 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: request: GET /compute/v2.1/servers/f7e43c4a-c38a-4da6-9687-d675f7c28f9a HTTP/1.1 Jul 26 07:52:22.276254 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept: application/json Jul 26 07:52:22.276254 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept-Encoding: identity Jul 26 07:52:22.276254 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Connection: close Jul 26 07:52:22.276254 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Length: 0 Jul 26 07:52:22.276254 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Type: application/json Jul 26 07:52:22.276254 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Host: 10.222.0.39 Jul 26 07:52:22.276254 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Openstack-System-Scope: None Jul 26 07:52:22.276254 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: User-Agent: python-urllib3/1.26.10 Jul 26 07:52:22.276254 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Auth-Token: gAAAAABi35bp-6MDlHFX6PqBP1JfjI-kDaErGZ8tS4CYMVgobtb4Gv-rSD0l-rBJa-iOQtbMEcv7gnFG6FuqSpAXwRcnDvooOo8YQBTuYFKMeWkJlsSVbvRshSqswhfLq3PM2Jh4Afd8RHIhCtF_ajjZyUKtQPL35KmYg8DZArwcVpy_HW9N5Qc Jul 26 07:52:22.276254 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Id: None Jul 26 07:52:22.276254 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Name: None Jul 26 07:52:22.276254 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Identity-Status: Confirmed Jul 26 07:52:22.276254 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Is-Admin-Project: True Jul 26 07:52:22.276254 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Id: default Jul 26 07:52:22.276254 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Name: Default Jul 26 07:52:22.276254 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Id: 4fa0c5574ef9497ebe29658f8164764c Jul 26 07:52:22.276254 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Name: tempest-AttachVolumeNegativeTest-1485570437 Jul 26 07:52:22.276254 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Role: member,reader Jul 26 07:52:22.276254 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Roles: member,reader Jul 26 07:52:22.278031 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:52:22.278031 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant: tempest-AttachVolumeNegativeTest-1485570437 Jul 26 07:52:22.278031 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Id: 4fa0c5574ef9497ebe29658f8164764c Jul 26 07:52:22.278031 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1485570437 Jul 26 07:52:22.278031 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User: tempest-AttachVolumeNegativeTest-1485570437-project Jul 26 07:52:22.278031 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Id: default Jul 26 07:52:22.278031 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Name: Default Jul 26 07:52:22.278031 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Id: 57029844165f4d83892176fe82594685 Jul 26 07:52:22.278031 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Name: tempest-AttachVolumeNegativeTest-1485570437-project Jul 26 07:52:22.278031 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: method: > Jul 26 07:52:22.278031 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: exception: Instance f7e43c4a-c38a-4da6-9687-d675f7c28f9a could not be found. Jul 26 07:52:22.278031 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: action_args: {'id': 'f7e43c4a-c38a-4da6-9687-d675f7c28f9a'} Jul 26 07:52:22.279160 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:52:22.279160 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:52:22.279160 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 07:52:22.279160 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 07:52:22.279160 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 07:52:22.279160 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 07:52:22.279160 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 07:52:22.279160 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 07:52:22.279160 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 07:52:22.279160 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 07:52:22.279160 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7e43c4a-c38a-4da6-9687-d675f7c28f9a could not be found. Jul 26 07:52:22.279160 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:52:22.279160 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:52:22.279160 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:52:22.279160 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:52:22.279160 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:52:22.279160 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:52:22.279160 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:52:22.279160 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:52:22.279160 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:52:22.280745 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:52:22.280745 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 07:52:22.280745 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 07:52:22.280745 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 07:52:22.280745 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 07:52:22.280745 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 07:52:22.280745 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:52:22.280745 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7e43c4a-c38a-4da6-9687-d675f7c28f9a could not be found. Jul 26 07:52:22.280745 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:52:22.280745 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:52:22.280745 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:52:22.280745 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:52:22.280745 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:52:22.280745 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:52:22.280745 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:52:22.280745 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:52:22.280745 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7e43c4a-c38a-4da6-9687-d675f7c28f9a could not be found. Jul 26 07:52:22.280745 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:52:22.282327 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-4937ac8c-567e-4fda-8d3b-a398573904f3 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Returning 404 to user: Instance f7e43c4a-c38a-4da6-9687-d675f7c28f9a could not be found. {{(pid=117716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:52:22.282327 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-4937ac8c-567e-4fda-8d3b-a398573904f3 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/f7e43c4a-c38a-4da6-9687-d675f7c28f9a" status: 404 len: 111 microversion: 2.1 time: 0.035208 Jul 26 07:52:22.282327 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1110/2263] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:52:22 2022] GET /compute/v2.1/servers/f7e43c4a-c38a-4da6-9687-d675f7c28f9a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 07:52:36.700991 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 07:52:36.701856 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Tue Jul 26 07:52:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 07:52:46.180635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 07:52:46.181648 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Tue Jul 26 07:52:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 07:54:07.263029 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 07:54:07.264138 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Tue Jul 26 07:54:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 07:55:30.356520 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 07:55:30.357445 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Tue Jul 26 07:55:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 07:55:37.703731 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 07:55:37.704529 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Tue Jul 26 07:55:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 07:55:38.017520 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 07:55:38.018395 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Tue Jul 26 07:55:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 07:55:45.421459 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=2 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:55:45.426218 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8079ef7c-adea-47ad-b54e-ee3fe74e0f10 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:55:45.426796 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8079ef7c-adea-47ad-b54e-ee3fe74e0f10 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:55:45.435462 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8079ef7c-adea-47ad-b54e-ee3fe74e0f10 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:55:45.436023 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8079ef7c-adea-47ad-b54e-ee3fe74e0f10 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:55:45.437060 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8079ef7c-adea-47ad-b54e-ee3fe74e0f10 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:55:45.437477 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8079ef7c-adea-47ad-b54e-ee3fe74e0f10 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:55:45.441283 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO oslo.messaging._drivers.impl_rabbit [-] [cdf51fd0-56a6-4942-afed-0aacdf04f143] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 56686. Jul 26 07:55:45.453542 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.wsgi [None req-8079ef7c-adea-47ad-b54e-ee3fe74e0f10 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] HTTP exception thrown: Instance 990571a8-aa04-4aac-921c-cf071eca1dd0 could not be found. Jul 26 07:55:45.455171 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8079ef7c-adea-47ad-b54e-ee3fe74e0f10 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Request method failure captured: Jul 26 07:55:45.455171 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: request: DELETE /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 HTTP/1.1 Jul 26 07:55:45.455171 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept: application/json Jul 26 07:55:45.455171 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept-Encoding: identity Jul 26 07:55:45.455171 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Connection: close Jul 26 07:55:45.455171 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Length: 0 Jul 26 07:55:45.455171 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Type: application/json Jul 26 07:55:45.455171 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Host: 10.222.0.39 Jul 26 07:55:45.455171 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Openstack-System-Scope: None Jul 26 07:55:45.455171 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: User-Agent: python-urllib3/1.26.10 Jul 26 07:55:45.455171 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Auth-Token: gAAAAABi35bvGDNo9P2I4uW1-Shojh4HGO1Rppt9NzkCOBk7jC7Yg59Bks6D-2VdTptuPMptM5Wlsb1aJJ8KPWzzT7udn9SD16W5yQq0PzF9cVldZ_vRp9Ln10FG5oAEy3VoanisC8CMcBLVkhKXP_6slgnYPKdW7nxAdOhUTnLvYmW_g2eKqmk Jul 26 07:55:45.455171 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Id: None Jul 26 07:55:45.455171 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Name: None Jul 26 07:55:45.455171 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Identity-Status: Confirmed Jul 26 07:55:45.455171 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Is-Admin-Project: True Jul 26 07:55:45.455171 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 07:55:45.455171 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Id: default Jul 26 07:55:45.455171 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Name: Default Jul 26 07:55:45.455171 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Id: 0874292e3f8f4db98adc2b9672f840c4 Jul 26 07:55:45.455171 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-715304843 Jul 26 07:55:45.455171 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Role: member,reader Jul 26 07:55:45.455171 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Roles: member,reader Jul 26 07:55:45.456959 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0874292e3f8f4db98adc2b9672f840c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0874292e3f8f4db98adc2b9672f840c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0874292e3f8f4db98adc2b9672f840c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0874292e3f8f4db98adc2b9672f840c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:55:45.456959 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant: tempest-AttachVolumeShelveTestJSON-715304843 Jul 26 07:55:45.456959 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Id: 0874292e3f8f4db98adc2b9672f840c4 Jul 26 07:55:45.456959 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-715304843 Jul 26 07:55:45.456959 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User: tempest-AttachVolumeShelveTestJSON-715304843-project Jul 26 07:55:45.456959 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Id: default Jul 26 07:55:45.456959 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Name: Default Jul 26 07:55:45.456959 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Id: 08c4ec6a688c4608aa75aaf046933eec Jul 26 07:55:45.456959 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Name: tempest-AttachVolumeShelveTestJSON-715304843-project Jul 26 07:55:45.456959 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: method: > Jul 26 07:55:45.456959 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: exception: Instance 990571a8-aa04-4aac-921c-cf071eca1dd0 could not be found. Jul 26 07:55:45.456959 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: action_args: {'id': '990571a8-aa04-4aac-921c-cf071eca1dd0'} Jul 26 07:55:45.461022 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:55:45.461022 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:55:45.461022 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 07:55:45.461022 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 07:55:45.461022 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 07:55:45.461022 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 07:55:45.461022 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 07:55:45.461022 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 07:55:45.461022 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 07:55:45.461022 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 07:55:45.461022 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 990571a8-aa04-4aac-921c-cf071eca1dd0 could not be found. Jul 26 07:55:45.461022 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:55:45.461022 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:55:45.461022 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:55:45.461022 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:55:45.461022 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:55:45.461022 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:55:45.461022 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:55:45.461022 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:55:45.461022 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:55:45.462736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:55:45.462736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 07:55:45.462736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 07:55:45.462736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 07:55:45.462736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 07:55:45.462736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 07:55:45.462736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 07:55:45.462736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 07:55:45.462736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:55:45.462736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 990571a8-aa04-4aac-921c-cf071eca1dd0 could not be found. Jul 26 07:55:45.462736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:55:45.462736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:55:45.462736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:55:45.462736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:55:45.462736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:55:45.462736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:55:45.462736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:55:45.462736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:55:45.462736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 990571a8-aa04-4aac-921c-cf071eca1dd0 could not be found. Jul 26 07:55:45.462736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:55:45.464744 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8079ef7c-adea-47ad-b54e-ee3fe74e0f10 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Returning 404 to user: Instance 990571a8-aa04-4aac-921c-cf071eca1dd0 could not be found. {{(pid=117715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:55:45.464744 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8079ef7c-adea-47ad-b54e-ee3fe74e0f10 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "DELETE /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 404 len: 111 microversion: 2.20 time: 0.037625 Jul 26 07:55:45.464744 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1154/2264] 10.222.0.39 () {60 vars in 1280 bytes} [Tue Jul 26 07:55:45 2022] DELETE /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 07:55:45.465102 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9dc8bbe6-3d82-4f6a-b753-d62839cd5a52] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 07:55:45.465538 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=2 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:55:45.466302 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=2 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:55:45.471736 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8e4a5c5f-d599-48ef-a1a8-920d57713db4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:55:45.473080 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8e4a5c5f-d599-48ef-a1a8-920d57713db4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] [instance: 990571a8-aa04-4aac-921c-cf071eca1dd0] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:55:45.481049 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8e4a5c5f-d599-48ef-a1a8-920d57713db4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:55:45.481491 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8e4a5c5f-d599-48ef-a1a8-920d57713db4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:55:45.482274 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8e4a5c5f-d599-48ef-a1a8-920d57713db4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:55:45.482725 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8e4a5c5f-d599-48ef-a1a8-920d57713db4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:55:45.497810 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.wsgi [None req-8e4a5c5f-d599-48ef-a1a8-920d57713db4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] HTTP exception thrown: Instance 990571a8-aa04-4aac-921c-cf071eca1dd0 could not be found. Jul 26 07:55:45.499460 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8e4a5c5f-d599-48ef-a1a8-920d57713db4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Request method failure captured: Jul 26 07:55:45.499460 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: request: GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 HTTP/1.1 Jul 26 07:55:45.499460 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept: application/json Jul 26 07:55:45.499460 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept-Encoding: identity Jul 26 07:55:45.499460 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Connection: close Jul 26 07:55:45.499460 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Length: 0 Jul 26 07:55:45.499460 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Type: application/json Jul 26 07:55:45.499460 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Host: 10.222.0.39 Jul 26 07:55:45.499460 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Openstack-System-Scope: None Jul 26 07:55:45.499460 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: User-Agent: python-urllib3/1.26.10 Jul 26 07:55:45.499460 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Auth-Token: gAAAAABi35bvGDNo9P2I4uW1-Shojh4HGO1Rppt9NzkCOBk7jC7Yg59Bks6D-2VdTptuPMptM5Wlsb1aJJ8KPWzzT7udn9SD16W5yQq0PzF9cVldZ_vRp9Ln10FG5oAEy3VoanisC8CMcBLVkhKXP_6slgnYPKdW7nxAdOhUTnLvYmW_g2eKqmk Jul 26 07:55:45.499460 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Id: None Jul 26 07:55:45.499460 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Name: None Jul 26 07:55:45.499460 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Identity-Status: Confirmed Jul 26 07:55:45.499460 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Is-Admin-Project: True Jul 26 07:55:45.499460 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 07:55:45.499460 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Id: default Jul 26 07:55:45.499460 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Name: Default Jul 26 07:55:45.499460 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Id: 0874292e3f8f4db98adc2b9672f840c4 Jul 26 07:55:45.499460 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-715304843 Jul 26 07:55:45.499460 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Role: member,reader Jul 26 07:55:45.499460 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Roles: member,reader Jul 26 07:55:45.501349 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0874292e3f8f4db98adc2b9672f840c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0874292e3f8f4db98adc2b9672f840c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0874292e3f8f4db98adc2b9672f840c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0874292e3f8f4db98adc2b9672f840c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:55:45.501349 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant: tempest-AttachVolumeShelveTestJSON-715304843 Jul 26 07:55:45.501349 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Id: 0874292e3f8f4db98adc2b9672f840c4 Jul 26 07:55:45.501349 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-715304843 Jul 26 07:55:45.501349 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User: tempest-AttachVolumeShelveTestJSON-715304843-project Jul 26 07:55:45.501349 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Id: default Jul 26 07:55:45.501349 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Name: Default Jul 26 07:55:45.501349 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Id: 08c4ec6a688c4608aa75aaf046933eec Jul 26 07:55:45.501349 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Name: tempest-AttachVolumeShelveTestJSON-715304843-project Jul 26 07:55:45.501349 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: method: > Jul 26 07:55:45.501349 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: exception: Instance 990571a8-aa04-4aac-921c-cf071eca1dd0 could not be found. Jul 26 07:55:45.501349 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: action_args: {'id': '990571a8-aa04-4aac-921c-cf071eca1dd0'} Jul 26 07:55:45.502334 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:55:45.502334 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:55:45.502334 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 07:55:45.502334 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 07:55:45.502334 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 07:55:45.502334 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 07:55:45.502334 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 07:55:45.502334 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 07:55:45.502334 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 07:55:45.502334 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 07:55:45.502334 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 990571a8-aa04-4aac-921c-cf071eca1dd0 could not be found. Jul 26 07:55:45.502334 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:55:45.502334 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:55:45.502334 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:55:45.502334 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:55:45.502334 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:55:45.502334 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:55:45.502334 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:55:45.502334 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:55:45.502334 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:55:45.503690 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:55:45.503690 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 07:55:45.503690 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 07:55:45.503690 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 07:55:45.503690 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 07:55:45.503690 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 07:55:45.503690 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:55:45.503690 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 990571a8-aa04-4aac-921c-cf071eca1dd0 could not be found. Jul 26 07:55:45.503690 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:55:45.503690 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:55:45.503690 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:55:45.503690 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:55:45.503690 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:55:45.503690 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:55:45.503690 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:55:45.503690 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:55:45.503690 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 990571a8-aa04-4aac-921c-cf071eca1dd0 could not be found. Jul 26 07:55:45.503690 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:55:45.504965 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8e4a5c5f-d599-48ef-a1a8-920d57713db4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] Returning 404 to user: Instance 990571a8-aa04-4aac-921c-cf071eca1dd0 could not be found. {{(pid=117716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:55:45.504965 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8e4a5c5f-d599-48ef-a1a8-920d57713db4 tempest-AttachVolumeShelveTestJSON-715304843 tempest-AttachVolumeShelveTestJSON-715304843-project] 10.222.0.39 "GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0" status: 404 len: 111 microversion: 2.20 time: 0.039731 Jul 26 07:55:45.504965 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1111/2265] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Jul 26 07:55:45 2022] GET /compute/v2.1/servers/990571a8-aa04-4aac-921c-cf071eca1dd0 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 07:55:53.969233 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-08c2362e-063e-4f09-9974-0c541a92a6c6 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Action: 'create', calling method: .version_select at 0x7f7f026e70d0>, body: {"keypair": {"name": "tempest-keypair-1007971507", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+b/Q1V3XPLP9Z3SfYqtHRIL1D+SPL0CefsheJMuBwsD/RXHQSFivaFcCYvatmfx9ukdUbvoTOotRb4itbvF5Y/8tgZFF2UDayAcGUe+h3eF3DuzHt13h/XjlzeBL7S0A=="}} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:55:53.984783 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.quota [None req-08c2362e-063e-4f09-9974-0c541a92a6c6 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Getting quotas for project 0898dc56ea6a416aae031efb7fefc46b. Resources: {'key_pairs'} {{(pid=117715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 07:55:53.988651 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.quota [None req-08c2362e-063e-4f09-9974-0c541a92a6c6 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Getting quotas for user dc97d25991d24cf9bb84f49366c895a6 and project 0898dc56ea6a416aae031efb7fefc46b. Resources: {'key_pairs'} {{(pid=117715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 07:55:54.015857 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-08c2362e-063e-4f09-9974-0c541a92a6c6 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.187049 Jul 26 07:55:54.016478 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1155/2266] 10.222.0.39 () {60 vars in 1159 bytes} [Tue Jul 26 07:55:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:55:55.362653 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0a37bd91-820e-4528-b1ca-0f4766e985b4 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1689743496", "imageRef": "b9589773-813f-42af-846a-43bcf9d4d002", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "566d56f0-0e97-4933-aad2-fef7f099951d"}], "security_groups": [{"name": "tempest-securitygroup--259063112"}], "key_name": "tempest-keypair-1007971507", "user_data": "}} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:55:55.388318 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO oslo.messaging._drivers.impl_rabbit [-] [9dc8bbe6-3d82-4f6a-b753-d62839cd5a52] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 56768. Jul 26 07:55:55.487572 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=2 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:55:55.617456 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.network.neutron [None req-0a37bd91-820e-4528-b1ca-0f4766e985b4 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] validate_networks() for [('566d56f0-0e97-4933-aad2-fef7f099951d', None, None, None, None, None)] {{(pid=117716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 07:55:56.300901 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-0a37bd91-820e-4528-b1ca-0f4766e985b4 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Flavor limits 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 07:55:56.301321 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-0a37bd91-820e-4528-b1ca-0f4766e985b4 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Image limits 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 07:55:56.301799 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-0a37bd91-820e-4528-b1ca-0f4766e985b4 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Flavor pref 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 07:55:56.302229 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-0a37bd91-820e-4528-b1ca-0f4766e985b4 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Image pref 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 07:55:56.302619 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-0a37bd91-820e-4528-b1ca-0f4766e985b4 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 07:55:56.312193 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0a37bd91-820e-4528-b1ca-0f4766e985b4 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:55:56.312566 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0a37bd91-820e-4528-b1ca-0f4766e985b4 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:55:56.313356 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0a37bd91-820e-4528-b1ca-0f4766e985b4 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:55:56.313813 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0a37bd91-820e-4528-b1ca-0f4766e985b4 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:55:56.331283 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.quota [None req-0a37bd91-820e-4528-b1ca-0f4766e985b4 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Getting quotas for project 0898dc56ea6a416aae031efb7fefc46b. Resources: {'instances', 'cores', 'ram'} {{(pid=117716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 07:55:56.335211 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.quota [None req-0a37bd91-820e-4528-b1ca-0f4766e985b4 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Getting quotas for user dc97d25991d24cf9bb84f49366c895a6 and project 0898dc56ea6a416aae031efb7fefc46b. Resources: {'instances', 'cores', 'ram'} {{(pid=117716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 07:55:56.346188 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0a37bd91-820e-4528-b1ca-0f4766e985b4 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Going to run 1 instances... {{(pid=117716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 07:55:56.348489 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0a37bd91-820e-4528-b1ca-0f4766e985b4 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 4ba108c9-d3fc-442d-9ce5-b6f78e900ead] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9589773-813f-42af-846a-43bcf9d4d002',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 07:55:56.395905 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0a37bd91-820e-4528-b1ca-0f4766e985b4 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.037533 Jul 26 07:55:56.396647 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1112/2267] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Jul 26 07:55:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 1039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 07:55:56.405245 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=4 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:55:56.409593 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-700be056-249b-4e03-94b0-0d9f65c4953d tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:55:56.410750 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-700be056-249b-4e03-94b0-0d9f65c4953d tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 4ba108c9-d3fc-442d-9ce5-b6f78e900ead] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:55:56.539989 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-700be056-249b-4e03-94b0-0d9f65c4953d tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc97d25991d24cf9bb84f49366c895a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0898dc56ea6a416aae031efb7fefc46b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:55:56.549040 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-700be056-249b-4e03-94b0-0d9f65c4953d tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "GET /compute/v2.1/servers/4ba108c9-d3fc-442d-9ce5-b6f78e900ead" status: 200 len: 1238 microversion: 2.1 time: 0.145014 Jul 26 07:55:56.549937 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1156/2268] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:55:56 2022] GET /compute/v2.1/servers/4ba108c9-d3fc-442d-9ce5-b6f78e900ead => generated 1238 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:55:56.712995 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 07:55:56.713545 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Tue Jul 26 07:55:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 07:55:57.576904 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-627a03f2-f45f-4f89-b377-8c95a8a2b241 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:55:57.578306 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-627a03f2-f45f-4f89-b377-8c95a8a2b241 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 4ba108c9-d3fc-442d-9ce5-b6f78e900ead] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:55:57.587996 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-627a03f2-f45f-4f89-b377-8c95a8a2b241 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:55:57.588889 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-627a03f2-f45f-4f89-b377-8c95a8a2b241 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:55:57.590114 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-627a03f2-f45f-4f89-b377-8c95a8a2b241 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:55:57.590769 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-627a03f2-f45f-4f89-b377-8c95a8a2b241 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:55:57.667098 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-627a03f2-f45f-4f89-b377-8c95a8a2b241 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc97d25991d24cf9bb84f49366c895a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0898dc56ea6a416aae031efb7fefc46b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:55:57.676850 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-627a03f2-f45f-4f89-b377-8c95a8a2b241 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "GET /compute/v2.1/servers/4ba108c9-d3fc-442d-9ce5-b6f78e900ead" status: 200 len: 1298 microversion: 2.1 time: 0.106641 Jul 26 07:55:57.681001 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1113/2269] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:55:57 2022] GET /compute/v2.1/servers/4ba108c9-d3fc-442d-9ce5-b6f78e900ead => generated 1298 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:55:58.702371 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-de9d0515-1546-45e9-a61c-97a04ab991de tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:55:58.703177 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-de9d0515-1546-45e9-a61c-97a04ab991de tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 4ba108c9-d3fc-442d-9ce5-b6f78e900ead] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:55:58.710034 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-de9d0515-1546-45e9-a61c-97a04ab991de tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:55:58.710555 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-de9d0515-1546-45e9-a61c-97a04ab991de tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:55:58.711381 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-de9d0515-1546-45e9-a61c-97a04ab991de tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:55:58.711871 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-de9d0515-1546-45e9-a61c-97a04ab991de tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:55:58.856183 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-de9d0515-1546-45e9-a61c-97a04ab991de tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc97d25991d24cf9bb84f49366c895a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0898dc56ea6a416aae031efb7fefc46b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:55:58.864495 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-de9d0515-1546-45e9-a61c-97a04ab991de tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "GET /compute/v2.1/servers/4ba108c9-d3fc-442d-9ce5-b6f78e900ead" status: 200 len: 1363 microversion: 2.1 time: 0.166493 Jul 26 07:55:58.865303 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1157/2270] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:55:58 2022] GET /compute/v2.1/servers/4ba108c9-d3fc-442d-9ce5-b6f78e900ead => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:55:59.145909 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-c68b329b-3fbd-4c4c-940e-ff972634d760 req-a999f417-fa88-41b1-a289-a243c8de43e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ba108c9-d3fc-442d-9ce5-b6f78e900ead", "tag": "1f0697a2-5732-45b0-9f9f-9df36e35bb92"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:55:59.156263 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-c68b329b-3fbd-4c4c-940e-ff972634d760 req-a999f417-fa88-41b1-a289-a243c8de43e2 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:55:59.156697 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-c68b329b-3fbd-4c4c-940e-ff972634d760 req-a999f417-fa88-41b1-a289-a243c8de43e2 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:55:59.168140 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-c68b329b-3fbd-4c4c-940e-ff972634d760 req-a999f417-fa88-41b1-a289-a243c8de43e2 service nova] Creating event network-changed:1f0697a2-5732-45b0-9f9f-9df36e35bb92 for instance 4ba108c9-d3fc-442d-9ce5-b6f78e900ead on hv-cinder-85083 Jul 26 07:55:59.171430 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR oslo.messaging._drivers.impl_rabbit [req-c68b329b-3fbd-4c4c-940e-ff972634d760 req-a999f417-fa88-41b1-a289-a243c8de43e2 service nova] [715afd05-a23d-48ea-9c69-7b252d372532] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 07:55:59.890706 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-cfc31101-abaa-442d-b409-0e646bb89477 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:55:59.891706 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-cfc31101-abaa-442d-b409-0e646bb89477 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 4ba108c9-d3fc-442d-9ce5-b6f78e900ead] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:55:59.904939 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cfc31101-abaa-442d-b409-0e646bb89477 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:55:59.905427 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cfc31101-abaa-442d-b409-0e646bb89477 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:55:59.906232 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cfc31101-abaa-442d-b409-0e646bb89477 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:55:59.906641 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-cfc31101-abaa-442d-b409-0e646bb89477 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:56:00.049082 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-cfc31101-abaa-442d-b409-0e646bb89477 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc97d25991d24cf9bb84f49366c895a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0898dc56ea6a416aae031efb7fefc46b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:56:00.061647 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-cfc31101-abaa-442d-b409-0e646bb89477 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "GET /compute/v2.1/servers/4ba108c9-d3fc-442d-9ce5-b6f78e900ead" status: 200 len: 1363 microversion: 2.1 time: 0.177122 Jul 26 07:56:00.062410 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1158/2271] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:55:59 2022] GET /compute/v2.1/servers/4ba108c9-d3fc-442d-9ce5-b6f78e900ead => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:56:00.179858 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO oslo.messaging._drivers.impl_rabbit [req-c68b329b-3fbd-4c4c-940e-ff972634d760 req-a999f417-fa88-41b1-a289-a243c8de43e2 service nova] [715afd05-a23d-48ea-9c69-7b252d372532] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 56816. Jul 26 07:56:00.184603 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-c68b329b-3fbd-4c4c-940e-ff972634d760 req-a999f417-fa88-41b1-a289-a243c8de43e2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.120427 Jul 26 07:56:00.185215 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1114/2272] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:56:01.084630 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-1a66805c-fa11-4f2e-9081-7eaa5b4d199f tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:56:01.085208 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-1a66805c-fa11-4f2e-9081-7eaa5b4d199f tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 4ba108c9-d3fc-442d-9ce5-b6f78e900ead] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:56:01.092064 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1a66805c-fa11-4f2e-9081-7eaa5b4d199f tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:56:01.092515 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1a66805c-fa11-4f2e-9081-7eaa5b4d199f tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:56:01.093274 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1a66805c-fa11-4f2e-9081-7eaa5b4d199f tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:56:01.093711 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1a66805c-fa11-4f2e-9081-7eaa5b4d199f tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:56:01.241998 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-1a66805c-fa11-4f2e-9081-7eaa5b4d199f tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc97d25991d24cf9bb84f49366c895a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0898dc56ea6a416aae031efb7fefc46b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:56:01.250129 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-1a66805c-fa11-4f2e-9081-7eaa5b4d199f tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "GET /compute/v2.1/servers/4ba108c9-d3fc-442d-9ce5-b6f78e900ead" status: 200 len: 1363 microversion: 2.1 time: 0.169577 Jul 26 07:56:01.250631 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1159/2273] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:56:01 2022] GET /compute/v2.1/servers/4ba108c9-d3fc-442d-9ce5-b6f78e900ead => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:56:02.273988 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-bf6437e0-8e7c-4308-87de-60b523e25896 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:56:02.274652 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-bf6437e0-8e7c-4308-87de-60b523e25896 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 4ba108c9-d3fc-442d-9ce5-b6f78e900ead] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:56:02.282274 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bf6437e0-8e7c-4308-87de-60b523e25896 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:56:02.282723 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bf6437e0-8e7c-4308-87de-60b523e25896 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:56:02.283482 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bf6437e0-8e7c-4308-87de-60b523e25896 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:56:02.283913 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bf6437e0-8e7c-4308-87de-60b523e25896 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:56:02.423647 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-bf6437e0-8e7c-4308-87de-60b523e25896 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc97d25991d24cf9bb84f49366c895a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0898dc56ea6a416aae031efb7fefc46b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:56:02.434697 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-bf6437e0-8e7c-4308-87de-60b523e25896 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "GET /compute/v2.1/servers/4ba108c9-d3fc-442d-9ce5-b6f78e900ead" status: 200 len: 1363 microversion: 2.1 time: 0.166725 Jul 26 07:56:02.435298 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1115/2274] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:56:02 2022] GET /compute/v2.1/servers/4ba108c9-d3fc-442d-9ce5-b6f78e900ead => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:56:02.512222 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-193b399d-7065-4a7e-bc74-cfe962a330fd req-95724210-2c3d-4f67-ab6a-36821e89716d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ba108c9-d3fc-442d-9ce5-b6f78e900ead", "name": "network-vif-plugged", "status": "completed", "tag": "1f0697a2-5732-45b0-9f9f-9df36e35bb92"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:56:02.524511 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-193b399d-7065-4a7e-bc74-cfe962a330fd req-95724210-2c3d-4f67-ab6a-36821e89716d service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:56:02.524917 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-193b399d-7065-4a7e-bc74-cfe962a330fd req-95724210-2c3d-4f67-ab6a-36821e89716d service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:56:02.541668 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-193b399d-7065-4a7e-bc74-cfe962a330fd req-95724210-2c3d-4f67-ab6a-36821e89716d service nova] Creating event network-vif-plugged:1f0697a2-5732-45b0-9f9f-9df36e35bb92 for instance 4ba108c9-d3fc-442d-9ce5-b6f78e900ead on hv-cinder-85083 Jul 26 07:56:02.548827 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-193b399d-7065-4a7e-bc74-cfe962a330fd req-95724210-2c3d-4f67-ab6a-36821e89716d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095042 Jul 26 07:56:02.549603 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1160/2275] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:56:03.456918 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-3e80f41f-2a3b-4ced-8fff-4a2f0bbadeef tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:56:03.457535 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-3e80f41f-2a3b-4ced-8fff-4a2f0bbadeef tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 4ba108c9-d3fc-442d-9ce5-b6f78e900ead] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:56:03.464512 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3e80f41f-2a3b-4ced-8fff-4a2f0bbadeef tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:56:03.464965 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3e80f41f-2a3b-4ced-8fff-4a2f0bbadeef tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:56:03.465725 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3e80f41f-2a3b-4ced-8fff-4a2f0bbadeef tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:56:03.466191 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3e80f41f-2a3b-4ced-8fff-4a2f0bbadeef tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:56:03.596379 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-3e80f41f-2a3b-4ced-8fff-4a2f0bbadeef tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc97d25991d24cf9bb84f49366c895a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0898dc56ea6a416aae031efb7fefc46b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:56:03.604320 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-3e80f41f-2a3b-4ced-8fff-4a2f0bbadeef tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "GET /compute/v2.1/servers/4ba108c9-d3fc-442d-9ce5-b6f78e900ead" status: 200 len: 1363 microversion: 2.1 time: 0.151459 Jul 26 07:56:03.604887 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1116/2276] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:56:03 2022] GET /compute/v2.1/servers/4ba108c9-d3fc-442d-9ce5-b6f78e900ead => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:56:04.630469 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f962c16a-ed7f-4901-9a9e-1a9824730814 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:56:04.631701 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f962c16a-ed7f-4901-9a9e-1a9824730814 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 4ba108c9-d3fc-442d-9ce5-b6f78e900ead] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:56:04.641773 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f962c16a-ed7f-4901-9a9e-1a9824730814 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:56:04.642245 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f962c16a-ed7f-4901-9a9e-1a9824730814 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:56:04.643004 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f962c16a-ed7f-4901-9a9e-1a9824730814 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:56:04.643432 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f962c16a-ed7f-4901-9a9e-1a9824730814 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:56:04.774674 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f962c16a-ed7f-4901-9a9e-1a9824730814 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc97d25991d24cf9bb84f49366c895a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0898dc56ea6a416aae031efb7fefc46b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:56:04.786955 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f962c16a-ed7f-4901-9a9e-1a9824730814 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "GET /compute/v2.1/servers/4ba108c9-d3fc-442d-9ce5-b6f78e900ead" status: 200 len: 1549 microversion: 2.1 time: 0.163425 Jul 26 07:56:04.787799 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1161/2277] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:56:04 2022] GET /compute/v2.1/servers/4ba108c9-d3fc-442d-9ce5-b6f78e900ead => generated 1549 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:56:04.810727 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6cddba44-fdb4-4c45-b6ba-8d461fc801a3 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:56:04.811279 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6cddba44-fdb4-4c45-b6ba-8d461fc801a3 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 4ba108c9-d3fc-442d-9ce5-b6f78e900ead] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:56:04.817856 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6cddba44-fdb4-4c45-b6ba-8d461fc801a3 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:56:04.818300 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6cddba44-fdb4-4c45-b6ba-8d461fc801a3 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:56:04.819039 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6cddba44-fdb4-4c45-b6ba-8d461fc801a3 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:56:04.819466 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6cddba44-fdb4-4c45-b6ba-8d461fc801a3 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:56:04.904656 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6cddba44-fdb4-4c45-b6ba-8d461fc801a3 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "GET /compute/v2.1/servers/4ba108c9-d3fc-442d-9ce5-b6f78e900ead/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097390 Jul 26 07:56:04.905421 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1117/2278] 10.222.0.39 () {58 vars in 1275 bytes} [Tue Jul 26 07:56:04 2022] GET /compute/v2.1/servers/4ba108c9-d3fc-442d-9ce5-b6f78e900ead/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:56:05.842599 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-4056b6da-ca11-4e61-84d7-a2d2f61ce709 req-d760c333-9fe9-44b6-9c14-dcaa1ebc44f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ba108c9-d3fc-442d-9ce5-b6f78e900ead", "tag": "1f0697a2-5732-45b0-9f9f-9df36e35bb92"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:56:05.852837 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-4056b6da-ca11-4e61-84d7-a2d2f61ce709 req-d760c333-9fe9-44b6-9c14-dcaa1ebc44f4 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:56:05.853272 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-4056b6da-ca11-4e61-84d7-a2d2f61ce709 req-d760c333-9fe9-44b6-9c14-dcaa1ebc44f4 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:56:05.864204 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-4056b6da-ca11-4e61-84d7-a2d2f61ce709 req-d760c333-9fe9-44b6-9c14-dcaa1ebc44f4 service nova] Creating event network-changed:1f0697a2-5732-45b0-9f9f-9df36e35bb92 for instance 4ba108c9-d3fc-442d-9ce5-b6f78e900ead on hv-cinder-85083 Jul 26 07:56:05.869257 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-4056b6da-ca11-4e61-84d7-a2d2f61ce709 req-d760c333-9fe9-44b6-9c14-dcaa1ebc44f4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030276 Jul 26 07:56:05.869869 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1162/2279] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:56:42.115213 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell0:SELECT=2 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:56:42.116162 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell0:SELECT=6 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:56:42.117146 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:56:42.118003 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=26 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:56:42.122688 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-48aba8e1-7084-4b40-bd49-ea0a0907bf41 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:56:42.123288 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-48aba8e1-7084-4b40-bd49-ea0a0907bf41 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 4ba108c9-d3fc-442d-9ce5-b6f78e900ead] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:56:42.134069 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-48aba8e1-7084-4b40-bd49-ea0a0907bf41 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:56:42.134617 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-48aba8e1-7084-4b40-bd49-ea0a0907bf41 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:56:42.135542 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-48aba8e1-7084-4b40-bd49-ea0a0907bf41 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:56:42.136073 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-48aba8e1-7084-4b40-bd49-ea0a0907bf41 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:56:42.160973 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-48aba8e1-7084-4b40-bd49-ea0a0907bf41 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "GET /compute/v2.1/servers/4ba108c9-d3fc-442d-9ce5-b6f78e900ead/ips" status: 200 len: 145 microversion: 2.1 time: 0.047950 Jul 26 07:56:42.161528 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1118/2280] 10.222.0.39 () {58 vars in 1248 bytes} [Tue Jul 26 07:56:42 2022] GET /compute/v2.1/servers/4ba108c9-d3fc-442d-9ce5-b6f78e900ead/ips => generated 145 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:57:43.048062 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell0:SELECT=6 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:57:43.050438 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:57:43.051794 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=28 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:57:43.061029 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-0299ce76-01de-480e-a7b9-8660af1a2c2c tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:57:43.062067 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-0299ce76-01de-480e-a7b9-8660af1a2c2c tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 4ba108c9-d3fc-442d-9ce5-b6f78e900ead] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:57:43.073630 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0299ce76-01de-480e-a7b9-8660af1a2c2c tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:57:43.074065 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0299ce76-01de-480e-a7b9-8660af1a2c2c tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:57:43.074809 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0299ce76-01de-480e-a7b9-8660af1a2c2c tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:57:43.075240 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0299ce76-01de-480e-a7b9-8660af1a2c2c tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:57:43.100401 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-0299ce76-01de-480e-a7b9-8660af1a2c2c tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 4ba108c9-d3fc-442d-9ce5-b6f78e900ead] Going to try to terminate instance {{(pid=117715) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 07:57:43.184285 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-0299ce76-01de-480e-a7b9-8660af1a2c2c tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4ba108c9-d3fc-442d-9ce5-b6f78e900ead" status: 204 len: 0 microversion: 2.1 time: 0.138657 Jul 26 07:57:43.184987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1163/2281] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Jul 26 07:57:43 2022] DELETE /compute/v2.1/servers/4ba108c9-d3fc-442d-9ce5-b6f78e900ead => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 07:57:43.191661 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=2 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:57:43.192407 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=4 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:57:43.196448 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-626c6f54-4090-473e-bfad-9dc406eb1f30 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:57:43.197476 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-626c6f54-4090-473e-bfad-9dc406eb1f30 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 4ba108c9-d3fc-442d-9ce5-b6f78e900ead] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:57:43.204294 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-626c6f54-4090-473e-bfad-9dc406eb1f30 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:57:43.204745 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-626c6f54-4090-473e-bfad-9dc406eb1f30 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:57:43.205494 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-626c6f54-4090-473e-bfad-9dc406eb1f30 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:57:43.205960 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-626c6f54-4090-473e-bfad-9dc406eb1f30 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:57:43.338889 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-626c6f54-4090-473e-bfad-9dc406eb1f30 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc97d25991d24cf9bb84f49366c895a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0898dc56ea6a416aae031efb7fefc46b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:57:43.346523 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-626c6f54-4090-473e-bfad-9dc406eb1f30 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "GET /compute/v2.1/servers/4ba108c9-d3fc-442d-9ce5-b6f78e900ead" status: 200 len: 1673 microversion: 2.1 time: 0.156609 Jul 26 07:57:43.347064 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1119/2282] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:57:43 2022] GET /compute/v2.1/servers/4ba108c9-d3fc-442d-9ce5-b6f78e900ead => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 07:57:44.368658 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f410f494-0c33-407b-8863-47e0ec1b9097 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:57:44.369335 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f410f494-0c33-407b-8863-47e0ec1b9097 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 4ba108c9-d3fc-442d-9ce5-b6f78e900ead] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:57:44.376349 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f410f494-0c33-407b-8863-47e0ec1b9097 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:57:44.376804 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f410f494-0c33-407b-8863-47e0ec1b9097 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:57:44.377616 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f410f494-0c33-407b-8863-47e0ec1b9097 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:57:44.378078 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f410f494-0c33-407b-8863-47e0ec1b9097 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:57:44.520185 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f410f494-0c33-407b-8863-47e0ec1b9097 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc97d25991d24cf9bb84f49366c895a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0898dc56ea6a416aae031efb7fefc46b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:57:44.528165 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f410f494-0c33-407b-8863-47e0ec1b9097 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "GET /compute/v2.1/servers/4ba108c9-d3fc-442d-9ce5-b6f78e900ead" status: 200 len: 1673 microversion: 2.1 time: 0.163944 Jul 26 07:57:44.528734 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1164/2283] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:57:44 2022] GET /compute/v2.1/servers/4ba108c9-d3fc-442d-9ce5-b6f78e900ead => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:57:45.444735 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-16f8bc93-2785-4260-8980-1e0158ceb14f req-d0ed5835-1f53-4572-8af2-9ae4570371c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ba108c9-d3fc-442d-9ce5-b6f78e900ead", "name": "network-vif-deleted", "tag": "1f0697a2-5732-45b0-9f9f-9df36e35bb92"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:57:45.455979 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-16f8bc93-2785-4260-8980-1e0158ceb14f req-d0ed5835-1f53-4572-8af2-9ae4570371c0 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:57:45.456806 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-16f8bc93-2785-4260-8980-1e0158ceb14f req-d0ed5835-1f53-4572-8af2-9ae4570371c0 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:57:45.470691 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-16f8bc93-2785-4260-8980-1e0158ceb14f req-d0ed5835-1f53-4572-8af2-9ae4570371c0 service nova] Creating event network-vif-deleted:1f0697a2-5732-45b0-9f9f-9df36e35bb92 for instance 4ba108c9-d3fc-442d-9ce5-b6f78e900ead on hv-cinder-85083 Jul 26 07:57:45.478424 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-16f8bc93-2785-4260-8980-1e0158ceb14f req-d0ed5835-1f53-4572-8af2-9ae4570371c0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115567 Jul 26 07:57:45.479385 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1120/2284] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:57:45.551691 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-46edf48e-2d08-46b5-b45b-32c4ed5ff76d tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:57:45.552356 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-46edf48e-2d08-46b5-b45b-32c4ed5ff76d tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 4ba108c9-d3fc-442d-9ce5-b6f78e900ead] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:57:45.559059 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-46edf48e-2d08-46b5-b45b-32c4ed5ff76d tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:57:45.559715 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-46edf48e-2d08-46b5-b45b-32c4ed5ff76d tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:57:45.560632 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-46edf48e-2d08-46b5-b45b-32c4ed5ff76d tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:57:45.561059 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-46edf48e-2d08-46b5-b45b-32c4ed5ff76d tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:57:45.602506 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-46edf48e-2d08-46b5-b45b-32c4ed5ff76d tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:57:45.603519 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-46edf48e-2d08-46b5-b45b-32c4ed5ff76d tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:57:45.603978 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.objects.instance [None req-46edf48e-2d08-46b5-b45b-32c4ed5ff76d tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lazy-loading 'fault' on Instance uuid 4ba108c9-d3fc-442d-9ce5-b6f78e900ead {{(pid=117715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 07:57:45.654665 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-46edf48e-2d08-46b5-b45b-32c4ed5ff76d tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc97d25991d24cf9bb84f49366c895a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0898dc56ea6a416aae031efb7fefc46b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:57:45.663147 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-46edf48e-2d08-46b5-b45b-32c4ed5ff76d tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "GET /compute/v2.1/servers/4ba108c9-d3fc-442d-9ce5-b6f78e900ead" status: 200 len: 1328 microversion: 2.1 time: 0.116122 Jul 26 07:57:45.663963 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1165/2285] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:57:45 2022] GET /compute/v2.1/servers/4ba108c9-d3fc-442d-9ce5-b6f78e900ead => generated 1328 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:57:46.689599 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-5aa07937-614c-4ea7-a73a-f055d9d685f5 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:57:46.690826 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-5aa07937-614c-4ea7-a73a-f055d9d685f5 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 4ba108c9-d3fc-442d-9ce5-b6f78e900ead] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:57:46.700965 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5aa07937-614c-4ea7-a73a-f055d9d685f5 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:57:46.701398 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5aa07937-614c-4ea7-a73a-f055d9d685f5 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:57:46.702192 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5aa07937-614c-4ea7-a73a-f055d9d685f5 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:57:46.702618 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5aa07937-614c-4ea7-a73a-f055d9d685f5 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:57:46.717893 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.wsgi [None req-5aa07937-614c-4ea7-a73a-f055d9d685f5 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] HTTP exception thrown: Instance 4ba108c9-d3fc-442d-9ce5-b6f78e900ead could not be found. Jul 26 07:57:46.719483 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-5aa07937-614c-4ea7-a73a-f055d9d685f5 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Request method failure captured: Jul 26 07:57:46.719483 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: request: GET /compute/v2.1/servers/4ba108c9-d3fc-442d-9ce5-b6f78e900ead HTTP/1.1 Jul 26 07:57:46.719483 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept: application/json Jul 26 07:57:46.719483 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept-Encoding: identity Jul 26 07:57:46.719483 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Connection: close Jul 26 07:57:46.719483 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Length: 0 Jul 26 07:57:46.719483 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Type: application/json Jul 26 07:57:46.719483 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Host: 10.222.0.39 Jul 26 07:57:46.719483 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Openstack-System-Scope: None Jul 26 07:57:46.719483 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: User-Agent: python-urllib3/1.26.10 Jul 26 07:57:46.719483 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Auth-Token: gAAAAABi354JNUHIbkSiNg_V-C8FV5XhJGOPjJANDYsxeZqi8fp-h_FI6ggXhQ0PqHfTv8fVB0VJRbvKFHSgmkxYPjR1r6Y9DclyJ8clf5QhTEbHB9CjsfveTYchPV8oHrnZkxfk7pVCqI-Cu2niyu3S5wBOhU2taGkKGQ-mcQ9LS-iV5EXyVSM Jul 26 07:57:46.719483 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Id: None Jul 26 07:57:46.719483 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Name: None Jul 26 07:57:46.719483 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Identity-Status: Confirmed Jul 26 07:57:46.719483 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Is-Admin-Project: True Jul 26 07:57:46.719483 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Id: default Jul 26 07:57:46.719483 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Name: Default Jul 26 07:57:46.719483 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Id: 0898dc56ea6a416aae031efb7fefc46b Jul 26 07:57:46.719483 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Name: tempest-AttachVolumeTestJSON-249023717 Jul 26 07:57:46.719483 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Role: member,reader Jul 26 07:57:46.719483 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Roles: member,reader Jul 26 07:57:46.721208 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0898dc56ea6a416aae031efb7fefc46b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0898dc56ea6a416aae031efb7fefc46b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0898dc56ea6a416aae031efb7fefc46b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0898dc56ea6a416aae031efb7fefc46b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:57:46.721208 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant: tempest-AttachVolumeTestJSON-249023717 Jul 26 07:57:46.721208 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Id: 0898dc56ea6a416aae031efb7fefc46b Jul 26 07:57:46.721208 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Name: tempest-AttachVolumeTestJSON-249023717 Jul 26 07:57:46.721208 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User: tempest-AttachVolumeTestJSON-249023717-project Jul 26 07:57:46.721208 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Id: default Jul 26 07:57:46.721208 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Name: Default Jul 26 07:57:46.721208 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Id: dc97d25991d24cf9bb84f49366c895a6 Jul 26 07:57:46.721208 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Name: tempest-AttachVolumeTestJSON-249023717-project Jul 26 07:57:46.721208 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: method: > Jul 26 07:57:46.721208 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: exception: Instance 4ba108c9-d3fc-442d-9ce5-b6f78e900ead could not be found. Jul 26 07:57:46.721208 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: action_args: {'id': '4ba108c9-d3fc-442d-9ce5-b6f78e900ead'} Jul 26 07:57:46.722529 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:57:46.722529 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:57:46.722529 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 07:57:46.722529 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 07:57:46.722529 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 07:57:46.722529 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 07:57:46.722529 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 07:57:46.722529 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 07:57:46.722529 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 07:57:46.722529 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 07:57:46.722529 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ba108c9-d3fc-442d-9ce5-b6f78e900ead could not be found. Jul 26 07:57:46.722529 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:57:46.722529 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:57:46.722529 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:57:46.722529 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:57:46.722529 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:57:46.722529 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:57:46.722529 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:57:46.722529 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:57:46.722529 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:57:46.724211 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:57:46.724211 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 07:57:46.724211 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 07:57:46.724211 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 07:57:46.724211 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 07:57:46.724211 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 07:57:46.724211 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:57:46.724211 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ba108c9-d3fc-442d-9ce5-b6f78e900ead could not be found. Jul 26 07:57:46.724211 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:57:46.724211 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:57:46.724211 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:57:46.724211 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:57:46.724211 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:57:46.724211 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:57:46.724211 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:57:46.724211 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:57:46.724211 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ba108c9-d3fc-442d-9ce5-b6f78e900ead could not be found. Jul 26 07:57:46.724211 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:57:46.725838 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-5aa07937-614c-4ea7-a73a-f055d9d685f5 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Returning 404 to user: Instance 4ba108c9-d3fc-442d-9ce5-b6f78e900ead could not be found. {{(pid=117716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:57:46.725838 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-5aa07937-614c-4ea7-a73a-f055d9d685f5 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "GET /compute/v2.1/servers/4ba108c9-d3fc-442d-9ce5-b6f78e900ead" status: 404 len: 111 microversion: 2.1 time: 0.038291 Jul 26 07:57:46.725838 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1121/2286] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:57:46 2022] GET /compute/v2.1/servers/4ba108c9-d3fc-442d-9ce5-b6f78e900ead => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 07:57:46.730619 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8f3c9d4a-b00e-4226-b227-df6a72f29244 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Calling method '.version_select at 0x7f7f0260f9d0>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:57:46.752070 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8f3c9d4a-b00e-4226-b227-df6a72f29244 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1007971507" status: 202 len: 0 microversion: 2.1 time: 0.026134 Jul 26 07:57:46.752627 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1166/2287] 10.222.0.39 () {58 vars in 1221 bytes} [Tue Jul 26 07:57:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1007971507 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 07:57:47.383663 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-108ccb29-666c-415c-9ad5-e64287f3ea5e tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Action: 'create', calling method: .version_select at 0x7f7f06f28a60>, body: {"keypair": {"name": "tempest-keypair-1048195692", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCpF0ntpwlOIe0sxxAXFUi//0KUX9ytIjigmiLkU83LXX6sD8MZ7gO/qXHCzeLXmCaC7eO86FYqwoXt0GBmJ5d2+50Ipb1YcJmIppfyFAlW27VIH43R/4DxhbvnAm1lwNg=="}} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:57:47.400092 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.quota [None req-108ccb29-666c-415c-9ad5-e64287f3ea5e tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Getting quotas for project 0898dc56ea6a416aae031efb7fefc46b. Resources: {'key_pairs'} {{(pid=117716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 07:57:47.404314 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.quota [None req-108ccb29-666c-415c-9ad5-e64287f3ea5e tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Getting quotas for user dc97d25991d24cf9bb84f49366c895a6 and project 0898dc56ea6a416aae031efb7fefc46b. Resources: {'key_pairs'} {{(pid=117716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 07:57:47.436346 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-108ccb29-666c-415c-9ad5-e64287f3ea5e tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056639 Jul 26 07:57:47.436989 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1122/2288] 10.222.0.39 () {60 vars in 1159 bytes} [Tue Jul 26 07:57:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:57:48.714740 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-31817c65-a192-4648-a946-5d930aafd90b tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2139604748", "imageRef": "b9589773-813f-42af-846a-43bcf9d4d002", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "566d56f0-0e97-4933-aad2-fef7f099951d"}], "security_groups": [{"name": "tempest-securitygroup--1920186913"}], "key_name": "tempest-keypair-1048195692", "user_data": "}} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:57:48.817066 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.network.neutron [None req-31817c65-a192-4648-a946-5d930aafd90b tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] validate_networks() for [('566d56f0-0e97-4933-aad2-fef7f099951d', None, None, None, None, None)] {{(pid=117715) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 07:57:49.293068 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-31817c65-a192-4648-a946-5d930aafd90b tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Flavor limits 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 07:57:49.293483 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-31817c65-a192-4648-a946-5d930aafd90b tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Image limits 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 07:57:49.293994 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-31817c65-a192-4648-a946-5d930aafd90b tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Flavor pref 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 07:57:49.294397 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-31817c65-a192-4648-a946-5d930aafd90b tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Image pref 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 07:57:49.294796 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-31817c65-a192-4648-a946-5d930aafd90b tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 07:57:49.304146 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-31817c65-a192-4648-a946-5d930aafd90b tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:57:49.304587 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-31817c65-a192-4648-a946-5d930aafd90b tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:57:49.305374 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-31817c65-a192-4648-a946-5d930aafd90b tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:57:49.305842 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-31817c65-a192-4648-a946-5d930aafd90b tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:57:49.324021 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.quota [None req-31817c65-a192-4648-a946-5d930aafd90b tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Getting quotas for project 0898dc56ea6a416aae031efb7fefc46b. Resources: {'instances', 'cores', 'ram'} {{(pid=117715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 07:57:49.328257 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.quota [None req-31817c65-a192-4648-a946-5d930aafd90b tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Getting quotas for user dc97d25991d24cf9bb84f49366c895a6 and project 0898dc56ea6a416aae031efb7fefc46b. Resources: {'instances', 'cores', 'ram'} {{(pid=117715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 07:57:49.339321 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-31817c65-a192-4648-a946-5d930aafd90b tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Going to run 1 instances... {{(pid=117715) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 07:57:49.341565 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-31817c65-a192-4648-a946-5d930aafd90b tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 44346319-f122-4c22-9867-4772c5e687a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9589773-813f-42af-846a-43bcf9d4d002',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 07:57:49.389575 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-31817c65-a192-4648-a946-5d930aafd90b tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.679610 Jul 26 07:57:49.390430 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1167/2289] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Jul 26 07:57:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 07:57:49.401652 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-916f0914-682d-4d57-8a59-d9a7c9a72a2a tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:57:49.402285 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-916f0914-682d-4d57-8a59-d9a7c9a72a2a tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 44346319-f122-4c22-9867-4772c5e687a8] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:57:49.458552 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-916f0914-682d-4d57-8a59-d9a7c9a72a2a tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc97d25991d24cf9bb84f49366c895a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0898dc56ea6a416aae031efb7fefc46b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:57:49.466405 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-916f0914-682d-4d57-8a59-d9a7c9a72a2a tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "GET /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8" status: 200 len: 1238 microversion: 2.1 time: 0.069114 Jul 26 07:57:49.467185 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1123/2290] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:57:49 2022] GET /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8 => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:57:50.487686 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-bf3023f2-8a44-4587-aec6-df9747fe691e tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:57:50.490979 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-bf3023f2-8a44-4587-aec6-df9747fe691e tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 44346319-f122-4c22-9867-4772c5e687a8] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:57:50.498345 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bf3023f2-8a44-4587-aec6-df9747fe691e tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:57:50.498798 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bf3023f2-8a44-4587-aec6-df9747fe691e tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:57:50.499568 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bf3023f2-8a44-4587-aec6-df9747fe691e tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:57:50.499997 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-bf3023f2-8a44-4587-aec6-df9747fe691e tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:57:50.578533 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-bf3023f2-8a44-4587-aec6-df9747fe691e tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc97d25991d24cf9bb84f49366c895a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0898dc56ea6a416aae031efb7fefc46b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:57:50.586720 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-bf3023f2-8a44-4587-aec6-df9747fe691e tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "GET /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8" status: 200 len: 1296 microversion: 2.1 time: 0.103788 Jul 26 07:57:50.587302 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1168/2291] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:57:50 2022] GET /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8 => generated 1296 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:57:51.609309 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-3cc0f11d-c422-42d2-9f35-5f42fba9a3f0 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:57:51.609965 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-3cc0f11d-c422-42d2-9f35-5f42fba9a3f0 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 44346319-f122-4c22-9867-4772c5e687a8] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:57:51.617558 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3cc0f11d-c422-42d2-9f35-5f42fba9a3f0 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:57:51.618139 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3cc0f11d-c422-42d2-9f35-5f42fba9a3f0 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:57:51.619038 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3cc0f11d-c422-42d2-9f35-5f42fba9a3f0 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:57:51.619560 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-3cc0f11d-c422-42d2-9f35-5f42fba9a3f0 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:57:51.748163 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-af32c4af-0318-403a-8bfe-c99a79507bd4 req-9cb7f29c-05fd-4bb5-a79e-b5b9d67b1265 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44346319-f122-4c22-9867-4772c5e687a8", "tag": "72953bd0-cc86-4624-b60f-a33e12292f95"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:57:51.762582 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-af32c4af-0318-403a-8bfe-c99a79507bd4 req-9cb7f29c-05fd-4bb5-a79e-b5b9d67b1265 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:57:51.763108 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-af32c4af-0318-403a-8bfe-c99a79507bd4 req-9cb7f29c-05fd-4bb5-a79e-b5b9d67b1265 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:57:51.766599 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-3cc0f11d-c422-42d2-9f35-5f42fba9a3f0 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc97d25991d24cf9bb84f49366c895a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0898dc56ea6a416aae031efb7fefc46b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:57:51.775614 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-3cc0f11d-c422-42d2-9f35-5f42fba9a3f0 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "GET /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8" status: 200 len: 1364 microversion: 2.1 time: 0.170420 Jul 26 07:57:51.776581 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1124/2292] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:57:51 2022] GET /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:57:51.778062 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-af32c4af-0318-403a-8bfe-c99a79507bd4 req-9cb7f29c-05fd-4bb5-a79e-b5b9d67b1265 service nova] Creating event network-changed:72953bd0-cc86-4624-b60f-a33e12292f95 for instance 44346319-f122-4c22-9867-4772c5e687a8 on hv-cinder-85083 Jul 26 07:57:51.795766 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-af32c4af-0318-403a-8bfe-c99a79507bd4 req-9cb7f29c-05fd-4bb5-a79e-b5b9d67b1265 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051981 Jul 26 07:57:51.796599 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1169/2293] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 07:57:52.796688 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-14b400fc-d317-4c34-a462-81ba4e44ec0d tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:57:52.797301 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-14b400fc-d317-4c34-a462-81ba4e44ec0d tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 44346319-f122-4c22-9867-4772c5e687a8] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:57:52.804379 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-14b400fc-d317-4c34-a462-81ba4e44ec0d tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:57:52.804827 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-14b400fc-d317-4c34-a462-81ba4e44ec0d tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:57:52.805596 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-14b400fc-d317-4c34-a462-81ba4e44ec0d tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:57:52.806045 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-14b400fc-d317-4c34-a462-81ba4e44ec0d tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:57:52.939094 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-14b400fc-d317-4c34-a462-81ba4e44ec0d tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc97d25991d24cf9bb84f49366c895a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0898dc56ea6a416aae031efb7fefc46b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:57:52.946703 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-14b400fc-d317-4c34-a462-81ba4e44ec0d tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "GET /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8" status: 200 len: 1364 microversion: 2.1 time: 0.153976 Jul 26 07:57:52.947636 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1125/2294] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:57:52 2022] GET /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:57:53.973042 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b14fdf5d-e133-4007-a411-ec95e3f7d6fb tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:57:53.974264 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b14fdf5d-e133-4007-a411-ec95e3f7d6fb tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 44346319-f122-4c22-9867-4772c5e687a8] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:57:53.986177 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b14fdf5d-e133-4007-a411-ec95e3f7d6fb tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:57:53.986623 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b14fdf5d-e133-4007-a411-ec95e3f7d6fb tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:57:53.987412 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b14fdf5d-e133-4007-a411-ec95e3f7d6fb tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:57:53.987838 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b14fdf5d-e133-4007-a411-ec95e3f7d6fb tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:57:54.118316 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-b14fdf5d-e133-4007-a411-ec95e3f7d6fb tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc97d25991d24cf9bb84f49366c895a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0898dc56ea6a416aae031efb7fefc46b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:57:54.125752 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b14fdf5d-e133-4007-a411-ec95e3f7d6fb tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "GET /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8" status: 200 len: 1364 microversion: 2.1 time: 0.159812 Jul 26 07:57:54.126324 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1170/2295] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:57:53 2022] GET /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:57:55.149653 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0c13bdce-5eb8-4ed2-8325-59fedd33a0b3 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:57:55.150318 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0c13bdce-5eb8-4ed2-8325-59fedd33a0b3 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 44346319-f122-4c22-9867-4772c5e687a8] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:57:55.157555 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0c13bdce-5eb8-4ed2-8325-59fedd33a0b3 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:57:55.158026 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0c13bdce-5eb8-4ed2-8325-59fedd33a0b3 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:57:55.158815 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0c13bdce-5eb8-4ed2-8325-59fedd33a0b3 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:57:55.159247 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0c13bdce-5eb8-4ed2-8325-59fedd33a0b3 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:57:55.292747 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-0c13bdce-5eb8-4ed2-8325-59fedd33a0b3 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc97d25991d24cf9bb84f49366c895a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0898dc56ea6a416aae031efb7fefc46b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:57:55.300448 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0c13bdce-5eb8-4ed2-8325-59fedd33a0b3 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "GET /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8" status: 200 len: 1364 microversion: 2.1 time: 0.154806 Jul 26 07:57:55.301038 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1126/2296] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:57:55 2022] GET /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:57:56.324788 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-5acb8b8f-057d-4b54-85ff-dc8f09badd8a tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:57:56.325464 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-5acb8b8f-057d-4b54-85ff-dc8f09badd8a tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 44346319-f122-4c22-9867-4772c5e687a8] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:57:56.332667 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5acb8b8f-057d-4b54-85ff-dc8f09badd8a tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:57:56.333116 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5acb8b8f-057d-4b54-85ff-dc8f09badd8a tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:57:56.333912 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5acb8b8f-057d-4b54-85ff-dc8f09badd8a tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:57:56.334341 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5acb8b8f-057d-4b54-85ff-dc8f09badd8a tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:57:56.468005 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-5acb8b8f-057d-4b54-85ff-dc8f09badd8a tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc97d25991d24cf9bb84f49366c895a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0898dc56ea6a416aae031efb7fefc46b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:57:56.475803 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-5acb8b8f-057d-4b54-85ff-dc8f09badd8a tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "GET /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8" status: 200 len: 1364 microversion: 2.1 time: 0.156938 Jul 26 07:57:56.476375 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1171/2297] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:57:56 2022] GET /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:57:57.041902 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-349fc001-09b4-4f4e-ad89-2b58ecead948 req-3b66a8dd-c509-4569-8779-dfcb489aa923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44346319-f122-4c22-9867-4772c5e687a8", "name": "network-vif-plugged", "status": "completed", "tag": "72953bd0-cc86-4624-b60f-a33e12292f95"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:57:57.053397 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-349fc001-09b4-4f4e-ad89-2b58ecead948 req-3b66a8dd-c509-4569-8779-dfcb489aa923 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:57:57.054200 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-349fc001-09b4-4f4e-ad89-2b58ecead948 req-3b66a8dd-c509-4569-8779-dfcb489aa923 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:57:57.066862 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-349fc001-09b4-4f4e-ad89-2b58ecead948 req-3b66a8dd-c509-4569-8779-dfcb489aa923 service nova] Creating event network-vif-plugged:72953bd0-cc86-4624-b60f-a33e12292f95 for instance 44346319-f122-4c22-9867-4772c5e687a8 on hv-cinder-85083 Jul 26 07:57:57.072430 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-349fc001-09b4-4f4e-ad89-2b58ecead948 req-3b66a8dd-c509-4569-8779-dfcb489aa923 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034906 Jul 26 07:57:57.073244 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1127/2298] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:57:57.497185 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d163ff12-523b-47b2-8168-840b429fa211 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:57:57.497859 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d163ff12-523b-47b2-8168-840b429fa211 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 44346319-f122-4c22-9867-4772c5e687a8] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:57:57.504835 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d163ff12-523b-47b2-8168-840b429fa211 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:57:57.505273 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d163ff12-523b-47b2-8168-840b429fa211 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:57:57.506068 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d163ff12-523b-47b2-8168-840b429fa211 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:57:57.506499 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d163ff12-523b-47b2-8168-840b429fa211 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:57:57.642198 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d163ff12-523b-47b2-8168-840b429fa211 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc97d25991d24cf9bb84f49366c895a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0898dc56ea6a416aae031efb7fefc46b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:57:57.652895 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d163ff12-523b-47b2-8168-840b429fa211 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "GET /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8" status: 200 len: 1364 microversion: 2.1 time: 0.159901 Jul 26 07:57:57.653727 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1172/2299] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:57:57 2022] GET /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:57:58.675059 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-4139a81f-95a7-48b0-8549-efc9dec4b193 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:57:58.675807 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-4139a81f-95a7-48b0-8549-efc9dec4b193 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 44346319-f122-4c22-9867-4772c5e687a8] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:57:58.682961 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4139a81f-95a7-48b0-8549-efc9dec4b193 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:57:58.683379 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4139a81f-95a7-48b0-8549-efc9dec4b193 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:57:58.684223 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4139a81f-95a7-48b0-8549-efc9dec4b193 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:57:58.684682 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4139a81f-95a7-48b0-8549-efc9dec4b193 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:57:58.822516 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-4139a81f-95a7-48b0-8549-efc9dec4b193 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc97d25991d24cf9bb84f49366c895a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0898dc56ea6a416aae031efb7fefc46b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:57:58.830780 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-4139a81f-95a7-48b0-8549-efc9dec4b193 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "GET /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8" status: 200 len: 1364 microversion: 2.1 time: 0.160021 Jul 26 07:57:58.831331 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1128/2300] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:57:58 2022] GET /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:57:59.856428 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-30fe2510-5215-409a-8bbf-d33ccf618673 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:57:59.857255 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-30fe2510-5215-409a-8bbf-d33ccf618673 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 44346319-f122-4c22-9867-4772c5e687a8] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:57:59.860416 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell0:SELECT=2 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:57:59.861310 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell0:SELECT=6 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:57:59.869510 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-30fe2510-5215-409a-8bbf-d33ccf618673 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:57:59.870121 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-30fe2510-5215-409a-8bbf-d33ccf618673 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:57:59.871116 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-30fe2510-5215-409a-8bbf-d33ccf618673 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:57:59.871681 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-30fe2510-5215-409a-8bbf-d33ccf618673 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:58:00.007574 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-30fe2510-5215-409a-8bbf-d33ccf618673 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc97d25991d24cf9bb84f49366c895a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0898dc56ea6a416aae031efb7fefc46b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:58:00.015243 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-30fe2510-5215-409a-8bbf-d33ccf618673 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "GET /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8" status: 200 len: 1551 microversion: 2.1 time: 0.165111 Jul 26 07:58:00.015809 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1173/2301] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:57:59 2022] GET /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8 => generated 1551 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:58:00.035947 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9610d094-0f95-44d8-9027-813277a429ba tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:58:00.036496 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-9610d094-0f95-44d8-9027-813277a429ba tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 44346319-f122-4c22-9867-4772c5e687a8] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:58:00.038406 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell0:SELECT=6 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:58:00.044568 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9610d094-0f95-44d8-9027-813277a429ba tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:58:00.045015 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9610d094-0f95-44d8-9027-813277a429ba tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:58:00.045825 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9610d094-0f95-44d8-9027-813277a429ba tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:58:00.046269 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9610d094-0f95-44d8-9027-813277a429ba tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:58:00.136774 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-9610d094-0f95-44d8-9027-813277a429ba tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "GET /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104562 Jul 26 07:58:00.137568 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1129/2302] 10.222.0.39 () {58 vars in 1275 bytes} [Tue Jul 26 07:58:00 2022] GET /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:58:01.318896 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-28f394d6-c5a7-4c03-8e79-568a443e2677 req-b147cf2c-1e47-4d54-b034-9c5cf767764b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44346319-f122-4c22-9867-4772c5e687a8", "tag": "72953bd0-cc86-4624-b60f-a33e12292f95"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:58:01.329223 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-28f394d6-c5a7-4c03-8e79-568a443e2677 req-b147cf2c-1e47-4d54-b034-9c5cf767764b service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:58:01.329663 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-28f394d6-c5a7-4c03-8e79-568a443e2677 req-b147cf2c-1e47-4d54-b034-9c5cf767764b service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:58:01.340785 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-28f394d6-c5a7-4c03-8e79-568a443e2677 req-b147cf2c-1e47-4d54-b034-9c5cf767764b service nova] Creating event network-changed:72953bd0-cc86-4624-b60f-a33e12292f95 for instance 44346319-f122-4c22-9867-4772c5e687a8 on hv-cinder-85083 Jul 26 07:58:01.345962 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-28f394d6-c5a7-4c03-8e79-568a443e2677 req-b147cf2c-1e47-4d54-b034-9c5cf767764b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030805 Jul 26 07:58:01.346548 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1174/2303] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:58:30.865305 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:58:30.866620 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=40 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:58:30.874896 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f6ad519a-a40a-4781-91ef-b69639c8f5ea tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:58:30.875711 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-f6ad519a-a40a-4781-91ef-b69639c8f5ea tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 44346319-f122-4c22-9867-4772c5e687a8] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:58:30.887422 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f6ad519a-a40a-4781-91ef-b69639c8f5ea tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:58:30.887871 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f6ad519a-a40a-4781-91ef-b69639c8f5ea tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:58:30.888616 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f6ad519a-a40a-4781-91ef-b69639c8f5ea tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:58:30.889045 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f6ad519a-a40a-4781-91ef-b69639c8f5ea tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:58:30.914270 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f6ad519a-a40a-4781-91ef-b69639c8f5ea tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "GET /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8/ips" status: 200 len: 146 microversion: 2.1 time: 0.051278 Jul 26 07:58:30.914827 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1130/2304] 10.222.0.39 () {58 vars in 1248 bytes} [Tue Jul 26 07:58:30 2022] GET /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8/ips => generated 146 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:59:07.277069 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 07:59:07.278308 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Tue Jul 26 07:59:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 07:59:30.988060 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:59:30.988875 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:59:30.993527 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-031c724e-a46f-4e73-8adc-51119ea358fc tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:59:30.994159 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-031c724e-a46f-4e73-8adc-51119ea358fc tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 44346319-f122-4c22-9867-4772c5e687a8] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:59:31.002540 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-031c724e-a46f-4e73-8adc-51119ea358fc tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:59:31.003037 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-031c724e-a46f-4e73-8adc-51119ea358fc tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:59:31.004200 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-031c724e-a46f-4e73-8adc-51119ea358fc tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:59:31.005227 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-031c724e-a46f-4e73-8adc-51119ea358fc tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:59:31.034076 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-031c724e-a46f-4e73-8adc-51119ea358fc tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 44346319-f122-4c22-9867-4772c5e687a8] Going to try to terminate instance {{(pid=117715) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 07:59:31.111693 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-031c724e-a46f-4e73-8adc-51119ea358fc tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "DELETE /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8" status: 204 len: 0 microversion: 2.1 time: 0.125637 Jul 26 07:59:31.112318 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1175/2305] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Jul 26 07:59:30 2022] DELETE /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 07:59:31.119673 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=2 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:59:31.120655 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=4 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:59:31.126113 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-79b56a1e-7f44-4bd6-92fe-e0b11f2e29ab tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:59:31.127456 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-79b56a1e-7f44-4bd6-92fe-e0b11f2e29ab tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 44346319-f122-4c22-9867-4772c5e687a8] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:59:31.134560 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-79b56a1e-7f44-4bd6-92fe-e0b11f2e29ab tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:59:31.135002 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-79b56a1e-7f44-4bd6-92fe-e0b11f2e29ab tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:59:31.135742 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-79b56a1e-7f44-4bd6-92fe-e0b11f2e29ab tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:59:31.136164 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-79b56a1e-7f44-4bd6-92fe-e0b11f2e29ab tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:59:31.278266 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-79b56a1e-7f44-4bd6-92fe-e0b11f2e29ab tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc97d25991d24cf9bb84f49366c895a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0898dc56ea6a416aae031efb7fefc46b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:59:31.285843 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-79b56a1e-7f44-4bd6-92fe-e0b11f2e29ab tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "GET /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8" status: 200 len: 1675 microversion: 2.1 time: 0.168501 Jul 26 07:59:31.286400 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1131/2306] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:59:31 2022] GET /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8 => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:59:32.312558 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-674124dd-d2f9-42af-948c-a3575a9c1e20 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:59:32.313762 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-674124dd-d2f9-42af-948c-a3575a9c1e20 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 44346319-f122-4c22-9867-4772c5e687a8] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:59:32.320647 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-674124dd-d2f9-42af-948c-a3575a9c1e20 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:59:32.321097 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-674124dd-d2f9-42af-948c-a3575a9c1e20 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:59:32.322239 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-674124dd-d2f9-42af-948c-a3575a9c1e20 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:59:32.322663 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-674124dd-d2f9-42af-948c-a3575a9c1e20 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:59:32.501973 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-674124dd-d2f9-42af-948c-a3575a9c1e20 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc97d25991d24cf9bb84f49366c895a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0898dc56ea6a416aae031efb7fefc46b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:59:32.509910 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-674124dd-d2f9-42af-948c-a3575a9c1e20 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "GET /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8" status: 200 len: 1675 microversion: 2.1 time: 0.204544 Jul 26 07:59:32.510454 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1176/2307] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:59:32 2022] GET /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8 => generated 1675 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:59:33.307486 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-1764bde6-ae0c-4b89-92d7-5961d6b407e6 req-da4c553c-b316-49b4-a004-abf4659f2bd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44346319-f122-4c22-9867-4772c5e687a8", "name": "network-vif-deleted", "tag": "72953bd0-cc86-4624-b60f-a33e12292f95"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 07:59:33.320340 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-1764bde6-ae0c-4b89-92d7-5961d6b407e6 req-da4c553c-b316-49b4-a004-abf4659f2bd8 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:59:33.320785 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-1764bde6-ae0c-4b89-92d7-5961d6b407e6 req-da4c553c-b316-49b4-a004-abf4659f2bd8 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:59:33.333377 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-1764bde6-ae0c-4b89-92d7-5961d6b407e6 req-da4c553c-b316-49b4-a004-abf4659f2bd8 service nova] Creating event network-vif-deleted:72953bd0-cc86-4624-b60f-a33e12292f95 for instance 44346319-f122-4c22-9867-4772c5e687a8 on hv-cinder-85083 Jul 26 07:59:33.339764 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-1764bde6-ae0c-4b89-92d7-5961d6b407e6 req-da4c553c-b316-49b4-a004-abf4659f2bd8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037637 Jul 26 07:59:33.340689 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1132/2308] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 07:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 07:59:33.532851 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c0cbe553-2abd-4939-849c-12518cb931db tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:59:33.533589 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c0cbe553-2abd-4939-849c-12518cb931db tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 44346319-f122-4c22-9867-4772c5e687a8] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:59:33.541419 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c0cbe553-2abd-4939-849c-12518cb931db tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:59:33.541967 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c0cbe553-2abd-4939-849c-12518cb931db tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:59:33.542804 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c0cbe553-2abd-4939-849c-12518cb931db tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:59:33.543233 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c0cbe553-2abd-4939-849c-12518cb931db tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:59:33.574643 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c0cbe553-2abd-4939-849c-12518cb931db tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:59:33.575088 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c0cbe553-2abd-4939-849c-12518cb931db tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:59:33.575531 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.objects.instance [None req-c0cbe553-2abd-4939-849c-12518cb931db tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lazy-loading 'fault' on Instance uuid 44346319-f122-4c22-9867-4772c5e687a8 {{(pid=117715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 07:59:33.620174 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c0cbe553-2abd-4939-849c-12518cb931db tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc97d25991d24cf9bb84f49366c895a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0898dc56ea6a416aae031efb7fefc46b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 07:59:33.627750 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c0cbe553-2abd-4939-849c-12518cb931db tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "GET /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8" status: 200 len: 1328 microversion: 2.1 time: 0.099437 Jul 26 07:59:33.628482 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1177/2309] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:59:33 2022] GET /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8 => generated 1328 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 07:59:34.653919 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-73a84d6b-fada-44a9-ade3-a118d84d9999 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:59:34.654973 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-73a84d6b-fada-44a9-ade3-a118d84d9999 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 44346319-f122-4c22-9867-4772c5e687a8] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:59:34.663065 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-73a84d6b-fada-44a9-ade3-a118d84d9999 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:59:34.663503 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-73a84d6b-fada-44a9-ade3-a118d84d9999 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:59:34.664256 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-73a84d6b-fada-44a9-ade3-a118d84d9999 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:59:34.664683 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-73a84d6b-fada-44a9-ade3-a118d84d9999 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:59:34.678123 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.wsgi [None req-73a84d6b-fada-44a9-ade3-a118d84d9999 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] HTTP exception thrown: Instance 44346319-f122-4c22-9867-4772c5e687a8 could not be found. Jul 26 07:59:34.679742 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-73a84d6b-fada-44a9-ade3-a118d84d9999 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Request method failure captured: Jul 26 07:59:34.679742 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: request: GET /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8 HTTP/1.1 Jul 26 07:59:34.679742 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept: application/json Jul 26 07:59:34.679742 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept-Encoding: identity Jul 26 07:59:34.679742 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Connection: close Jul 26 07:59:34.679742 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Length: 0 Jul 26 07:59:34.679742 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Type: application/json Jul 26 07:59:34.679742 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Host: 10.222.0.39 Jul 26 07:59:34.679742 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Openstack-System-Scope: None Jul 26 07:59:34.679742 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: User-Agent: python-urllib3/1.26.10 Jul 26 07:59:34.679742 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Auth-Token: gAAAAABi354JNUHIbkSiNg_V-C8FV5XhJGOPjJANDYsxeZqi8fp-h_FI6ggXhQ0PqHfTv8fVB0VJRbvKFHSgmkxYPjR1r6Y9DclyJ8clf5QhTEbHB9CjsfveTYchPV8oHrnZkxfk7pVCqI-Cu2niyu3S5wBOhU2taGkKGQ-mcQ9LS-iV5EXyVSM Jul 26 07:59:34.679742 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Id: None Jul 26 07:59:34.679742 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Name: None Jul 26 07:59:34.679742 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Identity-Status: Confirmed Jul 26 07:59:34.679742 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Is-Admin-Project: True Jul 26 07:59:34.679742 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Id: default Jul 26 07:59:34.679742 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Name: Default Jul 26 07:59:34.679742 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Id: 0898dc56ea6a416aae031efb7fefc46b Jul 26 07:59:34.679742 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Name: tempest-AttachVolumeTestJSON-249023717 Jul 26 07:59:34.679742 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Role: member,reader Jul 26 07:59:34.679742 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Roles: member,reader Jul 26 07:59:34.681567 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0898dc56ea6a416aae031efb7fefc46b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0898dc56ea6a416aae031efb7fefc46b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0898dc56ea6a416aae031efb7fefc46b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0898dc56ea6a416aae031efb7fefc46b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:59:34.681567 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant: tempest-AttachVolumeTestJSON-249023717 Jul 26 07:59:34.681567 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Id: 0898dc56ea6a416aae031efb7fefc46b Jul 26 07:59:34.681567 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Name: tempest-AttachVolumeTestJSON-249023717 Jul 26 07:59:34.681567 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User: tempest-AttachVolumeTestJSON-249023717-project Jul 26 07:59:34.681567 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Id: default Jul 26 07:59:34.681567 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Name: Default Jul 26 07:59:34.681567 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Id: dc97d25991d24cf9bb84f49366c895a6 Jul 26 07:59:34.681567 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Name: tempest-AttachVolumeTestJSON-249023717-project Jul 26 07:59:34.681567 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: method: > Jul 26 07:59:34.681567 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: exception: Instance 44346319-f122-4c22-9867-4772c5e687a8 could not be found. Jul 26 07:59:34.681567 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: action_args: {'id': '44346319-f122-4c22-9867-4772c5e687a8'} Jul 26 07:59:34.682635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:59:34.682635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:59:34.682635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 07:59:34.682635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 07:59:34.682635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 07:59:34.682635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 07:59:34.682635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 07:59:34.682635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 07:59:34.682635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 07:59:34.682635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 07:59:34.682635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44346319-f122-4c22-9867-4772c5e687a8 could not be found. Jul 26 07:59:34.682635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:59:34.682635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:59:34.682635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:59:34.682635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:59:34.682635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:59:34.682635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:59:34.682635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:59:34.682635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:59:34.682635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:59:34.684405 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:59:34.684405 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 07:59:34.684405 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 07:59:34.684405 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 07:59:34.684405 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 07:59:34.684405 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 07:59:34.684405 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:59:34.684405 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44346319-f122-4c22-9867-4772c5e687a8 could not be found. Jul 26 07:59:34.684405 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:59:34.684405 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:59:34.684405 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:59:34.684405 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:59:34.684405 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:59:34.684405 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:59:34.684405 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:59:34.684405 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:59:34.684405 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44346319-f122-4c22-9867-4772c5e687a8 could not be found. Jul 26 07:59:34.684405 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:59:34.686062 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-73a84d6b-fada-44a9-ade3-a118d84d9999 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Returning 404 to user: Instance 44346319-f122-4c22-9867-4772c5e687a8 could not be found. {{(pid=117716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:59:34.686062 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-73a84d6b-fada-44a9-ade3-a118d84d9999 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "GET /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8" status: 404 len: 111 microversion: 2.1 time: 0.034378 Jul 26 07:59:34.686062 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1133/2310] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:59:34 2022] GET /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 07:59:34.690226 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-eb450f4f-73aa-4226-bd6a-65bf2cc095ae tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Calling method '.version_select at 0x7f7f026768b0>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:59:34.717590 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-eb450f4f-73aa-4226-bd6a-65bf2cc095ae tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1048195692" status: 202 len: 0 microversion: 2.1 time: 0.031005 Jul 26 07:59:34.718382 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1178/2311] 10.222.0.39 () {58 vars in 1221 bytes} [Tue Jul 26 07:59:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1048195692 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 07:59:35.342669 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6006ff30-038b-4c5c-8c21-5d5a20af33d1 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:59:35.343166 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6006ff30-038b-4c5c-8c21-5d5a20af33d1 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 44346319-f122-4c22-9867-4772c5e687a8] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:59:35.349476 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6006ff30-038b-4c5c-8c21-5d5a20af33d1 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:59:35.349971 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6006ff30-038b-4c5c-8c21-5d5a20af33d1 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:59:35.350742 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6006ff30-038b-4c5c-8c21-5d5a20af33d1 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:59:35.351172 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6006ff30-038b-4c5c-8c21-5d5a20af33d1 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:59:35.364292 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.wsgi [None req-6006ff30-038b-4c5c-8c21-5d5a20af33d1 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] HTTP exception thrown: Instance 44346319-f122-4c22-9867-4772c5e687a8 could not be found. Jul 26 07:59:35.365841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6006ff30-038b-4c5c-8c21-5d5a20af33d1 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Request method failure captured: Jul 26 07:59:35.365841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: request: DELETE /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8 HTTP/1.1 Jul 26 07:59:35.365841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept: application/json Jul 26 07:59:35.365841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept-Encoding: identity Jul 26 07:59:35.365841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Connection: close Jul 26 07:59:35.365841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Length: 0 Jul 26 07:59:35.365841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Type: application/json Jul 26 07:59:35.365841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Host: 10.222.0.39 Jul 26 07:59:35.365841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Openstack-System-Scope: None Jul 26 07:59:35.365841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: User-Agent: python-urllib3/1.26.10 Jul 26 07:59:35.365841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Auth-Token: gAAAAABi354JNUHIbkSiNg_V-C8FV5XhJGOPjJANDYsxeZqi8fp-h_FI6ggXhQ0PqHfTv8fVB0VJRbvKFHSgmkxYPjR1r6Y9DclyJ8clf5QhTEbHB9CjsfveTYchPV8oHrnZkxfk7pVCqI-Cu2niyu3S5wBOhU2taGkKGQ-mcQ9LS-iV5EXyVSM Jul 26 07:59:35.365841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Id: None Jul 26 07:59:35.365841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Name: None Jul 26 07:59:35.365841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Identity-Status: Confirmed Jul 26 07:59:35.365841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Is-Admin-Project: True Jul 26 07:59:35.365841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Id: default Jul 26 07:59:35.365841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Name: Default Jul 26 07:59:35.365841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Id: 0898dc56ea6a416aae031efb7fefc46b Jul 26 07:59:35.365841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Name: tempest-AttachVolumeTestJSON-249023717 Jul 26 07:59:35.365841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Role: member,reader Jul 26 07:59:35.365841 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Roles: member,reader Jul 26 07:59:35.367672 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0898dc56ea6a416aae031efb7fefc46b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0898dc56ea6a416aae031efb7fefc46b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0898dc56ea6a416aae031efb7fefc46b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0898dc56ea6a416aae031efb7fefc46b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:59:35.367672 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant: tempest-AttachVolumeTestJSON-249023717 Jul 26 07:59:35.367672 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Id: 0898dc56ea6a416aae031efb7fefc46b Jul 26 07:59:35.367672 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Name: tempest-AttachVolumeTestJSON-249023717 Jul 26 07:59:35.367672 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User: tempest-AttachVolumeTestJSON-249023717-project Jul 26 07:59:35.367672 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Id: default Jul 26 07:59:35.367672 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Name: Default Jul 26 07:59:35.367672 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Id: dc97d25991d24cf9bb84f49366c895a6 Jul 26 07:59:35.367672 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Name: tempest-AttachVolumeTestJSON-249023717-project Jul 26 07:59:35.367672 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: method: > Jul 26 07:59:35.367672 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: exception: Instance 44346319-f122-4c22-9867-4772c5e687a8 could not be found. Jul 26 07:59:35.367672 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: action_args: {'id': '44346319-f122-4c22-9867-4772c5e687a8'} Jul 26 07:59:35.371534 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:59:35.371534 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:59:35.371534 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 07:59:35.371534 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 07:59:35.371534 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 07:59:35.371534 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 07:59:35.371534 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 07:59:35.371534 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 07:59:35.371534 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 07:59:35.371534 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 07:59:35.371534 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44346319-f122-4c22-9867-4772c5e687a8 could not be found. Jul 26 07:59:35.371534 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:59:35.371534 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:59:35.371534 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:59:35.371534 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:59:35.371534 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:59:35.371534 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:59:35.371534 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:59:35.371534 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:59:35.371534 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:59:35.373107 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:59:35.373107 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 07:59:35.373107 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 07:59:35.373107 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 07:59:35.373107 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 07:59:35.373107 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 07:59:35.373107 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 07:59:35.373107 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 07:59:35.373107 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:59:35.373107 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44346319-f122-4c22-9867-4772c5e687a8 could not be found. Jul 26 07:59:35.373107 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:59:35.373107 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:59:35.373107 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:59:35.373107 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:59:35.373107 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:59:35.373107 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:59:35.373107 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:59:35.373107 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:59:35.373107 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44346319-f122-4c22-9867-4772c5e687a8 could not be found. Jul 26 07:59:35.373107 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:59:35.374773 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6006ff30-038b-4c5c-8c21-5d5a20af33d1 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Returning 404 to user: Instance 44346319-f122-4c22-9867-4772c5e687a8 could not be found. {{(pid=117716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:59:35.374773 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6006ff30-038b-4c5c-8c21-5d5a20af33d1 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "DELETE /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8" status: 404 len: 111 microversion: 2.1 time: 0.028478 Jul 26 07:59:35.374773 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1134/2312] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Jul 26 07:59:35 2022] DELETE /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 07:59:35.375819 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9ff07cc8-68d0-4d0d-8e16-a962343c89f0 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:59:35.376509 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-9ff07cc8-68d0-4d0d-8e16-a962343c89f0 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 44346319-f122-4c22-9867-4772c5e687a8] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:59:35.382920 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9ff07cc8-68d0-4d0d-8e16-a962343c89f0 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:59:35.383364 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9ff07cc8-68d0-4d0d-8e16-a962343c89f0 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:59:35.384157 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9ff07cc8-68d0-4d0d-8e16-a962343c89f0 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:59:35.384585 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9ff07cc8-68d0-4d0d-8e16-a962343c89f0 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:59:35.398231 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.wsgi [None req-9ff07cc8-68d0-4d0d-8e16-a962343c89f0 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] HTTP exception thrown: Instance 44346319-f122-4c22-9867-4772c5e687a8 could not be found. Jul 26 07:59:35.399898 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9ff07cc8-68d0-4d0d-8e16-a962343c89f0 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Request method failure captured: Jul 26 07:59:35.399898 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: request: GET /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8 HTTP/1.1 Jul 26 07:59:35.399898 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept: application/json Jul 26 07:59:35.399898 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept-Encoding: identity Jul 26 07:59:35.399898 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Connection: close Jul 26 07:59:35.399898 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Length: 0 Jul 26 07:59:35.399898 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Type: application/json Jul 26 07:59:35.399898 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Host: 10.222.0.39 Jul 26 07:59:35.399898 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Openstack-System-Scope: None Jul 26 07:59:35.399898 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: User-Agent: python-urllib3/1.26.10 Jul 26 07:59:35.399898 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Auth-Token: gAAAAABi354JNUHIbkSiNg_V-C8FV5XhJGOPjJANDYsxeZqi8fp-h_FI6ggXhQ0PqHfTv8fVB0VJRbvKFHSgmkxYPjR1r6Y9DclyJ8clf5QhTEbHB9CjsfveTYchPV8oHrnZkxfk7pVCqI-Cu2niyu3S5wBOhU2taGkKGQ-mcQ9LS-iV5EXyVSM Jul 26 07:59:35.399898 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Id: None Jul 26 07:59:35.399898 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Name: None Jul 26 07:59:35.399898 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Identity-Status: Confirmed Jul 26 07:59:35.399898 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Is-Admin-Project: True Jul 26 07:59:35.399898 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Id: default Jul 26 07:59:35.399898 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Name: Default Jul 26 07:59:35.399898 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Id: 0898dc56ea6a416aae031efb7fefc46b Jul 26 07:59:35.399898 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Name: tempest-AttachVolumeTestJSON-249023717 Jul 26 07:59:35.399898 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Role: member,reader Jul 26 07:59:35.399898 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Roles: member,reader Jul 26 07:59:35.401702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0898dc56ea6a416aae031efb7fefc46b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0898dc56ea6a416aae031efb7fefc46b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0898dc56ea6a416aae031efb7fefc46b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0898dc56ea6a416aae031efb7fefc46b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:59:35.401702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant: tempest-AttachVolumeTestJSON-249023717 Jul 26 07:59:35.401702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Id: 0898dc56ea6a416aae031efb7fefc46b Jul 26 07:59:35.401702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Name: tempest-AttachVolumeTestJSON-249023717 Jul 26 07:59:35.401702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User: tempest-AttachVolumeTestJSON-249023717-project Jul 26 07:59:35.401702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Id: default Jul 26 07:59:35.401702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Name: Default Jul 26 07:59:35.401702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Id: dc97d25991d24cf9bb84f49366c895a6 Jul 26 07:59:35.401702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Name: tempest-AttachVolumeTestJSON-249023717-project Jul 26 07:59:35.401702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: method: > Jul 26 07:59:35.401702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: exception: Instance 44346319-f122-4c22-9867-4772c5e687a8 could not be found. Jul 26 07:59:35.401702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: action_args: {'id': '44346319-f122-4c22-9867-4772c5e687a8'} Jul 26 07:59:35.402725 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:59:35.402725 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:59:35.402725 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 07:59:35.402725 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 07:59:35.402725 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 07:59:35.402725 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 07:59:35.402725 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 07:59:35.402725 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 07:59:35.402725 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 07:59:35.402725 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 07:59:35.402725 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44346319-f122-4c22-9867-4772c5e687a8 could not be found. Jul 26 07:59:35.402725 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:59:35.402725 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:59:35.402725 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:59:35.402725 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:59:35.402725 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:59:35.402725 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:59:35.402725 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:59:35.402725 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:59:35.402725 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:59:35.404354 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:59:35.404354 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 07:59:35.404354 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 07:59:35.404354 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 07:59:35.404354 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 07:59:35.404354 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 07:59:35.404354 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:59:35.404354 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44346319-f122-4c22-9867-4772c5e687a8 could not be found. Jul 26 07:59:35.404354 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:59:35.404354 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:59:35.404354 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:59:35.404354 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:59:35.404354 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:59:35.404354 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:59:35.404354 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:59:35.404354 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:59:35.404354 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44346319-f122-4c22-9867-4772c5e687a8 could not be found. Jul 26 07:59:35.404354 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:59:35.405907 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9ff07cc8-68d0-4d0d-8e16-a962343c89f0 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Returning 404 to user: Instance 44346319-f122-4c22-9867-4772c5e687a8 could not be found. {{(pid=117715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:59:35.405907 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-9ff07cc8-68d0-4d0d-8e16-a962343c89f0 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "GET /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8" status: 404 len: 111 microversion: 2.1 time: 0.029353 Jul 26 07:59:35.405907 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1179/2313] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:59:35 2022] GET /compute/v2.1/servers/44346319-f122-4c22-9867-4772c5e687a8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 07:59:35.410787 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2f3e809e-b7c2-44f8-92f5-be5666aaa0f9 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:59:35.411283 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2f3e809e-b7c2-44f8-92f5-be5666aaa0f9 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 4ba108c9-d3fc-442d-9ce5-b6f78e900ead] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:59:35.417805 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2f3e809e-b7c2-44f8-92f5-be5666aaa0f9 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:59:35.418278 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2f3e809e-b7c2-44f8-92f5-be5666aaa0f9 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:59:35.419031 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2f3e809e-b7c2-44f8-92f5-be5666aaa0f9 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:59:35.419466 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2f3e809e-b7c2-44f8-92f5-be5666aaa0f9 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:59:35.433426 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.wsgi [None req-2f3e809e-b7c2-44f8-92f5-be5666aaa0f9 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] HTTP exception thrown: Instance 4ba108c9-d3fc-442d-9ce5-b6f78e900ead could not be found. Jul 26 07:59:35.435035 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2f3e809e-b7c2-44f8-92f5-be5666aaa0f9 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Request method failure captured: Jul 26 07:59:35.435035 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: request: DELETE /compute/v2.1/servers/4ba108c9-d3fc-442d-9ce5-b6f78e900ead HTTP/1.1 Jul 26 07:59:35.435035 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept: application/json Jul 26 07:59:35.435035 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept-Encoding: identity Jul 26 07:59:35.435035 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Connection: close Jul 26 07:59:35.435035 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Length: 0 Jul 26 07:59:35.435035 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Type: application/json Jul 26 07:59:35.435035 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Host: 10.222.0.39 Jul 26 07:59:35.435035 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Openstack-System-Scope: None Jul 26 07:59:35.435035 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: User-Agent: python-urllib3/1.26.10 Jul 26 07:59:35.435035 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Auth-Token: gAAAAABi354JNUHIbkSiNg_V-C8FV5XhJGOPjJANDYsxeZqi8fp-h_FI6ggXhQ0PqHfTv8fVB0VJRbvKFHSgmkxYPjR1r6Y9DclyJ8clf5QhTEbHB9CjsfveTYchPV8oHrnZkxfk7pVCqI-Cu2niyu3S5wBOhU2taGkKGQ-mcQ9LS-iV5EXyVSM Jul 26 07:59:35.435035 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Id: None Jul 26 07:59:35.435035 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Name: None Jul 26 07:59:35.435035 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Identity-Status: Confirmed Jul 26 07:59:35.435035 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Is-Admin-Project: True Jul 26 07:59:35.435035 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Id: default Jul 26 07:59:35.435035 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Name: Default Jul 26 07:59:35.435035 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Id: 0898dc56ea6a416aae031efb7fefc46b Jul 26 07:59:35.435035 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Name: tempest-AttachVolumeTestJSON-249023717 Jul 26 07:59:35.435035 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Role: member,reader Jul 26 07:59:35.435035 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Roles: member,reader Jul 26 07:59:35.436511 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0898dc56ea6a416aae031efb7fefc46b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0898dc56ea6a416aae031efb7fefc46b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0898dc56ea6a416aae031efb7fefc46b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0898dc56ea6a416aae031efb7fefc46b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:59:35.436511 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant: tempest-AttachVolumeTestJSON-249023717 Jul 26 07:59:35.436511 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Id: 0898dc56ea6a416aae031efb7fefc46b Jul 26 07:59:35.436511 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Name: tempest-AttachVolumeTestJSON-249023717 Jul 26 07:59:35.436511 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User: tempest-AttachVolumeTestJSON-249023717-project Jul 26 07:59:35.436511 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Id: default Jul 26 07:59:35.436511 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Name: Default Jul 26 07:59:35.436511 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Id: dc97d25991d24cf9bb84f49366c895a6 Jul 26 07:59:35.436511 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Name: tempest-AttachVolumeTestJSON-249023717-project Jul 26 07:59:35.436511 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: method: > Jul 26 07:59:35.436511 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: exception: Instance 4ba108c9-d3fc-442d-9ce5-b6f78e900ead could not be found. Jul 26 07:59:35.436511 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: action_args: {'id': '4ba108c9-d3fc-442d-9ce5-b6f78e900ead'} Jul 26 07:59:35.437987 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:59:35.437987 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:59:35.437987 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 07:59:35.437987 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 07:59:35.437987 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 07:59:35.437987 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 07:59:35.437987 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 07:59:35.437987 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 07:59:35.437987 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 07:59:35.437987 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 07:59:35.437987 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ba108c9-d3fc-442d-9ce5-b6f78e900ead could not be found. Jul 26 07:59:35.437987 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:59:35.437987 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:59:35.437987 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:59:35.437987 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:59:35.437987 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:59:35.437987 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:59:35.437987 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:59:35.437987 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:59:35.437987 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:59:35.439430 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:59:35.439430 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 07:59:35.439430 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 07:59:35.439430 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 07:59:35.439430 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 07:59:35.439430 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 07:59:35.439430 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 07:59:35.439430 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 07:59:35.439430 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:59:35.439430 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ba108c9-d3fc-442d-9ce5-b6f78e900ead could not be found. Jul 26 07:59:35.439430 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:59:35.439430 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:59:35.439430 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:59:35.439430 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:59:35.439430 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:59:35.439430 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:59:35.439430 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:59:35.439430 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:59:35.439430 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ba108c9-d3fc-442d-9ce5-b6f78e900ead could not be found. Jul 26 07:59:35.439430 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:59:35.441041 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2f3e809e-b7c2-44f8-92f5-be5666aaa0f9 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Returning 404 to user: Instance 4ba108c9-d3fc-442d-9ce5-b6f78e900ead could not be found. {{(pid=117716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:59:35.441041 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2f3e809e-b7c2-44f8-92f5-be5666aaa0f9 tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4ba108c9-d3fc-442d-9ce5-b6f78e900ead" status: 404 len: 111 microversion: 2.1 time: 0.029783 Jul 26 07:59:35.441041 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1135/2314] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Jul 26 07:59:35 2022] DELETE /compute/v2.1/servers/4ba108c9-d3fc-442d-9ce5-b6f78e900ead => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 07:59:35.445529 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9cf752c7-317d-4183-afc6-df942699e4cc tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:59:35.446540 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-9cf752c7-317d-4183-afc6-df942699e4cc tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] [instance: 4ba108c9-d3fc-442d-9ce5-b6f78e900ead] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:59:35.452864 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9cf752c7-317d-4183-afc6-df942699e4cc tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:59:35.453304 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9cf752c7-317d-4183-afc6-df942699e4cc tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:59:35.454096 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9cf752c7-317d-4183-afc6-df942699e4cc tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:59:35.454523 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9cf752c7-317d-4183-afc6-df942699e4cc tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:59:35.468227 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.wsgi [None req-9cf752c7-317d-4183-afc6-df942699e4cc tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] HTTP exception thrown: Instance 4ba108c9-d3fc-442d-9ce5-b6f78e900ead could not be found. Jul 26 07:59:35.469804 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9cf752c7-317d-4183-afc6-df942699e4cc tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Request method failure captured: Jul 26 07:59:35.469804 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: request: GET /compute/v2.1/servers/4ba108c9-d3fc-442d-9ce5-b6f78e900ead HTTP/1.1 Jul 26 07:59:35.469804 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept: application/json Jul 26 07:59:35.469804 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept-Encoding: identity Jul 26 07:59:35.469804 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Connection: close Jul 26 07:59:35.469804 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Length: 0 Jul 26 07:59:35.469804 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Type: application/json Jul 26 07:59:35.469804 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Host: 10.222.0.39 Jul 26 07:59:35.469804 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Openstack-System-Scope: None Jul 26 07:59:35.469804 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: User-Agent: python-urllib3/1.26.10 Jul 26 07:59:35.469804 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Auth-Token: gAAAAABi354JNUHIbkSiNg_V-C8FV5XhJGOPjJANDYsxeZqi8fp-h_FI6ggXhQ0PqHfTv8fVB0VJRbvKFHSgmkxYPjR1r6Y9DclyJ8clf5QhTEbHB9CjsfveTYchPV8oHrnZkxfk7pVCqI-Cu2niyu3S5wBOhU2taGkKGQ-mcQ9LS-iV5EXyVSM Jul 26 07:59:35.469804 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Id: None Jul 26 07:59:35.469804 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Name: None Jul 26 07:59:35.469804 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Identity-Status: Confirmed Jul 26 07:59:35.469804 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Is-Admin-Project: True Jul 26 07:59:35.469804 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Id: default Jul 26 07:59:35.469804 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Name: Default Jul 26 07:59:35.469804 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Id: 0898dc56ea6a416aae031efb7fefc46b Jul 26 07:59:35.469804 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Name: tempest-AttachVolumeTestJSON-249023717 Jul 26 07:59:35.469804 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Role: member,reader Jul 26 07:59:35.469804 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Roles: member,reader Jul 26 07:59:35.471671 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0898dc56ea6a416aae031efb7fefc46b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0898dc56ea6a416aae031efb7fefc46b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0898dc56ea6a416aae031efb7fefc46b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0898dc56ea6a416aae031efb7fefc46b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:59:35.471671 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant: tempest-AttachVolumeTestJSON-249023717 Jul 26 07:59:35.471671 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Id: 0898dc56ea6a416aae031efb7fefc46b Jul 26 07:59:35.471671 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Name: tempest-AttachVolumeTestJSON-249023717 Jul 26 07:59:35.471671 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User: tempest-AttachVolumeTestJSON-249023717-project Jul 26 07:59:35.471671 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Id: default Jul 26 07:59:35.471671 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Name: Default Jul 26 07:59:35.471671 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Id: dc97d25991d24cf9bb84f49366c895a6 Jul 26 07:59:35.471671 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Name: tempest-AttachVolumeTestJSON-249023717-project Jul 26 07:59:35.471671 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: method: > Jul 26 07:59:35.471671 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: exception: Instance 4ba108c9-d3fc-442d-9ce5-b6f78e900ead could not be found. Jul 26 07:59:35.471671 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: action_args: {'id': '4ba108c9-d3fc-442d-9ce5-b6f78e900ead'} Jul 26 07:59:35.472637 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:59:35.472637 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:59:35.472637 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 07:59:35.472637 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 07:59:35.472637 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 07:59:35.472637 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 07:59:35.472637 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 07:59:35.472637 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 07:59:35.472637 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 07:59:35.472637 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 07:59:35.472637 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ba108c9-d3fc-442d-9ce5-b6f78e900ead could not be found. Jul 26 07:59:35.472637 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:59:35.472637 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:59:35.472637 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:59:35.472637 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:59:35.472637 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:59:35.472637 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:59:35.472637 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:59:35.472637 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:59:35.472637 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:59:35.474373 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:59:35.474373 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 07:59:35.474373 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 07:59:35.474373 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 07:59:35.474373 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 07:59:35.474373 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 07:59:35.474373 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:59:35.474373 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ba108c9-d3fc-442d-9ce5-b6f78e900ead could not be found. Jul 26 07:59:35.474373 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:59:35.474373 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:59:35.474373 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:59:35.474373 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:59:35.474373 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:59:35.474373 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:59:35.474373 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:59:35.474373 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:59:35.474373 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ba108c9-d3fc-442d-9ce5-b6f78e900ead could not be found. Jul 26 07:59:35.474373 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:59:35.475838 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9cf752c7-317d-4183-afc6-df942699e4cc tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] Returning 404 to user: Instance 4ba108c9-d3fc-442d-9ce5-b6f78e900ead could not be found. {{(pid=117715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:59:35.475838 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-9cf752c7-317d-4183-afc6-df942699e4cc tempest-AttachVolumeTestJSON-249023717 tempest-AttachVolumeTestJSON-249023717-project] 10.222.0.39 "GET /compute/v2.1/servers/4ba108c9-d3fc-442d-9ce5-b6f78e900ead" status: 404 len: 111 microversion: 2.1 time: 0.029670 Jul 26 07:59:35.475838 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1180/2315] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:59:35 2022] GET /compute/v2.1/servers/4ba108c9-d3fc-442d-9ce5-b6f78e900ead => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 07:59:46.990568 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0e97735d-e65b-40a0-a5bc-cd0a1ecb9443 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:59:46.991058 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-0e97735d-e65b-40a0-a5bc-cd0a1ecb9443 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:59:46.993879 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=10 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:59:46.994497 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=14 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:59:47.000327 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0e97735d-e65b-40a0-a5bc-cd0a1ecb9443 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:59:47.000786 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0e97735d-e65b-40a0-a5bc-cd0a1ecb9443 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:59:47.001934 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0e97735d-e65b-40a0-a5bc-cd0a1ecb9443 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:59:47.002437 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-0e97735d-e65b-40a0-a5bc-cd0a1ecb9443 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:59:47.017356 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.wsgi [None req-0e97735d-e65b-40a0-a5bc-cd0a1ecb9443 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] HTTP exception thrown: Instance 88ea2e0b-57a1-4a83-9324-6f6f6f000641 could not be found. Jul 26 07:59:47.018929 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0e97735d-e65b-40a0-a5bc-cd0a1ecb9443 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Request method failure captured: Jul 26 07:59:47.018929 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: request: DELETE /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 HTTP/1.1 Jul 26 07:59:47.018929 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept: application/json Jul 26 07:59:47.018929 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept-Encoding: identity Jul 26 07:59:47.018929 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Connection: close Jul 26 07:59:47.018929 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Length: 0 Jul 26 07:59:47.018929 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Type: application/json Jul 26 07:59:47.018929 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Host: 10.222.0.39 Jul 26 07:59:47.018929 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Openstack-System-Scope: None Jul 26 07:59:47.018929 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: User-Agent: python-urllib3/1.26.10 Jul 26 07:59:47.018929 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Auth-Token: gAAAAABi35bp-6MDlHFX6PqBP1JfjI-kDaErGZ8tS4CYMVgobtb4Gv-rSD0l-rBJa-iOQtbMEcv7gnFG6FuqSpAXwRcnDvooOo8YQBTuYFKMeWkJlsSVbvRshSqswhfLq3PM2Jh4Afd8RHIhCtF_ajjZyUKtQPL35KmYg8DZArwcVpy_HW9N5Qc Jul 26 07:59:47.018929 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Id: None Jul 26 07:59:47.018929 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Name: None Jul 26 07:59:47.018929 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Identity-Status: Confirmed Jul 26 07:59:47.018929 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Is-Admin-Project: True Jul 26 07:59:47.018929 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Id: default Jul 26 07:59:47.018929 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Name: Default Jul 26 07:59:47.018929 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Id: 4fa0c5574ef9497ebe29658f8164764c Jul 26 07:59:47.018929 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Name: tempest-AttachVolumeNegativeTest-1485570437 Jul 26 07:59:47.018929 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Role: member,reader Jul 26 07:59:47.018929 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Roles: member,reader Jul 26 07:59:47.020461 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:59:47.020461 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant: tempest-AttachVolumeNegativeTest-1485570437 Jul 26 07:59:47.020461 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Id: 4fa0c5574ef9497ebe29658f8164764c Jul 26 07:59:47.020461 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1485570437 Jul 26 07:59:47.020461 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User: tempest-AttachVolumeNegativeTest-1485570437-project Jul 26 07:59:47.020461 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Id: default Jul 26 07:59:47.020461 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Name: Default Jul 26 07:59:47.020461 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Id: 57029844165f4d83892176fe82594685 Jul 26 07:59:47.020461 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Name: tempest-AttachVolumeNegativeTest-1485570437-project Jul 26 07:59:47.020461 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: method: > Jul 26 07:59:47.020461 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: exception: Instance 88ea2e0b-57a1-4a83-9324-6f6f6f000641 could not be found. Jul 26 07:59:47.020461 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: action_args: {'id': '88ea2e0b-57a1-4a83-9324-6f6f6f000641'} Jul 26 07:59:47.021943 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:59:47.021943 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:59:47.021943 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 07:59:47.021943 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 07:59:47.021943 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 07:59:47.021943 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 07:59:47.021943 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 07:59:47.021943 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 07:59:47.021943 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 07:59:47.021943 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 07:59:47.021943 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88ea2e0b-57a1-4a83-9324-6f6f6f000641 could not be found. Jul 26 07:59:47.021943 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:59:47.021943 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:59:47.021943 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:59:47.021943 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:59:47.021943 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:59:47.021943 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:59:47.021943 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:59:47.021943 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:59:47.021943 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:59:47.023314 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:59:47.023314 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 07:59:47.023314 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 07:59:47.023314 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 07:59:47.023314 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 07:59:47.023314 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 07:59:47.023314 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 07:59:47.023314 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 07:59:47.023314 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:59:47.023314 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88ea2e0b-57a1-4a83-9324-6f6f6f000641 could not be found. Jul 26 07:59:47.023314 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:59:47.023314 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:59:47.023314 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:59:47.023314 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:59:47.023314 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:59:47.023314 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:59:47.023314 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:59:47.023314 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:59:47.023314 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88ea2e0b-57a1-4a83-9324-6f6f6f000641 could not be found. Jul 26 07:59:47.023314 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:59:47.026148 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-0e97735d-e65b-40a0-a5bc-cd0a1ecb9443 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Returning 404 to user: Instance 88ea2e0b-57a1-4a83-9324-6f6f6f000641 could not be found. {{(pid=117716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:59:47.026148 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-0e97735d-e65b-40a0-a5bc-cd0a1ecb9443 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "DELETE /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 404 len: 111 microversion: 2.1 time: 0.033634 Jul 26 07:59:47.026148 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1136/2316] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Jul 26 07:59:46 2022] DELETE /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 07:59:47.029205 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-1050c710-ac3d-46f2-842d-1c84f6c9264e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:59:47.029876 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-1050c710-ac3d-46f2-842d-1c84f6c9264e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: 88ea2e0b-57a1-4a83-9324-6f6f6f000641] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:59:47.032038 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:59:47.032698 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:59:47.038975 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1050c710-ac3d-46f2-842d-1c84f6c9264e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:59:47.038975 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1050c710-ac3d-46f2-842d-1c84f6c9264e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:59:47.039684 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1050c710-ac3d-46f2-842d-1c84f6c9264e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:59:47.040105 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1050c710-ac3d-46f2-842d-1c84f6c9264e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:59:47.056878 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.wsgi [None req-1050c710-ac3d-46f2-842d-1c84f6c9264e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] HTTP exception thrown: Instance 88ea2e0b-57a1-4a83-9324-6f6f6f000641 could not be found. Jul 26 07:59:47.058292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-1050c710-ac3d-46f2-842d-1c84f6c9264e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Request method failure captured: Jul 26 07:59:47.058292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: request: GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 HTTP/1.1 Jul 26 07:59:47.058292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept: application/json Jul 26 07:59:47.058292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept-Encoding: identity Jul 26 07:59:47.058292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Connection: close Jul 26 07:59:47.058292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Length: 0 Jul 26 07:59:47.058292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Type: application/json Jul 26 07:59:47.058292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Host: 10.222.0.39 Jul 26 07:59:47.058292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Openstack-System-Scope: None Jul 26 07:59:47.058292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: User-Agent: python-urllib3/1.26.10 Jul 26 07:59:47.058292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Auth-Token: gAAAAABi35bp-6MDlHFX6PqBP1JfjI-kDaErGZ8tS4CYMVgobtb4Gv-rSD0l-rBJa-iOQtbMEcv7gnFG6FuqSpAXwRcnDvooOo8YQBTuYFKMeWkJlsSVbvRshSqswhfLq3PM2Jh4Afd8RHIhCtF_ajjZyUKtQPL35KmYg8DZArwcVpy_HW9N5Qc Jul 26 07:59:47.058292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Id: None Jul 26 07:59:47.058292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Name: None Jul 26 07:59:47.058292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Identity-Status: Confirmed Jul 26 07:59:47.058292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Is-Admin-Project: True Jul 26 07:59:47.058292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Id: default Jul 26 07:59:47.058292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Name: Default Jul 26 07:59:47.058292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Id: 4fa0c5574ef9497ebe29658f8164764c Jul 26 07:59:47.058292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Name: tempest-AttachVolumeNegativeTest-1485570437 Jul 26 07:59:47.058292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Role: member,reader Jul 26 07:59:47.058292 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Roles: member,reader Jul 26 07:59:47.059892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:59:47.059892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant: tempest-AttachVolumeNegativeTest-1485570437 Jul 26 07:59:47.059892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Id: 4fa0c5574ef9497ebe29658f8164764c Jul 26 07:59:47.059892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1485570437 Jul 26 07:59:47.059892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User: tempest-AttachVolumeNegativeTest-1485570437-project Jul 26 07:59:47.059892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Id: default Jul 26 07:59:47.059892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Name: Default Jul 26 07:59:47.059892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Id: 57029844165f4d83892176fe82594685 Jul 26 07:59:47.059892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Name: tempest-AttachVolumeNegativeTest-1485570437-project Jul 26 07:59:47.059892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: method: > Jul 26 07:59:47.059892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: exception: Instance 88ea2e0b-57a1-4a83-9324-6f6f6f000641 could not be found. Jul 26 07:59:47.059892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: action_args: {'id': '88ea2e0b-57a1-4a83-9324-6f6f6f000641'} Jul 26 07:59:47.061188 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:59:47.061188 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:59:47.061188 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 07:59:47.061188 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 07:59:47.061188 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 07:59:47.061188 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 07:59:47.061188 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 07:59:47.061188 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 07:59:47.061188 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 07:59:47.061188 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 07:59:47.061188 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88ea2e0b-57a1-4a83-9324-6f6f6f000641 could not be found. Jul 26 07:59:47.061188 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:59:47.061188 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:59:47.061188 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:59:47.061188 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:59:47.061188 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:59:47.061188 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:59:47.061188 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:59:47.061188 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:59:47.061188 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:59:47.063262 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:59:47.063262 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 07:59:47.063262 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 07:59:47.063262 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 07:59:47.063262 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 07:59:47.063262 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 07:59:47.063262 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:59:47.063262 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88ea2e0b-57a1-4a83-9324-6f6f6f000641 could not be found. Jul 26 07:59:47.063262 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:59:47.063262 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:59:47.063262 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:59:47.063262 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:59:47.063262 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:59:47.063262 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:59:47.063262 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:59:47.063262 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:59:47.063262 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88ea2e0b-57a1-4a83-9324-6f6f6f000641 could not be found. Jul 26 07:59:47.063262 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:59:47.064811 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-1050c710-ac3d-46f2-842d-1c84f6c9264e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Returning 404 to user: Instance 88ea2e0b-57a1-4a83-9324-6f6f6f000641 could not be found. {{(pid=117715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:59:47.064811 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-1050c710-ac3d-46f2-842d-1c84f6c9264e tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641" status: 404 len: 111 microversion: 2.1 time: 0.034600 Jul 26 07:59:47.064811 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1181/2317] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:59:47 2022] GET /compute/v2.1/servers/88ea2e0b-57a1-4a83-9324-6f6f6f000641 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 07:59:47.072413 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-467dfd9c-7eae-4266-8718-4caf633083f7 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:59:47.072905 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-467dfd9c-7eae-4266-8718-4caf633083f7 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: e5a904a1-f100-432e-8c8c-f3dc187c3a0c] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:59:47.079149 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-467dfd9c-7eae-4266-8718-4caf633083f7 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:59:47.079661 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-467dfd9c-7eae-4266-8718-4caf633083f7 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:59:47.080400 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-467dfd9c-7eae-4266-8718-4caf633083f7 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:59:47.080831 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-467dfd9c-7eae-4266-8718-4caf633083f7 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:59:47.096175 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.wsgi [None req-467dfd9c-7eae-4266-8718-4caf633083f7 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] HTTP exception thrown: Instance e5a904a1-f100-432e-8c8c-f3dc187c3a0c could not be found. Jul 26 07:59:47.097723 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-467dfd9c-7eae-4266-8718-4caf633083f7 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Request method failure captured: Jul 26 07:59:47.097723 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: request: DELETE /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c HTTP/1.1 Jul 26 07:59:47.097723 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept: application/json Jul 26 07:59:47.097723 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept-Encoding: identity Jul 26 07:59:47.097723 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Connection: close Jul 26 07:59:47.097723 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Length: 0 Jul 26 07:59:47.097723 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Type: application/json Jul 26 07:59:47.097723 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Host: 10.222.0.39 Jul 26 07:59:47.097723 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Openstack-System-Scope: None Jul 26 07:59:47.097723 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: User-Agent: python-urllib3/1.26.10 Jul 26 07:59:47.097723 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Auth-Token: gAAAAABi35bp-6MDlHFX6PqBP1JfjI-kDaErGZ8tS4CYMVgobtb4Gv-rSD0l-rBJa-iOQtbMEcv7gnFG6FuqSpAXwRcnDvooOo8YQBTuYFKMeWkJlsSVbvRshSqswhfLq3PM2Jh4Afd8RHIhCtF_ajjZyUKtQPL35KmYg8DZArwcVpy_HW9N5Qc Jul 26 07:59:47.097723 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Id: None Jul 26 07:59:47.097723 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Name: None Jul 26 07:59:47.097723 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Identity-Status: Confirmed Jul 26 07:59:47.097723 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Is-Admin-Project: True Jul 26 07:59:47.097723 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Id: default Jul 26 07:59:47.097723 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Name: Default Jul 26 07:59:47.097723 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Id: 4fa0c5574ef9497ebe29658f8164764c Jul 26 07:59:47.097723 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Name: tempest-AttachVolumeNegativeTest-1485570437 Jul 26 07:59:47.097723 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Role: member,reader Jul 26 07:59:47.097723 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Roles: member,reader Jul 26 07:59:47.099502 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:59:47.099502 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant: tempest-AttachVolumeNegativeTest-1485570437 Jul 26 07:59:47.099502 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Id: 4fa0c5574ef9497ebe29658f8164764c Jul 26 07:59:47.099502 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1485570437 Jul 26 07:59:47.099502 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User: tempest-AttachVolumeNegativeTest-1485570437-project Jul 26 07:59:47.099502 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Id: default Jul 26 07:59:47.099502 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Name: Default Jul 26 07:59:47.099502 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Id: 57029844165f4d83892176fe82594685 Jul 26 07:59:47.099502 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Name: tempest-AttachVolumeNegativeTest-1485570437-project Jul 26 07:59:47.099502 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: method: > Jul 26 07:59:47.099502 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: exception: Instance e5a904a1-f100-432e-8c8c-f3dc187c3a0c could not be found. Jul 26 07:59:47.099502 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: action_args: {'id': 'e5a904a1-f100-432e-8c8c-f3dc187c3a0c'} Jul 26 07:59:47.100498 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:59:47.100498 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:59:47.100498 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 07:59:47.100498 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 07:59:47.100498 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 07:59:47.100498 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 07:59:47.100498 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 07:59:47.100498 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 07:59:47.100498 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 07:59:47.100498 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 07:59:47.100498 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5a904a1-f100-432e-8c8c-f3dc187c3a0c could not be found. Jul 26 07:59:47.100498 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:59:47.100498 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:59:47.100498 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:59:47.100498 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:59:47.100498 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:59:47.100498 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:59:47.100498 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:59:47.100498 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:59:47.100498 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:59:47.102164 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:59:47.102164 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 07:59:47.102164 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 07:59:47.102164 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 07:59:47.102164 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 07:59:47.102164 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 07:59:47.102164 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 07:59:47.102164 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 07:59:47.102164 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:59:47.102164 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5a904a1-f100-432e-8c8c-f3dc187c3a0c could not be found. Jul 26 07:59:47.102164 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:59:47.102164 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:59:47.102164 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:59:47.102164 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:59:47.102164 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:59:47.102164 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:59:47.102164 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:59:47.102164 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:59:47.102164 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5a904a1-f100-432e-8c8c-f3dc187c3a0c could not be found. Jul 26 07:59:47.102164 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 07:59:47.103744 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-467dfd9c-7eae-4266-8718-4caf633083f7 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Returning 404 to user: Instance e5a904a1-f100-432e-8c8c-f3dc187c3a0c could not be found. {{(pid=117716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:59:47.103744 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-467dfd9c-7eae-4266-8718-4caf633083f7 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c" status: 404 len: 111 microversion: 2.1 time: 0.032366 Jul 26 07:59:47.103744 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1137/2318] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Jul 26 07:59:47 2022] DELETE /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 07:59:47.108014 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8e73f46b-e87a-4748-a30e-75eed8f4da57 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 07:59:47.108620 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8e73f46b-e87a-4748-a30e-75eed8f4da57 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: e5a904a1-f100-432e-8c8c-f3dc187c3a0c] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 07:59:47.114825 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8e73f46b-e87a-4748-a30e-75eed8f4da57 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:59:47.115265 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8e73f46b-e87a-4748-a30e-75eed8f4da57 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:59:47.116005 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8e73f46b-e87a-4748-a30e-75eed8f4da57 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 07:59:47.116430 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8e73f46b-e87a-4748-a30e-75eed8f4da57 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 07:59:47.129761 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.wsgi [None req-8e73f46b-e87a-4748-a30e-75eed8f4da57 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] HTTP exception thrown: Instance e5a904a1-f100-432e-8c8c-f3dc187c3a0c could not be found. Jul 26 07:59:47.131251 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8e73f46b-e87a-4748-a30e-75eed8f4da57 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Request method failure captured: Jul 26 07:59:47.131251 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: request: GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c HTTP/1.1 Jul 26 07:59:47.131251 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept: application/json Jul 26 07:59:47.131251 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept-Encoding: identity Jul 26 07:59:47.131251 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Connection: close Jul 26 07:59:47.131251 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Length: 0 Jul 26 07:59:47.131251 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Type: application/json Jul 26 07:59:47.131251 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Host: 10.222.0.39 Jul 26 07:59:47.131251 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Openstack-System-Scope: None Jul 26 07:59:47.131251 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: User-Agent: python-urllib3/1.26.10 Jul 26 07:59:47.131251 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Auth-Token: gAAAAABi35bp-6MDlHFX6PqBP1JfjI-kDaErGZ8tS4CYMVgobtb4Gv-rSD0l-rBJa-iOQtbMEcv7gnFG6FuqSpAXwRcnDvooOo8YQBTuYFKMeWkJlsSVbvRshSqswhfLq3PM2Jh4Afd8RHIhCtF_ajjZyUKtQPL35KmYg8DZArwcVpy_HW9N5Qc Jul 26 07:59:47.131251 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Id: None Jul 26 07:59:47.131251 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Name: None Jul 26 07:59:47.131251 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Identity-Status: Confirmed Jul 26 07:59:47.131251 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Is-Admin-Project: True Jul 26 07:59:47.131251 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Id: default Jul 26 07:59:47.131251 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Name: Default Jul 26 07:59:47.131251 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Id: 4fa0c5574ef9497ebe29658f8164764c Jul 26 07:59:47.131251 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Name: tempest-AttachVolumeNegativeTest-1485570437 Jul 26 07:59:47.131251 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Role: member,reader Jul 26 07:59:47.131251 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Roles: member,reader Jul 26 07:59:47.132990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 07:59:47.132990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant: tempest-AttachVolumeNegativeTest-1485570437 Jul 26 07:59:47.132990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Id: 4fa0c5574ef9497ebe29658f8164764c Jul 26 07:59:47.132990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1485570437 Jul 26 07:59:47.132990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User: tempest-AttachVolumeNegativeTest-1485570437-project Jul 26 07:59:47.132990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Id: default Jul 26 07:59:47.132990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Name: Default Jul 26 07:59:47.132990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Id: 57029844165f4d83892176fe82594685 Jul 26 07:59:47.132990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Name: tempest-AttachVolumeNegativeTest-1485570437-project Jul 26 07:59:47.132990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: method: > Jul 26 07:59:47.132990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: exception: Instance e5a904a1-f100-432e-8c8c-f3dc187c3a0c could not be found. Jul 26 07:59:47.132990 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: action_args: {'id': 'e5a904a1-f100-432e-8c8c-f3dc187c3a0c'} Jul 26 07:59:47.133965 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 07:59:47.133965 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:59:47.133965 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 07:59:47.133965 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 07:59:47.133965 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 07:59:47.133965 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 07:59:47.133965 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 07:59:47.133965 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 07:59:47.133965 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 07:59:47.133965 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 07:59:47.133965 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5a904a1-f100-432e-8c8c-f3dc187c3a0c could not be found. Jul 26 07:59:47.133965 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:59:47.133965 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:59:47.133965 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:59:47.133965 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:59:47.133965 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:59:47.133965 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:59:47.133965 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 07:59:47.133965 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 07:59:47.133965 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 07:59:47.135357 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 07:59:47.135357 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 07:59:47.135357 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 07:59:47.135357 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 07:59:47.135357 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 07:59:47.135357 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 07:59:47.135357 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 07:59:47.135357 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5a904a1-f100-432e-8c8c-f3dc187c3a0c could not be found. Jul 26 07:59:47.135357 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:59:47.135357 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 07:59:47.135357 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:59:47.135357 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 07:59:47.135357 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 07:59:47.135357 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 07:59:47.135357 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 07:59:47.135357 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 07:59:47.135357 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5a904a1-f100-432e-8c8c-f3dc187c3a0c could not be found. Jul 26 07:59:47.135357 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 07:59:47.136810 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8e73f46b-e87a-4748-a30e-75eed8f4da57 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Returning 404 to user: Instance e5a904a1-f100-432e-8c8c-f3dc187c3a0c could not be found. {{(pid=117715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 07:59:47.136810 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8e73f46b-e87a-4748-a30e-75eed8f4da57 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c" status: 404 len: 111 microversion: 2.1 time: 0.028794 Jul 26 07:59:47.136810 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1182/2319] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 07:59:47 2022] GET /compute/v2.1/servers/e5a904a1-f100-432e-8c8c-f3dc187c3a0c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 08:00:21.366445 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ff76c8ab-fac0-4a15-967e-73d83cb874d4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:00:21.367055 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ff76c8ab-fac0-4a15-967e-73d83cb874d4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:00:21.369775 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=4 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:00:21.370605 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=4 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:00:21.377420 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ff76c8ab-fac0-4a15-967e-73d83cb874d4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:00:21.377927 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ff76c8ab-fac0-4a15-967e-73d83cb874d4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:00:21.378959 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ff76c8ab-fac0-4a15-967e-73d83cb874d4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:00:21.379713 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-ff76c8ab-fac0-4a15-967e-73d83cb874d4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:00:21.386417 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-921f89b7-3e4f-4f65-93e2-2097f496a065 tempest-VolumesTestJSON-419126838 tempest-VolumesTestJSON-419126838-project] Calling method '.version_select at 0x7f7f02a62ee0>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:00:21.395343 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=4 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:00:21.396550 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=4 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:00:21.416050 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-ff76c8ab-fac0-4a15-967e-73d83cb874d4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Going to try to terminate instance {{(pid=117716) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 08:00:21.452544 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-921f89b7-3e4f-4f65-93e2-2097f496a065 tempest-VolumesTestJSON-419126838 tempest-VolumesTestJSON-419126838-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/70dfddc4-2d3f-482f-ba46-d631d6135cea" status: 200 len: 350 microversion: 2.1 time: 0.071990 Jul 26 08:00:21.453345 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1183/2320] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Jul 26 08:00:21 2022] GET /compute/v2.1/os-volumes/70dfddc4-2d3f-482f-ba46-d631d6135cea => generated 350 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 08:00:21.465727 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-0b5663ce-b846-4696-b723-b21e1c650dd0 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:00:21.466576 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-0b5663ce-b846-4696-b723-b21e1c650dd0 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: c0b50e8b-a23c-4aa8-826e-3e2141006ede] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:00:21.475172 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0b5663ce-b846-4696-b723-b21e1c650dd0 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:00:21.475838 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0b5663ce-b846-4696-b723-b21e1c650dd0 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:00:21.477072 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0b5663ce-b846-4696-b723-b21e1c650dd0 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:00:21.477699 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0b5663ce-b846-4696-b723-b21e1c650dd0 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:00:21.494208 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.wsgi [None req-0b5663ce-b846-4696-b723-b21e1c650dd0 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] HTTP exception thrown: Instance c0b50e8b-a23c-4aa8-826e-3e2141006ede could not be found. Jul 26 08:00:21.496849 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-0b5663ce-b846-4696-b723-b21e1c650dd0 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Request method failure captured: Jul 26 08:00:21.496849 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: request: DELETE /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede HTTP/1.1 Jul 26 08:00:21.496849 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept: application/json Jul 26 08:00:21.496849 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept-Encoding: identity Jul 26 08:00:21.496849 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Connection: close Jul 26 08:00:21.496849 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Length: 0 Jul 26 08:00:21.496849 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Type: application/json Jul 26 08:00:21.496849 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Host: 10.222.0.39 Jul 26 08:00:21.496849 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Openstack-System-Scope: None Jul 26 08:00:21.496849 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: User-Agent: python-urllib3/1.26.10 Jul 26 08:00:21.496849 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Auth-Token: gAAAAABi35bp-6MDlHFX6PqBP1JfjI-kDaErGZ8tS4CYMVgobtb4Gv-rSD0l-rBJa-iOQtbMEcv7gnFG6FuqSpAXwRcnDvooOo8YQBTuYFKMeWkJlsSVbvRshSqswhfLq3PM2Jh4Afd8RHIhCtF_ajjZyUKtQPL35KmYg8DZArwcVpy_HW9N5Qc Jul 26 08:00:21.496849 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Id: None Jul 26 08:00:21.496849 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Name: None Jul 26 08:00:21.496849 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Identity-Status: Confirmed Jul 26 08:00:21.496849 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Is-Admin-Project: True Jul 26 08:00:21.496849 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Id: default Jul 26 08:00:21.496849 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Name: Default Jul 26 08:00:21.496849 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Id: 4fa0c5574ef9497ebe29658f8164764c Jul 26 08:00:21.496849 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Name: tempest-AttachVolumeNegativeTest-1485570437 Jul 26 08:00:21.496849 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Role: member,reader Jul 26 08:00:21.496849 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Roles: member,reader Jul 26 08:00:21.498702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 08:00:21.498702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant: tempest-AttachVolumeNegativeTest-1485570437 Jul 26 08:00:21.498702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Id: 4fa0c5574ef9497ebe29658f8164764c Jul 26 08:00:21.498702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1485570437 Jul 26 08:00:21.498702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User: tempest-AttachVolumeNegativeTest-1485570437-project Jul 26 08:00:21.498702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Id: default Jul 26 08:00:21.498702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Name: Default Jul 26 08:00:21.498702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Id: 57029844165f4d83892176fe82594685 Jul 26 08:00:21.498702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Name: tempest-AttachVolumeNegativeTest-1485570437-project Jul 26 08:00:21.498702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: method: > Jul 26 08:00:21.498702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: exception: Instance c0b50e8b-a23c-4aa8-826e-3e2141006ede could not be found. Jul 26 08:00:21.498702 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: action_args: {'id': 'c0b50e8b-a23c-4aa8-826e-3e2141006ede'} Jul 26 08:00:21.499581 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 08:00:21.499581 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 08:00:21.499581 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 08:00:21.499581 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 08:00:21.499581 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 08:00:21.499581 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 08:00:21.499581 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 08:00:21.499581 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 08:00:21.499581 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 08:00:21.499581 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 08:00:21.499581 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0b50e8b-a23c-4aa8-826e-3e2141006ede could not be found. Jul 26 08:00:21.499581 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 08:00:21.499581 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 08:00:21.499581 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 08:00:21.499581 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 08:00:21.499581 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 08:00:21.499581 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 08:00:21.499581 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 08:00:21.499581 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 08:00:21.499581 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 08:00:21.501040 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 08:00:21.501040 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 08:00:21.501040 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 08:00:21.501040 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 08:00:21.501040 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 08:00:21.501040 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 08:00:21.501040 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 08:00:21.501040 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 08:00:21.501040 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 08:00:21.501040 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0b50e8b-a23c-4aa8-826e-3e2141006ede could not be found. Jul 26 08:00:21.501040 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 08:00:21.501040 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 08:00:21.501040 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 08:00:21.501040 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 08:00:21.501040 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 08:00:21.501040 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 08:00:21.501040 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 08:00:21.501040 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 08:00:21.501040 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0b50e8b-a23c-4aa8-826e-3e2141006ede could not be found. Jul 26 08:00:21.501040 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 08:00:21.504087 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-0b5663ce-b846-4696-b723-b21e1c650dd0 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Returning 404 to user: Instance c0b50e8b-a23c-4aa8-826e-3e2141006ede could not be found. {{(pid=117715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 08:00:21.505555 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-0b5663ce-b846-4696-b723-b21e1c650dd0 tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede" status: 404 len: 111 microversion: 2.1 time: 0.049785 Jul 26 08:00:21.506860 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1184/2321] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Jul 26 08:00:21 2022] DELETE /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 08:00:21.523521 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-232cd821-9f6b-4d4a-b712-f14a824517ee tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:00:21.525472 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-232cd821-9f6b-4d4a-b712-f14a824517ee tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] [instance: c0b50e8b-a23c-4aa8-826e-3e2141006ede] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:00:21.539996 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-232cd821-9f6b-4d4a-b712-f14a824517ee tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:00:21.540781 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-232cd821-9f6b-4d4a-b712-f14a824517ee tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:00:21.541845 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-232cd821-9f6b-4d4a-b712-f14a824517ee tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:00:21.544642 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-232cd821-9f6b-4d4a-b712-f14a824517ee tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:00:21.564869 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ff76c8ab-fac0-4a15-967e-73d83cb874d4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 204 len: 0 microversion: 2.1 time: 0.202107 Jul 26 08:00:21.569876 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1138/2322] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Jul 26 08:00:21 2022] DELETE /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 08:00:21.576735 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.wsgi [None req-232cd821-9f6b-4d4a-b712-f14a824517ee tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] HTTP exception thrown: Instance c0b50e8b-a23c-4aa8-826e-3e2141006ede could not be found. Jul 26 08:00:21.577999 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7d3c74b1-b7ac-4543-9e93-9bea88af1afa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:00:21.578330 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-232cd821-9f6b-4d4a-b712-f14a824517ee tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Request method failure captured: Jul 26 08:00:21.578330 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: request: GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede HTTP/1.1 Jul 26 08:00:21.578330 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept: application/json Jul 26 08:00:21.578330 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept-Encoding: identity Jul 26 08:00:21.578330 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Connection: close Jul 26 08:00:21.578330 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Length: 0 Jul 26 08:00:21.578330 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Type: application/json Jul 26 08:00:21.578330 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Host: 10.222.0.39 Jul 26 08:00:21.578330 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Openstack-System-Scope: None Jul 26 08:00:21.578330 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: User-Agent: python-urllib3/1.26.10 Jul 26 08:00:21.578330 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Auth-Token: gAAAAABi35bp-6MDlHFX6PqBP1JfjI-kDaErGZ8tS4CYMVgobtb4Gv-rSD0l-rBJa-iOQtbMEcv7gnFG6FuqSpAXwRcnDvooOo8YQBTuYFKMeWkJlsSVbvRshSqswhfLq3PM2Jh4Afd8RHIhCtF_ajjZyUKtQPL35KmYg8DZArwcVpy_HW9N5Qc Jul 26 08:00:21.578330 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Id: None Jul 26 08:00:21.578330 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Name: None Jul 26 08:00:21.578330 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Identity-Status: Confirmed Jul 26 08:00:21.578330 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Is-Admin-Project: True Jul 26 08:00:21.578330 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Id: default Jul 26 08:00:21.578330 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Name: Default Jul 26 08:00:21.578330 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Id: 4fa0c5574ef9497ebe29658f8164764c Jul 26 08:00:21.578330 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Name: tempest-AttachVolumeNegativeTest-1485570437 Jul 26 08:00:21.578330 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Role: member,reader Jul 26 08:00:21.578330 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Roles: member,reader Jul 26 08:00:21.579910 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4fa0c5574ef9497ebe29658f8164764c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 08:00:21.579910 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant: tempest-AttachVolumeNegativeTest-1485570437 Jul 26 08:00:21.579910 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Id: 4fa0c5574ef9497ebe29658f8164764c Jul 26 08:00:21.579910 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1485570437 Jul 26 08:00:21.579910 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User: tempest-AttachVolumeNegativeTest-1485570437-project Jul 26 08:00:21.579910 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Id: default Jul 26 08:00:21.579910 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Name: Default Jul 26 08:00:21.579910 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Id: 57029844165f4d83892176fe82594685 Jul 26 08:00:21.579910 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Name: tempest-AttachVolumeNegativeTest-1485570437-project Jul 26 08:00:21.579910 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: method: > Jul 26 08:00:21.579910 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: exception: Instance c0b50e8b-a23c-4aa8-826e-3e2141006ede could not be found. Jul 26 08:00:21.579910 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: action_args: {'id': 'c0b50e8b-a23c-4aa8-826e-3e2141006ede'} Jul 26 08:00:21.580766 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 08:00:21.580766 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 08:00:21.580766 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 08:00:21.580766 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 08:00:21.580766 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 08:00:21.580766 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 08:00:21.580766 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 08:00:21.580766 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 08:00:21.580766 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 08:00:21.580766 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 08:00:21.580766 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0b50e8b-a23c-4aa8-826e-3e2141006ede could not be found. Jul 26 08:00:21.580766 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 08:00:21.580766 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 08:00:21.580766 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 08:00:21.580766 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 08:00:21.580766 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 08:00:21.580766 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 08:00:21.580766 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 08:00:21.580766 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 08:00:21.580766 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 08:00:21.582168 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 08:00:21.582168 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 08:00:21.582168 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 08:00:21.582168 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 08:00:21.582168 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 08:00:21.582168 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 08:00:21.582168 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 08:00:21.582168 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0b50e8b-a23c-4aa8-826e-3e2141006ede could not be found. Jul 26 08:00:21.582168 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 08:00:21.582168 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 08:00:21.582168 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 08:00:21.582168 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 08:00:21.582168 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 08:00:21.582168 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 08:00:21.582168 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 08:00:21.582168 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 08:00:21.582168 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0b50e8b-a23c-4aa8-826e-3e2141006ede could not be found. Jul 26 08:00:21.582168 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 08:00:21.584172 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-232cd821-9f6b-4d4a-b712-f14a824517ee tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] Returning 404 to user: Instance c0b50e8b-a23c-4aa8-826e-3e2141006ede could not be found. {{(pid=117715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 08:00:21.584172 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-232cd821-9f6b-4d4a-b712-f14a824517ee tempest-AttachVolumeNegativeTest-1485570437 tempest-AttachVolumeNegativeTest-1485570437-project] 10.222.0.39 "GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede" status: 404 len: 111 microversion: 2.1 time: 0.068409 Jul 26 08:00:21.584480 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7d3c74b1-b7ac-4543-9e93-9bea88af1afa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:00:21.587307 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1185/2323] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:00:21 2022] GET /compute/v2.1/servers/c0b50e8b-a23c-4aa8-826e-3e2141006ede => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 08:00:21.597233 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7d3c74b1-b7ac-4543-9e93-9bea88af1afa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:00:21.598395 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7d3c74b1-b7ac-4543-9e93-9bea88af1afa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:00:21.599181 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7d3c74b1-b7ac-4543-9e93-9bea88af1afa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:00:21.599615 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7d3c74b1-b7ac-4543-9e93-9bea88af1afa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:00:21.779721 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-f8906724-7443-4727-a9c0-5e2ee27dcdfa req-25356eae-9139-4115-bcb9-1c16bfefe670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c87e5af-1321-4b95-86a4-6e094fa1d61f", "name": "network-vif-deleted", "tag": "73dd8ccd-92c0-40af-8e88-e8a03c94989c"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 08:00:21.806363 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-f8906724-7443-4727-a9c0-5e2ee27dcdfa req-25356eae-9139-4115-bcb9-1c16bfefe670 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:00:21.811552 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-f8906724-7443-4727-a9c0-5e2ee27dcdfa req-25356eae-9139-4115-bcb9-1c16bfefe670 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:00:21.821616 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7d3c74b1-b7ac-4543-9e93-9bea88af1afa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:00:21.830723 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7d3c74b1-b7ac-4543-9e93-9bea88af1afa tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1506 microversion: 2.1 time: 0.258737 Jul 26 08:00:21.832182 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1139/2324] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:00:21 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1506 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:00:21.840417 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-f8906724-7443-4727-a9c0-5e2ee27dcdfa req-25356eae-9139-4115-bcb9-1c16bfefe670 service nova] Creating event network-vif-deleted:73dd8ccd-92c0-40af-8e88-e8a03c94989c for instance 8c87e5af-1321-4b95-86a4-6e094fa1d61f on hv-cinder-85083 Jul 26 08:00:21.851103 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-f8906724-7443-4727-a9c0-5e2ee27dcdfa req-25356eae-9139-4115-bcb9-1c16bfefe670 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082333 Jul 26 08:00:21.852382 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1186/2325] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 08:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 08:00:22.856489 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-e738becc-bcf5-4114-96df-713c81961905 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:00:22.857116 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-e738becc-bcf5-4114-96df-713c81961905 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:00:22.890444 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e738becc-bcf5-4114-96df-713c81961905 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:00:22.890890 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e738becc-bcf5-4114-96df-713c81961905 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:00:22.891678 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e738becc-bcf5-4114-96df-713c81961905 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:00:22.892111 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e738becc-bcf5-4114-96df-713c81961905 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:00:22.982524 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-e738becc-bcf5-4114-96df-713c81961905 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:00:22.991080 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-e738becc-bcf5-4114-96df-713c81961905 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 200 len: 1464 microversion: 2.1 time: 0.141896 Jul 26 08:00:22.995808 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1140/2326] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:00:22 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 1464 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:00:23.011707 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-bb820bce-cbe8-49f5-947f-3b8dfd96db94 tempest-VolumesTestJSON-419126838 tempest-VolumesTestJSON-419126838-project] Calling method '.version_select at 0x7f7f0260f700>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:00:23.066011 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-bb820bce-cbe8-49f5-947f-3b8dfd96db94 tempest-VolumesTestJSON-419126838 tempest-VolumesTestJSON-419126838-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/2da6bd10-8f4e-4cfd-936f-dd63f4316d62" status: 200 len: 351 microversion: 2.1 time: 0.072017 Jul 26 08:00:23.073978 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1187/2327] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Jul 26 08:00:22 2022] GET /compute/v2.1/os-volumes/2da6bd10-8f4e-4cfd-936f-dd63f4316d62 => generated 351 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 08:00:23.865423 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-6cdef671-021a-4b27-a201-9cc313c64047 req-b61675f0-3fb7-46c0-9dfa-4e4d7ec920bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e85830f-4d1d-4386-89f0-dbe72ad75089", "name": "network-vif-deleted", "tag": "527d5b48-4c6b-40c4-95e8-b8d39da61a3d"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 08:00:23.876355 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-6cdef671-021a-4b27-a201-9cc313c64047 req-b61675f0-3fb7-46c0-9dfa-4e4d7ec920bb service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:00:23.876795 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-6cdef671-021a-4b27-a201-9cc313c64047 req-b61675f0-3fb7-46c0-9dfa-4e4d7ec920bb service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:00:23.888457 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-6cdef671-021a-4b27-a201-9cc313c64047 req-b61675f0-3fb7-46c0-9dfa-4e4d7ec920bb service nova] Creating event network-vif-deleted:527d5b48-4c6b-40c4-95e8-b8d39da61a3d for instance 9e85830f-4d1d-4386-89f0-dbe72ad75089 on hv-cinder-85083 Jul 26 08:00:23.893682 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-6cdef671-021a-4b27-a201-9cc313c64047 req-b61675f0-3fb7-46c0-9dfa-4e4d7ec920bb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031924 Jul 26 08:00:23.897905 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1141/2328] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 08:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 08:00:24.017494 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-61c2aca8-45fb-43aa-8259-48af4043776f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:00:24.018696 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-61c2aca8-45fb-43aa-8259-48af4043776f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 9e85830f-4d1d-4386-89f0-dbe72ad75089] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:00:24.028147 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-61c2aca8-45fb-43aa-8259-48af4043776f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:00:24.028609 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-61c2aca8-45fb-43aa-8259-48af4043776f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:00:24.029371 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-61c2aca8-45fb-43aa-8259-48af4043776f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:00:24.029903 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-61c2aca8-45fb-43aa-8259-48af4043776f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:00:24.057901 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.wsgi [None req-61c2aca8-45fb-43aa-8259-48af4043776f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] HTTP exception thrown: Instance 9e85830f-4d1d-4386-89f0-dbe72ad75089 could not be found. Jul 26 08:00:24.061376 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-61c2aca8-45fb-43aa-8259-48af4043776f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Request method failure captured: Jul 26 08:00:24.061376 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: request: GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 HTTP/1.1 Jul 26 08:00:24.061376 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept: application/json Jul 26 08:00:24.061376 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept-Encoding: identity Jul 26 08:00:24.061376 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Connection: close Jul 26 08:00:24.061376 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Length: 0 Jul 26 08:00:24.061376 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Type: application/json Jul 26 08:00:24.061376 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Host: 10.222.0.39 Jul 26 08:00:24.061376 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Openstack-System-Scope: None Jul 26 08:00:24.061376 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: User-Agent: python-urllib3/1.26.10 Jul 26 08:00:24.061376 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Auth-Token: gAAAAABi35b0t1LoOclOQiICyH7DfI9hTlCmo6suXwXRkCJi3MOM6RoKV-npsPapEw2uaIZ5CDpBRV73e8bEa0KMo_SVyclOzKbXE-MGMa484BeADltPBu8Mv7x89PigpBRQ6AvYL7hJKXltVglq5g-su4TtRmSS4VgBmr5HVZ4x5obXr-WQPfA Jul 26 08:00:24.061376 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Id: None Jul 26 08:00:24.061376 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Name: None Jul 26 08:00:24.061376 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Identity-Status: Confirmed Jul 26 08:00:24.061376 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Is-Admin-Project: True Jul 26 08:00:24.061376 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Id: default Jul 26 08:00:24.061376 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Name: Default Jul 26 08:00:24.061376 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Id: 02e545f0c2784698a35cd8dcb1b02395 Jul 26 08:00:24.061376 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1083850303 Jul 26 08:00:24.061376 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Role: member,reader Jul 26 08:00:24.061376 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Roles: member,reader Jul 26 08:00:24.063327 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/02e545f0c2784698a35cd8dcb1b02395"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_02e545f0c2784698a35cd8dcb1b02395"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/02e545f0c2784698a35cd8dcb1b02395"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/02e545f0c2784698a35cd8dcb1b02395"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 08:00:24.063327 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1083850303 Jul 26 08:00:24.063327 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Id: 02e545f0c2784698a35cd8dcb1b02395 Jul 26 08:00:24.063327 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1083850303 Jul 26 08:00:24.063327 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User: tempest-ServerRescueNegativeTestJSON-1083850303-project Jul 26 08:00:24.063327 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Id: default Jul 26 08:00:24.063327 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Name: Default Jul 26 08:00:24.063327 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Id: 886151888fc84ccf890d609ba62da9e1 Jul 26 08:00:24.063327 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1083850303-project Jul 26 08:00:24.063327 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: method: > Jul 26 08:00:24.063327 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: exception: Instance 9e85830f-4d1d-4386-89f0-dbe72ad75089 could not be found. Jul 26 08:00:24.063327 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: action_args: {'id': '9e85830f-4d1d-4386-89f0-dbe72ad75089'} Jul 26 08:00:24.064419 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 08:00:24.064419 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 08:00:24.064419 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 08:00:24.064419 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 08:00:24.064419 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 08:00:24.064419 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 08:00:24.064419 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 08:00:24.064419 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 08:00:24.064419 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 08:00:24.064419 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 08:00:24.064419 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e85830f-4d1d-4386-89f0-dbe72ad75089 could not be found. Jul 26 08:00:24.064419 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 08:00:24.064419 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 08:00:24.064419 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 08:00:24.064419 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 08:00:24.064419 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 08:00:24.064419 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 08:00:24.064419 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 08:00:24.064419 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 08:00:24.064419 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 08:00:24.065911 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 08:00:24.065911 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 08:00:24.065911 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 08:00:24.065911 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 08:00:24.065911 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 08:00:24.065911 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 08:00:24.065911 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 08:00:24.065911 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e85830f-4d1d-4386-89f0-dbe72ad75089 could not be found. Jul 26 08:00:24.065911 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 08:00:24.065911 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 08:00:24.065911 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 08:00:24.065911 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 08:00:24.065911 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 08:00:24.065911 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 08:00:24.065911 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 08:00:24.065911 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 08:00:24.065911 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e85830f-4d1d-4386-89f0-dbe72ad75089 could not be found. Jul 26 08:00:24.065911 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 08:00:24.067354 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-61c2aca8-45fb-43aa-8259-48af4043776f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Returning 404 to user: Instance 9e85830f-4d1d-4386-89f0-dbe72ad75089 could not be found. {{(pid=117715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 08:00:24.067354 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-61c2aca8-45fb-43aa-8259-48af4043776f tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089" status: 404 len: 111 microversion: 2.1 time: 0.051762 Jul 26 08:00:24.067354 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1188/2329] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:00:24 2022] GET /compute/v2.1/servers/9e85830f-4d1d-4386-89f0-dbe72ad75089 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 08:00:24.075333 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c59df5af-c60f-4bbc-8c0e-7a2e49189b0c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:00:24.075919 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c59df5af-c60f-4bbc-8c0e-7a2e49189b0c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:00:24.082516 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c59df5af-c60f-4bbc-8c0e-7a2e49189b0c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:00:24.083081 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c59df5af-c60f-4bbc-8c0e-7a2e49189b0c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:00:24.084002 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c59df5af-c60f-4bbc-8c0e-7a2e49189b0c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:00:24.084442 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c59df5af-c60f-4bbc-8c0e-7a2e49189b0c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:00:24.117500 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c59df5af-c60f-4bbc-8c0e-7a2e49189b0c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] Going to try to terminate instance {{(pid=117716) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 08:00:24.217520 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c59df5af-c60f-4bbc-8c0e-7a2e49189b0c tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "DELETE /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669" status: 204 len: 0 microversion: 2.1 time: 0.146571 Jul 26 08:00:24.217520 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1142/2330] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Jul 26 08:00:24 2022] DELETE /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 08:00:24.227610 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3dfa1c1e-561a-46a7-bfb5-40b427480fe4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:00:24.228346 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3dfa1c1e-561a-46a7-bfb5-40b427480fe4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:00:24.237337 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3dfa1c1e-561a-46a7-bfb5-40b427480fe4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:00:24.241415 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3dfa1c1e-561a-46a7-bfb5-40b427480fe4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:00:24.243424 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3dfa1c1e-561a-46a7-bfb5-40b427480fe4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:00:24.243424 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3dfa1c1e-561a-46a7-bfb5-40b427480fe4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:00:24.465491 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3dfa1c1e-561a-46a7-bfb5-40b427480fe4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:00:24.473545 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3dfa1c1e-561a-46a7-bfb5-40b427480fe4 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669" status: 200 len: 1520 microversion: 2.1 time: 0.249992 Jul 26 08:00:24.474979 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1189/2331] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:00:24 2022] GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669 => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:00:24.605187 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-00a326cb-e183-4325-ac4a-8f23285cf2b3 tempest-VolumesTestJSON-419126838 tempest-VolumesTestJSON-419126838-project] Calling method '.version_select at 0x7f7f06f8b280>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:00:24.658471 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-00a326cb-e183-4325-ac4a-8f23285cf2b3 tempest-VolumesTestJSON-419126838 tempest-VolumesTestJSON-419126838-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/f5c14eca-1af6-4cf0-bc67-afed029e361d" status: 200 len: 351 microversion: 2.1 time: 0.058365 Jul 26 08:00:24.661780 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1143/2332] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Jul 26 08:00:24 2022] GET /compute/v2.1/os-volumes/f5c14eca-1af6-4cf0-bc67-afed029e361d => generated 351 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 08:00:24.674337 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e6776855-7202-49f2-ba4b-ec2df956f07a tempest-VolumesTestJSON-419126838 tempest-VolumesTestJSON-419126838-project] Calling method '.version_select at 0x7f7f026b6430>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:00:24.774630 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e6776855-7202-49f2-ba4b-ec2df956f07a tempest-VolumesTestJSON-419126838 tempest-VolumesTestJSON-419126838-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.104280 Jul 26 08:00:24.775244 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1190/2333] 10.222.0.39 () {58 vars in 1134 bytes} [Tue Jul 26 08:00:24 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 08:00:24.788924 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-3ee7d52e-e242-414f-9c6b-2c18d8831795 tempest-VolumesTestJSON-419126838 tempest-VolumesTestJSON-419126838-project] Calling method '.version_select at 0x7f7f06f5b9d0>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:00:24.882464 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-3ee7d52e-e242-414f-9c6b-2c18d8831795 tempest-VolumesTestJSON-419126838 tempest-VolumesTestJSON-419126838-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.096888 Jul 26 08:00:24.890754 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1144/2334] 10.222.0.39 () {58 vars in 1149 bytes} [Tue Jul 26 08:00:24 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 08:00:24.908219 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-94c3af09-2ea4-40e7-93f0-6c7b8d36b212 tempest-VolumesTestJSON-419126838 tempest-VolumesTestJSON-419126838-project] Calling method '.version_select at 0x7f7f02692790>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:00:25.028301 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-94c3af09-2ea4-40e7-93f0-6c7b8d36b212 tempest-VolumesTestJSON-419126838 tempest-VolumesTestJSON-419126838-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.125743 Jul 26 08:00:25.029121 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1191/2335] 10.222.0.39 () {58 vars in 1134 bytes} [Tue Jul 26 08:00:24 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:00:25.042886 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-157ab76b-d90f-4342-9bd0-381d1c24e47a tempest-VolumesTestJSON-419126838 tempest-VolumesTestJSON-419126838-project] Calling method '.version_select at 0x7f7f026c81f0>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:00:25.122273 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-157ab76b-d90f-4342-9bd0-381d1c24e47a tempest-VolumesTestJSON-419126838 tempest-VolumesTestJSON-419126838-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.084408 Jul 26 08:00:25.122824 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1145/2336] 10.222.0.39 () {58 vars in 1167 bytes} [Tue Jul 26 08:00:25 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 08:00:25.136119 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-1d6c3720-d9d1-4c65-bf06-2e52d945824b tempest-VolumesTestJSON-419126838 tempest-VolumesTestJSON-419126838-project] Calling method '.version_select at 0x7f7f0260f0d0>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:00:25.223061 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-1d6c3720-d9d1-4c65-bf06-2e52d945824b tempest-VolumesTestJSON-419126838 tempest-VolumesTestJSON-419126838-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.090739 Jul 26 08:00:25.223617 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1192/2337] 10.222.0.39 () {58 vars in 1170 bytes} [Tue Jul 26 08:00:25 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 08:00:25.240702 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-44df5aa4-3fb1-4de1-91ac-437285a45328 tempest-VolumesTestJSON-419126838 tempest-VolumesTestJSON-419126838-project] Calling method '.version_select at 0x7f7f06f28b80>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:00:25.332907 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-44df5aa4-3fb1-4de1-91ac-437285a45328 tempest-VolumesTestJSON-419126838 tempest-VolumesTestJSON-419126838-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.099471 Jul 26 08:00:25.334199 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1146/2338] 10.222.0.39 () {58 vars in 1155 bytes} [Tue Jul 26 08:00:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:00:25.350307 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-18b3ae4d-12b0-4e0b-a265-9dffad4e6ad9 tempest-VolumesTestJSON-419126838 tempest-VolumesTestJSON-419126838-project] Calling method '.version_select at 0x7f7f026923a0>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:00:25.450862 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-18b3ae4d-12b0-4e0b-a265-9dffad4e6ad9 tempest-VolumesTestJSON-419126838 tempest-VolumesTestJSON-419126838-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.107546 Jul 26 08:00:25.454116 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1193/2339] 10.222.0.39 () {58 vars in 1188 bytes} [Tue Jul 26 08:00:25 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 08:00:25.471670 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7a7db845-f506-4c20-9b1e-c3de903d1ede tempest-VolumesTestJSON-419126838 tempest-VolumesTestJSON-419126838-project] Calling method '.version_select at 0x7f7f06f704c0>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:00:25.494584 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c498bc96-f9ec-41cb-9fa6-92300b59f303 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:00:25.495194 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c498bc96-f9ec-41cb-9fa6-92300b59f303 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:00:25.511811 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c498bc96-f9ec-41cb-9fa6-92300b59f303 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:00:25.512291 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c498bc96-f9ec-41cb-9fa6-92300b59f303 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:00:25.513877 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c498bc96-f9ec-41cb-9fa6-92300b59f303 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:00:25.514323 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c498bc96-f9ec-41cb-9fa6-92300b59f303 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:00:25.645349 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7a7db845-f506-4c20-9b1e-c3de903d1ede tempest-VolumesTestJSON-419126838 tempest-VolumesTestJSON-419126838-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.183676 Jul 26 08:00:25.645994 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1147/2340] 10.222.0.39 () {58 vars in 1155 bytes} [Tue Jul 26 08:00:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:00:25.680337 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c498bc96-f9ec-41cb-9fa6-92300b59f303 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886151888fc84ccf890d609ba62da9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e545f0c2784698a35cd8dcb1b02395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:00:25.693039 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c498bc96-f9ec-41cb-9fa6-92300b59f303 tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669" status: 200 len: 1478 microversion: 2.1 time: 0.200783 Jul 26 08:00:25.694588 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1194/2341] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:00:25 2022] GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669 => generated 1478 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:00:25.911425 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-e5ff881a-9ae3-48f2-8195-1cd6d9db5a02 req-36f89c87-1900-4128-85b2-651f14ad8ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80da1213-270f-4afc-87f8-345874caa669", "name": "network-vif-deleted", "tag": "a592fd67-f5f8-4a93-bb6f-f2ff436180bf"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 08:00:25.939886 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-e5ff881a-9ae3-48f2-8195-1cd6d9db5a02 req-36f89c87-1900-4128-85b2-651f14ad8ee8 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:00:25.941255 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-e5ff881a-9ae3-48f2-8195-1cd6d9db5a02 req-36f89c87-1900-4128-85b2-651f14ad8ee8 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:00:25.973828 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-e5ff881a-9ae3-48f2-8195-1cd6d9db5a02 req-36f89c87-1900-4128-85b2-651f14ad8ee8 service nova] Creating event network-vif-deleted:a592fd67-f5f8-4a93-bb6f-f2ff436180bf for instance 80da1213-270f-4afc-87f8-345874caa669 on hv-cinder-85083 Jul 26 08:00:25.982983 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-e5ff881a-9ae3-48f2-8195-1cd6d9db5a02 req-36f89c87-1900-4128-85b2-651f14ad8ee8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075279 Jul 26 08:00:25.984226 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1148/2342] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 08:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 08:00:26.715560 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f92e5e57-c04b-40ee-8195-8d62abd2cdfb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:00:26.716252 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f92e5e57-c04b-40ee-8195-8d62abd2cdfb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] [instance: 80da1213-270f-4afc-87f8-345874caa669] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:00:26.729413 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f92e5e57-c04b-40ee-8195-8d62abd2cdfb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:00:26.729732 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f92e5e57-c04b-40ee-8195-8d62abd2cdfb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:00:26.736017 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f92e5e57-c04b-40ee-8195-8d62abd2cdfb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:00:26.736489 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f92e5e57-c04b-40ee-8195-8d62abd2cdfb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:00:26.753163 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.wsgi [None req-f92e5e57-c04b-40ee-8195-8d62abd2cdfb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] HTTP exception thrown: Instance 80da1213-270f-4afc-87f8-345874caa669 could not be found. Jul 26 08:00:26.755126 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f92e5e57-c04b-40ee-8195-8d62abd2cdfb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Request method failure captured: Jul 26 08:00:26.755126 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: request: GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669 HTTP/1.1 Jul 26 08:00:26.755126 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept: application/json Jul 26 08:00:26.755126 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept-Encoding: identity Jul 26 08:00:26.755126 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Connection: close Jul 26 08:00:26.755126 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Length: 0 Jul 26 08:00:26.755126 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Type: application/json Jul 26 08:00:26.755126 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Host: 10.222.0.39 Jul 26 08:00:26.755126 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Openstack-System-Scope: None Jul 26 08:00:26.755126 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: User-Agent: python-urllib3/1.26.10 Jul 26 08:00:26.755126 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Auth-Token: gAAAAABi35b0t1LoOclOQiICyH7DfI9hTlCmo6suXwXRkCJi3MOM6RoKV-npsPapEw2uaIZ5CDpBRV73e8bEa0KMo_SVyclOzKbXE-MGMa484BeADltPBu8Mv7x89PigpBRQ6AvYL7hJKXltVglq5g-su4TtRmSS4VgBmr5HVZ4x5obXr-WQPfA Jul 26 08:00:26.755126 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Id: None Jul 26 08:00:26.755126 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Name: None Jul 26 08:00:26.755126 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Identity-Status: Confirmed Jul 26 08:00:26.755126 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Is-Admin-Project: True Jul 26 08:00:26.755126 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Id: default Jul 26 08:00:26.755126 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Name: Default Jul 26 08:00:26.755126 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Id: 02e545f0c2784698a35cd8dcb1b02395 Jul 26 08:00:26.755126 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1083850303 Jul 26 08:00:26.755126 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Role: member,reader Jul 26 08:00:26.755126 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Roles: member,reader Jul 26 08:00:26.758280 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/02e545f0c2784698a35cd8dcb1b02395"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_02e545f0c2784698a35cd8dcb1b02395"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/02e545f0c2784698a35cd8dcb1b02395"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/02e545f0c2784698a35cd8dcb1b02395"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 08:00:26.758280 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1083850303 Jul 26 08:00:26.758280 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Id: 02e545f0c2784698a35cd8dcb1b02395 Jul 26 08:00:26.758280 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1083850303 Jul 26 08:00:26.758280 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User: tempest-ServerRescueNegativeTestJSON-1083850303-project Jul 26 08:00:26.758280 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Id: default Jul 26 08:00:26.758280 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Name: Default Jul 26 08:00:26.758280 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Id: 886151888fc84ccf890d609ba62da9e1 Jul 26 08:00:26.758280 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1083850303-project Jul 26 08:00:26.758280 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: method: > Jul 26 08:00:26.758280 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: exception: Instance 80da1213-270f-4afc-87f8-345874caa669 could not be found. Jul 26 08:00:26.758280 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: action_args: {'id': '80da1213-270f-4afc-87f8-345874caa669'} Jul 26 08:00:26.759892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 08:00:26.759892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 08:00:26.759892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 08:00:26.759892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 08:00:26.759892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 08:00:26.759892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 08:00:26.759892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 08:00:26.759892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 08:00:26.759892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 08:00:26.759892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 08:00:26.759892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80da1213-270f-4afc-87f8-345874caa669 could not be found. Jul 26 08:00:26.759892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 08:00:26.759892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 08:00:26.759892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 08:00:26.759892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 08:00:26.759892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 08:00:26.759892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 08:00:26.759892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 08:00:26.759892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 08:00:26.759892 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 08:00:26.764249 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 08:00:26.764249 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 08:00:26.764249 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 08:00:26.764249 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 08:00:26.764249 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 08:00:26.764249 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 08:00:26.764249 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 08:00:26.764249 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80da1213-270f-4afc-87f8-345874caa669 could not be found. Jul 26 08:00:26.764249 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 08:00:26.764249 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 08:00:26.764249 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 08:00:26.764249 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 08:00:26.764249 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 08:00:26.764249 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 08:00:26.764249 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 08:00:26.764249 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 08:00:26.764249 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80da1213-270f-4afc-87f8-345874caa669 could not be found. Jul 26 08:00:26.764249 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 08:00:26.768174 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f92e5e57-c04b-40ee-8195-8d62abd2cdfb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] Returning 404 to user: Instance 80da1213-270f-4afc-87f8-345874caa669 could not be found. {{(pid=117715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 08:00:26.768174 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f92e5e57-c04b-40ee-8195-8d62abd2cdfb tempest-ServerRescueNegativeTestJSON-1083850303 tempest-ServerRescueNegativeTestJSON-1083850303-project] 10.222.0.39 "GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669" status: 404 len: 111 microversion: 2.1 time: 0.046012 Jul 26 08:00:26.768174 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1195/2343] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:00:26 2022] GET /compute/v2.1/servers/80da1213-270f-4afc-87f8-345874caa669 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 08:00:37.719186 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 08:00:37.719703 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Tue Jul 26 08:00:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 08:00:38.032870 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 08:00:38.033618 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Tue Jul 26 08:00:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 08:00:53.098667 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=2 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:00:53.099601 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:00:53.104110 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-316848da-f609-4c41-98ab-cf49ee1cf710 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Action: 'create', calling method: .version_select at 0x7f7f04ee70d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1252635699", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcx/zeZyv5jw3kP5PoxMYSPi4ohWpfJbTmfuzolxsfFPmxZEK6+yIGmdCUEtyWIcaa5z/3nK7wkxJTGv9peDXTsW6tsNYCwn+k5XyVmT1Q1rGXEaAVPsLURAuf9UDwe1A=="}} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 08:00:53.139466 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.quota [None req-316848da-f609-4c41-98ab-cf49ee1cf710 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Getting quotas for project 8a46af50be774973800f747cdaf66896. Resources: {'key_pairs'} {{(pid=117716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 08:00:53.143693 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.quota [None req-316848da-f609-4c41-98ab-cf49ee1cf710 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Getting quotas for user dc6c885fee5440799beac8cfd3e42822 and project 8a46af50be774973800f747cdaf66896. Resources: {'key_pairs'} {{(pid=117716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 08:00:53.179562 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-316848da-f609-4c41-98ab-cf49ee1cf710 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.082650 Jul 26 08:00:53.180392 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1149/2344] 10.222.0.39 () {60 vars in 1159 bytes} [Tue Jul 26 08:00:53 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 08:00:53.368384 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-4638b853-afa1-4686-82eb-ba84025f7c57 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1489229811", "imageRef": "881d8d9f-1323-49d6-bfa0-511b08b32d7a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1252635699", "networks": [{"uuid": "4f8bde9d-da47-4291-b65a-68d2330b1d61"}]}} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 08:00:53.377096 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=14 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:00:53.377785 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=22 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:00:53.429694 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.network.neutron [None req-4638b853-afa1-4686-82eb-ba84025f7c57 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] validate_networks() for [('4f8bde9d-da47-4291-b65a-68d2330b1d61', None, None, None, None, None)] {{(pid=117715) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 08:00:53.854922 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-4638b853-afa1-4686-82eb-ba84025f7c57 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Flavor limits 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 08:00:53.855336 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-4638b853-afa1-4686-82eb-ba84025f7c57 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Image limits 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 08:00:53.855806 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-4638b853-afa1-4686-82eb-ba84025f7c57 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Flavor pref 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 08:00:53.856204 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-4638b853-afa1-4686-82eb-ba84025f7c57 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Image pref 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 08:00:53.856601 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-4638b853-afa1-4686-82eb-ba84025f7c57 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 08:00:53.867049 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4638b853-afa1-4686-82eb-ba84025f7c57 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:00:53.867493 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4638b853-afa1-4686-82eb-ba84025f7c57 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:00:53.868269 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4638b853-afa1-4686-82eb-ba84025f7c57 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:00:53.868694 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4638b853-afa1-4686-82eb-ba84025f7c57 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:00:53.898143 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.quota [None req-4638b853-afa1-4686-82eb-ba84025f7c57 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Getting quotas for project 8a46af50be774973800f747cdaf66896. Resources: {'instances', 'cores', 'ram'} {{(pid=117715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 08:00:53.898143 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.quota [None req-4638b853-afa1-4686-82eb-ba84025f7c57 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Getting quotas for user dc6c885fee5440799beac8cfd3e42822 and project 8a46af50be774973800f747cdaf66896. Resources: {'instances', 'cores', 'ram'} {{(pid=117715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 08:00:53.903828 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-4638b853-afa1-4686-82eb-ba84025f7c57 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Going to run 1 instances... {{(pid=117715) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 08:00:53.906545 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-4638b853-afa1-4686-82eb-ba84025f7c57 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='881d8d9f-1323-49d6-bfa0-511b08b32d7a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 08:00:53.955576 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-4638b853-afa1-4686-82eb-ba84025f7c57 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.591581 Jul 26 08:00:53.956223 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1196/2345] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Jul 26 08:00:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 08:00:53.967478 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c663a9b6-b674-44f3-bfa1-d29d4868c0ff tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:00:53.968306 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c663a9b6-b674-44f3-bfa1-d29d4868c0ff tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:00:54.038659 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-c663a9b6-b674-44f3-bfa1-d29d4868c0ff tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:00:54.048137 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c663a9b6-b674-44f3-bfa1-d29d4868c0ff tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1259 microversion: 2.1 time: 0.085052 Jul 26 08:00:54.049039 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1150/2346] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:00:53 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1259 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:00:55.073446 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ef73bb78-0e79-4295-8c94-1bd5d4a93527 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:00:55.075047 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ef73bb78-0e79-4295-8c94-1bd5d4a93527 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:00:55.083394 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef73bb78-0e79-4295-8c94-1bd5d4a93527 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:00:55.083943 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef73bb78-0e79-4295-8c94-1bd5d4a93527 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:00:55.084911 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef73bb78-0e79-4295-8c94-1bd5d4a93527 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:00:55.085457 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ef73bb78-0e79-4295-8c94-1bd5d4a93527 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:00:55.146607 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ef73bb78-0e79-4295-8c94-1bd5d4a93527 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:00:55.154330 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ef73bb78-0e79-4295-8c94-1bd5d4a93527 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1263 microversion: 2.1 time: 0.085688 Jul 26 08:00:55.155002 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1197/2347] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:00:55 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1263 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:00:56.175816 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-dd2122d4-ec6f-4c53-9d4d-0d8d8e593aa2 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:00:56.176434 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-dd2122d4-ec6f-4c53-9d4d-0d8d8e593aa2 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:00:56.183344 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dd2122d4-ec6f-4c53-9d4d-0d8d8e593aa2 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:00:56.183997 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dd2122d4-ec6f-4c53-9d4d-0d8d8e593aa2 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:00:56.184769 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dd2122d4-ec6f-4c53-9d4d-0d8d8e593aa2 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:00:56.185200 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-dd2122d4-ec6f-4c53-9d4d-0d8d8e593aa2 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:00:56.441480 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-dd2122d4-ec6f-4c53-9d4d-0d8d8e593aa2 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:00:56.450045 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-dd2122d4-ec6f-4c53-9d4d-0d8d8e593aa2 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1255 microversion: 2.1 time: 0.278044 Jul 26 08:00:56.450606 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1151/2348] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:00:56 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1255 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:00:57.471080 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f35fce28-d07c-41e5-ae4e-be740be9bdbd tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:00:57.472338 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f35fce28-d07c-41e5-ae4e-be740be9bdbd tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:00:57.480542 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f35fce28-d07c-41e5-ae4e-be740be9bdbd tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:00:57.481304 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f35fce28-d07c-41e5-ae4e-be740be9bdbd tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:00:57.482566 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f35fce28-d07c-41e5-ae4e-be740be9bdbd tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:00:57.483235 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f35fce28-d07c-41e5-ae4e-be740be9bdbd tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:00:57.659682 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f35fce28-d07c-41e5-ae4e-be740be9bdbd tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:00:57.689239 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f35fce28-d07c-41e5-ae4e-be740be9bdbd tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1317 microversion: 2.1 time: 0.221668 Jul 26 08:00:57.694981 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1198/2349] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:00:57 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:00:58.718837 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2feb344b-d555-4490-b177-5330e7f073f9 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:00:58.719438 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2feb344b-d555-4490-b177-5330e7f073f9 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:00:58.726128 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2feb344b-d555-4490-b177-5330e7f073f9 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:00:58.726888 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2feb344b-d555-4490-b177-5330e7f073f9 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:00:58.727844 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2feb344b-d555-4490-b177-5330e7f073f9 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:00:58.728446 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2feb344b-d555-4490-b177-5330e7f073f9 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:00:58.905095 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2feb344b-d555-4490-b177-5330e7f073f9 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:00:58.919550 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2feb344b-d555-4490-b177-5330e7f073f9 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1359 microversion: 2.1 time: 0.204425 Jul 26 08:00:58.930096 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1152/2350] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:00:58 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1359 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:00:59.944333 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e5d27e65-ae90-4231-b65c-878f5f877293 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:00:59.946391 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e5d27e65-ae90-4231-b65c-878f5f877293 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:00:59.954836 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e5d27e65-ae90-4231-b65c-878f5f877293 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:00:59.955887 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e5d27e65-ae90-4231-b65c-878f5f877293 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:00:59.957227 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e5d27e65-ae90-4231-b65c-878f5f877293 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:00:59.957657 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e5d27e65-ae90-4231-b65c-878f5f877293 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:00.150287 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-e5d27e65-ae90-4231-b65c-878f5f877293 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:01:00.158327 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e5d27e65-ae90-4231-b65c-878f5f877293 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1359 microversion: 2.1 time: 0.220231 Jul 26 08:01:00.158909 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1199/2351] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:00:59 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1359 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:01:01.179580 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2f650d63-6392-4349-afb4-6548708389e8 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:01:01.180356 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2f650d63-6392-4349-afb4-6548708389e8 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:01:01.187395 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2f650d63-6392-4349-afb4-6548708389e8 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:01.187840 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2f650d63-6392-4349-afb4-6548708389e8 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:01.188608 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2f650d63-6392-4349-afb4-6548708389e8 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:01.189037 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2f650d63-6392-4349-afb4-6548708389e8 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:01.323724 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2f650d63-6392-4349-afb4-6548708389e8 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:01:01.331752 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2f650d63-6392-4349-afb4-6548708389e8 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1359 microversion: 2.1 time: 0.156370 Jul 26 08:01:01.332506 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1153/2352] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:01:01 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:01:02.352815 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3f172c98-8fc2-42ee-918b-fed87976d456 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:01:02.353496 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3f172c98-8fc2-42ee-918b-fed87976d456 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:01:02.360005 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3f172c98-8fc2-42ee-918b-fed87976d456 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:02.360468 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3f172c98-8fc2-42ee-918b-fed87976d456 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:02.361241 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3f172c98-8fc2-42ee-918b-fed87976d456 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:02.361673 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3f172c98-8fc2-42ee-918b-fed87976d456 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:02.504888 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3f172c98-8fc2-42ee-918b-fed87976d456 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:01:02.512874 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3f172c98-8fc2-42ee-918b-fed87976d456 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1359 microversion: 2.1 time: 0.164129 Jul 26 08:01:02.513527 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1200/2353] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:01:02 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:01:03.536201 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-bf1a25e3-4a1b-4676-91a1-ba045f5e24ae tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:01:03.537711 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-bf1a25e3-4a1b-4676-91a1-ba045f5e24ae tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:01:03.546493 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bf1a25e3-4a1b-4676-91a1-ba045f5e24ae tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:03.547699 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bf1a25e3-4a1b-4676-91a1-ba045f5e24ae tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:03.549398 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bf1a25e3-4a1b-4676-91a1-ba045f5e24ae tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:03.550253 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-bf1a25e3-4a1b-4676-91a1-ba045f5e24ae tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:03.730640 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-bf1a25e3-4a1b-4676-91a1-ba045f5e24ae tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:01:03.739991 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-bf1a25e3-4a1b-4676-91a1-ba045f5e24ae tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1359 microversion: 2.1 time: 0.209483 Jul 26 08:01:03.740576 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1154/2354] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:01:03 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1359 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:01:04.760995 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ac98568e-29ce-428b-b8c4-f8b617dbb923 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:01:04.761692 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ac98568e-29ce-428b-b8c4-f8b617dbb923 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:01:04.764835 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell0:SELECT=2 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:01:04.766344 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell0:SELECT=6 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:01:04.772846 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ac98568e-29ce-428b-b8c4-f8b617dbb923 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:04.773296 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ac98568e-29ce-428b-b8c4-f8b617dbb923 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:04.774303 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ac98568e-29ce-428b-b8c4-f8b617dbb923 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:04.774735 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ac98568e-29ce-428b-b8c4-f8b617dbb923 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:04.904595 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ac98568e-29ce-428b-b8c4-f8b617dbb923 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:01:04.912060 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ac98568e-29ce-428b-b8c4-f8b617dbb923 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1359 microversion: 2.1 time: 0.155150 Jul 26 08:01:04.912626 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1201/2355] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:01:04 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 08:01:05.937102 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8e97229c-5f8c-4e0e-a6a1-254d218a53cc tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:01:05.938317 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8e97229c-5f8c-4e0e-a6a1-254d218a53cc tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:01:05.941182 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell0:SELECT=6 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:01:05.951398 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8e97229c-5f8c-4e0e-a6a1-254d218a53cc tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:05.952130 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8e97229c-5f8c-4e0e-a6a1-254d218a53cc tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:05.953415 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8e97229c-5f8c-4e0e-a6a1-254d218a53cc tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:05.954170 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8e97229c-5f8c-4e0e-a6a1-254d218a53cc tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:06.093661 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8e97229c-5f8c-4e0e-a6a1-254d218a53cc tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:01:06.101164 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8e97229c-5f8c-4e0e-a6a1-254d218a53cc tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1359 microversion: 2.1 time: 0.170608 Jul 26 08:01:06.101701 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1155/2356] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:01:05 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:01:07.122210 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-df4c4b3b-3d7a-4f16-8851-13d96599af3b tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:01:07.122810 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-df4c4b3b-3d7a-4f16-8851-13d96599af3b tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:01:07.129500 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-df4c4b3b-3d7a-4f16-8851-13d96599af3b tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:07.129933 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-df4c4b3b-3d7a-4f16-8851-13d96599af3b tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:07.130696 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-df4c4b3b-3d7a-4f16-8851-13d96599af3b tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:07.131129 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-df4c4b3b-3d7a-4f16-8851-13d96599af3b tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:07.618560 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-df4c4b3b-3d7a-4f16-8851-13d96599af3b tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:01:07.626472 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-df4c4b3b-3d7a-4f16-8851-13d96599af3b tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1359 microversion: 2.1 time: 0.508183 Jul 26 08:01:07.633988 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1202/2357] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:01:07 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1359 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:01:07.957284 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-3708e971-4dbd-48f3-b50d-cb25d62b68e4 req-6b8416c8-1d3a-4553-8d81-7afbab618b49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89e691fe-7c7b-4ad8-8558-50ff1413e0f8", "tag": "d40ebc80-aa04-4830-84fa-40a87398a8cd"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 08:01:07.969284 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-3708e971-4dbd-48f3-b50d-cb25d62b68e4 req-6b8416c8-1d3a-4553-8d81-7afbab618b49 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:07.970247 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-3708e971-4dbd-48f3-b50d-cb25d62b68e4 req-6b8416c8-1d3a-4553-8d81-7afbab618b49 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:07.994280 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-3708e971-4dbd-48f3-b50d-cb25d62b68e4 req-6b8416c8-1d3a-4553-8d81-7afbab618b49 service nova] Creating event network-changed:d40ebc80-aa04-4830-84fa-40a87398a8cd for instance 89e691fe-7c7b-4ad8-8558-50ff1413e0f8 on hv-cinder-85083 Jul 26 08:01:07.999759 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-3708e971-4dbd-48f3-b50d-cb25d62b68e4 req-6b8416c8-1d3a-4553-8d81-7afbab618b49 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046361 Jul 26 08:01:08.000527 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1156/2358] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 08:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 08:01:08.652192 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-99f0a84e-7186-42c2-8325-b06f2c3ec839 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:01:08.653175 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-99f0a84e-7186-42c2-8325-b06f2c3ec839 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:01:08.664862 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-99f0a84e-7186-42c2-8325-b06f2c3ec839 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:08.665618 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-99f0a84e-7186-42c2-8325-b06f2c3ec839 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:08.666939 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-99f0a84e-7186-42c2-8325-b06f2c3ec839 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:08.667665 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-99f0a84e-7186-42c2-8325-b06f2c3ec839 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:08.812347 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-99f0a84e-7186-42c2-8325-b06f2c3ec839 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:01:08.820194 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-99f0a84e-7186-42c2-8325-b06f2c3ec839 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1359 microversion: 2.1 time: 0.175184 Jul 26 08:01:08.821392 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1203/2359] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:01:08 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:01:09.848233 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-9e3443e9-69b1-4203-ae97-22f781335e7c tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:01:09.849374 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-9e3443e9-69b1-4203-ae97-22f781335e7c tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:01:09.860194 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9e3443e9-69b1-4203-ae97-22f781335e7c tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:09.860799 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9e3443e9-69b1-4203-ae97-22f781335e7c tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:09.862099 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9e3443e9-69b1-4203-ae97-22f781335e7c tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:09.862849 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-9e3443e9-69b1-4203-ae97-22f781335e7c tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:10.000304 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-9e3443e9-69b1-4203-ae97-22f781335e7c tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:01:10.010884 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-9e3443e9-69b1-4203-ae97-22f781335e7c tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1359 microversion: 2.1 time: 0.170476 Jul 26 08:01:10.011683 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1157/2360] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:01:09 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:01:11.034316 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7e657394-8421-4d83-b9d1-fa950f24ef8c tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:01:11.034986 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7e657394-8421-4d83-b9d1-fa950f24ef8c tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:01:11.043150 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7e657394-8421-4d83-b9d1-fa950f24ef8c tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:11.043604 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7e657394-8421-4d83-b9d1-fa950f24ef8c tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:11.044492 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7e657394-8421-4d83-b9d1-fa950f24ef8c tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:11.045008 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7e657394-8421-4d83-b9d1-fa950f24ef8c tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:11.185890 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7e657394-8421-4d83-b9d1-fa950f24ef8c tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:01:11.193453 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7e657394-8421-4d83-b9d1-fa950f24ef8c tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1359 microversion: 2.1 time: 0.164023 Jul 26 08:01:11.194047 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1204/2361] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:01:11 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:01:12.223948 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-cc19dbc6-c7fb-40d2-81cf-7d8b72b46b59 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:01:12.224878 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-cc19dbc6-c7fb-40d2-81cf-7d8b72b46b59 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:01:12.234767 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cc19dbc6-c7fb-40d2-81cf-7d8b72b46b59 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:12.235221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cc19dbc6-c7fb-40d2-81cf-7d8b72b46b59 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:12.235984 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cc19dbc6-c7fb-40d2-81cf-7d8b72b46b59 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:12.236419 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-cc19dbc6-c7fb-40d2-81cf-7d8b72b46b59 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:12.368550 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-cc19dbc6-c7fb-40d2-81cf-7d8b72b46b59 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:01:12.381198 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-cc19dbc6-c7fb-40d2-81cf-7d8b72b46b59 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1359 microversion: 2.1 time: 0.163617 Jul 26 08:01:12.382102 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1158/2362] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:01:12 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:01:13.406776 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-3457ac95-2349-425e-8f51-31e7b0cfefa0 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:01:13.407438 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-3457ac95-2349-425e-8f51-31e7b0cfefa0 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:01:13.414530 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3457ac95-2349-425e-8f51-31e7b0cfefa0 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:13.414962 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3457ac95-2349-425e-8f51-31e7b0cfefa0 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:13.415733 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3457ac95-2349-425e-8f51-31e7b0cfefa0 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:13.416165 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-3457ac95-2349-425e-8f51-31e7b0cfefa0 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:13.547816 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-3457ac95-2349-425e-8f51-31e7b0cfefa0 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:01:13.555540 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-3457ac95-2349-425e-8f51-31e7b0cfefa0 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1359 microversion: 2.1 time: 0.155113 Jul 26 08:01:13.556113 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1205/2363] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:01:13 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:01:14.577241 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-e54f35b6-07a9-4161-8d91-d1fefe7c9949 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:01:14.577995 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-e54f35b6-07a9-4161-8d91-d1fefe7c9949 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:01:14.585017 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e54f35b6-07a9-4161-8d91-d1fefe7c9949 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:14.585439 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e54f35b6-07a9-4161-8d91-d1fefe7c9949 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:14.586220 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e54f35b6-07a9-4161-8d91-d1fefe7c9949 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:14.586648 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-e54f35b6-07a9-4161-8d91-d1fefe7c9949 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:14.718735 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-e54f35b6-07a9-4161-8d91-d1fefe7c9949 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:01:14.729133 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-e54f35b6-07a9-4161-8d91-d1fefe7c9949 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1359 microversion: 2.1 time: 0.155784 Jul 26 08:01:14.729728 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1159/2364] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:01:14 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:01:15.755989 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-85c98a6b-cc05-46e2-867c-b51091b09222 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:01:15.757001 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-85c98a6b-cc05-46e2-867c-b51091b09222 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:01:15.767579 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-85c98a6b-cc05-46e2-867c-b51091b09222 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:15.768335 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-85c98a6b-cc05-46e2-867c-b51091b09222 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:15.769600 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-85c98a6b-cc05-46e2-867c-b51091b09222 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:15.770393 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-85c98a6b-cc05-46e2-867c-b51091b09222 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:15.914275 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-85c98a6b-cc05-46e2-867c-b51091b09222 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:01:15.924450 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-85c98a6b-cc05-46e2-867c-b51091b09222 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1359 microversion: 2.1 time: 0.175474 Jul 26 08:01:15.925021 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1206/2365] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:01:15 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:01:16.949767 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-efafe4b3-b2e2-4c16-a2bf-941e2bf5a878 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:01:16.950722 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-efafe4b3-b2e2-4c16-a2bf-941e2bf5a878 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:01:16.958389 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-efafe4b3-b2e2-4c16-a2bf-941e2bf5a878 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:16.958832 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-efafe4b3-b2e2-4c16-a2bf-941e2bf5a878 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:16.959576 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-efafe4b3-b2e2-4c16-a2bf-941e2bf5a878 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:16.959996 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-efafe4b3-b2e2-4c16-a2bf-941e2bf5a878 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:17.100702 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-efafe4b3-b2e2-4c16-a2bf-941e2bf5a878 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:01:17.108464 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-efafe4b3-b2e2-4c16-a2bf-941e2bf5a878 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1359 microversion: 2.1 time: 0.165698 Jul 26 08:01:17.117732 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1160/2366] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:01:16 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:01:18.128993 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-03c90681-b00c-49d5-8b99-44b62c41b344 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:01:18.129630 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-03c90681-b00c-49d5-8b99-44b62c41b344 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:01:18.135983 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-03c90681-b00c-49d5-8b99-44b62c41b344 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:18.136297 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-03c90681-b00c-49d5-8b99-44b62c41b344 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:18.137485 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-03c90681-b00c-49d5-8b99-44b62c41b344 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:18.137485 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-03c90681-b00c-49d5-8b99-44b62c41b344 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:18.183346 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-b20c96e1-0fb2-4db6-9e61-2b426412ed09 req-15375023-c7d6-4710-a696-4ea7bafdf2c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89e691fe-7c7b-4ad8-8558-50ff1413e0f8", "name": "network-vif-plugged", "status": "completed", "tag": "d40ebc80-aa04-4830-84fa-40a87398a8cd"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 08:01:18.193826 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-b20c96e1-0fb2-4db6-9e61-2b426412ed09 req-15375023-c7d6-4710-a696-4ea7bafdf2c0 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:18.194278 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-b20c96e1-0fb2-4db6-9e61-2b426412ed09 req-15375023-c7d6-4710-a696-4ea7bafdf2c0 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:18.209102 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-b20c96e1-0fb2-4db6-9e61-2b426412ed09 req-15375023-c7d6-4710-a696-4ea7bafdf2c0 service nova] Creating event network-vif-plugged:d40ebc80-aa04-4830-84fa-40a87398a8cd for instance 89e691fe-7c7b-4ad8-8558-50ff1413e0f8 on hv-cinder-85083 Jul 26 08:01:18.214423 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-b20c96e1-0fb2-4db6-9e61-2b426412ed09 req-15375023-c7d6-4710-a696-4ea7bafdf2c0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123747 Jul 26 08:01:18.215316 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1207/2367] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 08:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 08:01:18.275757 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-03c90681-b00c-49d5-8b99-44b62c41b344 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:01:18.285132 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-03c90681-b00c-49d5-8b99-44b62c41b344 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1359 microversion: 2.1 time: 0.159824 Jul 26 08:01:18.285937 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1161/2368] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:01:18 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 08:01:19.309220 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-2eeb0a31-d1b2-418f-89c3-3e130f1322ee tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:01:19.309929 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2eeb0a31-d1b2-418f-89c3-3e130f1322ee tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:01:19.317331 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2eeb0a31-d1b2-418f-89c3-3e130f1322ee tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:19.317987 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2eeb0a31-d1b2-418f-89c3-3e130f1322ee tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:19.318898 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2eeb0a31-d1b2-418f-89c3-3e130f1322ee tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:19.319475 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2eeb0a31-d1b2-418f-89c3-3e130f1322ee tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:19.485160 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2eeb0a31-d1b2-418f-89c3-3e130f1322ee tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:01:19.493660 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-2eeb0a31-d1b2-418f-89c3-3e130f1322ee tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1359 microversion: 2.1 time: 0.190031 Jul 26 08:01:19.494261 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1208/2369] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:01:19 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:01:20.514989 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-94fe9d0c-6145-48e2-b3d0-8b7a3f34c62b tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:01:20.515558 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-94fe9d0c-6145-48e2-b3d0-8b7a3f34c62b tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:01:20.522713 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-94fe9d0c-6145-48e2-b3d0-8b7a3f34c62b tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:20.523177 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-94fe9d0c-6145-48e2-b3d0-8b7a3f34c62b tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:20.523923 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-94fe9d0c-6145-48e2-b3d0-8b7a3f34c62b tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:20.524352 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-94fe9d0c-6145-48e2-b3d0-8b7a3f34c62b tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:20.654975 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-94fe9d0c-6145-48e2-b3d0-8b7a3f34c62b tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:01:20.663081 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-94fe9d0c-6145-48e2-b3d0-8b7a3f34c62b tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1549 microversion: 2.1 time: 0.151854 Jul 26 08:01:20.663523 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1162/2370] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:01:20 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:01:20.686599 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ecd2cbf1-f62c-4408-b30a-ca0bd00823f2 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:01:20.687217 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ecd2cbf1-f62c-4408-b30a-ca0bd00823f2 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:01:20.694180 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ecd2cbf1-f62c-4408-b30a-ca0bd00823f2 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:20.694629 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ecd2cbf1-f62c-4408-b30a-ca0bd00823f2 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:20.695384 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ecd2cbf1-f62c-4408-b30a-ca0bd00823f2 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:20.696186 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ecd2cbf1-f62c-4408-b30a-ca0bd00823f2 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:20.841499 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ecd2cbf1-f62c-4408-b30a-ca0bd00823f2 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:01:20.849341 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ecd2cbf1-f62c-4408-b30a-ca0bd00823f2 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1549 microversion: 2.1 time: 0.166623 Jul 26 08:01:20.849971 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1209/2371] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:01:20 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1549 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:01:20.868826 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-1a5c9dc8-b9b5-4a8c-8bd7-9a126c2a17eb tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:01:20.873484 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-1a5c9dc8-b9b5-4a8c-8bd7-9a126c2a17eb tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:01:20.874281 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-1a5c9dc8-b9b5-4a8c-8bd7-9a126c2a17eb tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Searching by: {'deleted': False, 'project_id': '8a46af50be774973800f747cdaf66896'} {{(pid=117716) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 08:01:20.881163 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1a5c9dc8-b9b5-4a8c-8bd7-9a126c2a17eb tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:20.881609 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1a5c9dc8-b9b5-4a8c-8bd7-9a126c2a17eb tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:20.882428 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1a5c9dc8-b9b5-4a8c-8bd7-9a126c2a17eb tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:20.882857 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1a5c9dc8-b9b5-4a8c-8bd7-9a126c2a17eb tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:20.973253 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.multi_cell_list [None req-1a5c9dc8-b9b5-4a8c-8bd7-9a126c2a17eb tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117716) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 08:01:21.067552 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-1a5c9dc8-b9b5-4a8c-8bd7-9a126c2a17eb tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.202405 Jul 26 08:01:21.068179 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1163/2372] 10.222.0.39 () {58 vars in 1125 bytes} [Tue Jul 26 08:01:20 2022] GET /compute/v2.1/servers => generated 343 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 08:01:21.080457 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e98ce101-59fc-49a9-9873-45cb68b974b9 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:01:21.081076 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e98ce101-59fc-49a9-9873-45cb68b974b9 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:01:21.088278 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e98ce101-59fc-49a9-9873-45cb68b974b9 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:21.088764 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e98ce101-59fc-49a9-9873-45cb68b974b9 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:21.089585 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e98ce101-59fc-49a9-9873-45cb68b974b9 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:21.090092 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e98ce101-59fc-49a9-9873-45cb68b974b9 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:21.221993 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-e98ce101-59fc-49a9-9873-45cb68b974b9 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:01:21.234635 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e98ce101-59fc-49a9-9873-45cb68b974b9 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1549 microversion: 2.1 time: 0.158611 Jul 26 08:01:21.235266 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1210/2373] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:01:21 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:01:22.938654 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8f332a4d-479c-443b-be3d-0fb0117a5751 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ecdcf491-e35d-4c64-9da2-37552084bdc2"}} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 08:01:22.941684 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8f332a4d-479c-443b-be3d-0fb0117a5751 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:01:22.949954 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8f332a4d-479c-443b-be3d-0fb0117a5751 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:22.950402 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8f332a4d-479c-443b-be3d-0fb0117a5751 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:22.951465 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8f332a4d-479c-443b-be3d-0fb0117a5751 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:22.951741 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8f332a4d-479c-443b-be3d-0fb0117a5751 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:23.263892 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:01:23.292192 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8f332a4d-479c-443b-be3d-0fb0117a5751 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "POST /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.357257 Jul 26 08:01:23.292813 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1164/2374] 10.222.0.39 () {60 vars in 1323 bytes} [Tue Jul 26 08:01:22 2022] POST /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8/os-volume_attachments => generated 194 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 08:01:34.203763 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9f8eb031-24e5-450c-985e-041b193af194 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:01:34.206090 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-9f8eb031-24e5-450c-985e-041b193af194 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:01:34.209941 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:01:34.211056 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=82 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:01:34.218568 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9f8eb031-24e5-450c-985e-041b193af194 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:34.219232 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9f8eb031-24e5-450c-985e-041b193af194 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:34.220536 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9f8eb031-24e5-450c-985e-041b193af194 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:34.221091 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9f8eb031-24e5-450c-985e-041b193af194 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:34.393644 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-9f8eb031-24e5-450c-985e-041b193af194 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:01:34.404340 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-9f8eb031-24e5-450c-985e-041b193af194 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1595 microversion: 2.1 time: 0.204839 Jul 26 08:01:34.404937 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1211/2375] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:01:34 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1595 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:01:37.175122 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell0:SELECT=2 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:01:37.175905 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:01:37.176703 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=2,nova_cell1:INSERT=1 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:01:37.449269 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-7eb51881-5f9b-4052-8fd8-0633a3f8642d req-74b8410c-d7af-40fd-99d6-ad680260e73b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89e691fe-7c7b-4ad8-8558-50ff1413e0f8", "tag": "d40ebc80-aa04-4830-84fa-40a87398a8cd"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 08:01:37.470527 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-7eb51881-5f9b-4052-8fd8-0633a3f8642d req-74b8410c-d7af-40fd-99d6-ad680260e73b service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:37.472517 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-7eb51881-5f9b-4052-8fd8-0633a3f8642d req-74b8410c-d7af-40fd-99d6-ad680260e73b service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:37.496049 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-7eb51881-5f9b-4052-8fd8-0633a3f8642d req-74b8410c-d7af-40fd-99d6-ad680260e73b service nova] Creating event network-changed:d40ebc80-aa04-4830-84fa-40a87398a8cd for instance 89e691fe-7c7b-4ad8-8558-50ff1413e0f8 on hv-cinder-85083 Jul 26 08:01:37.503524 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-7eb51881-5f9b-4052-8fd8-0633a3f8642d req-74b8410c-d7af-40fd-99d6-ad680260e73b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.329763 Jul 26 08:01:37.505056 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1165/2376] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 08:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 08:01:38.739753 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-1bc74773-ff67-4f0e-9446-bf81a74deef6 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-711046332"}} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 08:01:38.740329 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-1bc74773-ff67-4f0e-9446-bf81a74deef6 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:01:38.748827 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1bc74773-ff67-4f0e-9446-bf81a74deef6 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:38.749381 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1bc74773-ff67-4f0e-9446-bf81a74deef6 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:38.750209 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1bc74773-ff67-4f0e-9446-bf81a74deef6 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:38.750638 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1bc74773-ff67-4f0e-9446-bf81a74deef6 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:38.916669 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.network.security_group_api [None req-1bc74773-ff67-4f0e-9446-bf81a74deef6 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Adding security group 7716dc27-54f9-449e-b35f-fd92fadc289a to port d40ebc80-aa04-4830-84fa-40a87398a8cd Jul 26 08:01:39.270280 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-1bc74773-ff67-4f0e-9446-bf81a74deef6 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "POST /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8/action" status: 202 len: 0 microversion: 2.1 time: 0.535132 Jul 26 08:01:39.282192 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1212/2377] 10.222.0.39 () {60 vars in 1278 bytes} [Tue Jul 26 08:01:38 2022] POST /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8/action => generated 0 bytes in 548 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 08:01:39.287280 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-475b9631-1c61-4419-bdc7-6ed4295456a4 req-d15caa9f-d12e-4a2f-8b24-5114c8255813 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89e691fe-7c7b-4ad8-8558-50ff1413e0f8", "tag": "d40ebc80-aa04-4830-84fa-40a87398a8cd"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 08:01:39.290238 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-958e2902-7455-43f8-9689-d1f8a5d01d4b tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:01:39.291089 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-958e2902-7455-43f8-9689-d1f8a5d01d4b tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:01:39.302609 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-958e2902-7455-43f8-9689-d1f8a5d01d4b tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:39.303056 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-958e2902-7455-43f8-9689-d1f8a5d01d4b tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:39.303932 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-958e2902-7455-43f8-9689-d1f8a5d01d4b tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:39.304395 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-958e2902-7455-43f8-9689-d1f8a5d01d4b tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:39.319000 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-475b9631-1c61-4419-bdc7-6ed4295456a4 req-d15caa9f-d12e-4a2f-8b24-5114c8255813 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:01:39.321056 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-475b9631-1c61-4419-bdc7-6ed4295456a4 req-d15caa9f-d12e-4a2f-8b24-5114c8255813 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:01:39.336022 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-475b9631-1c61-4419-bdc7-6ed4295456a4 req-d15caa9f-d12e-4a2f-8b24-5114c8255813 service nova] Creating event network-changed:d40ebc80-aa04-4830-84fa-40a87398a8cd for instance 89e691fe-7c7b-4ad8-8558-50ff1413e0f8 on hv-cinder-85083 Jul 26 08:01:39.351033 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-475b9631-1c61-4419-bdc7-6ed4295456a4 req-d15caa9f-d12e-4a2f-8b24-5114c8255813 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058167 Jul 26 08:01:39.352338 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1213/2378] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 08:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 08:01:39.604861 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-958e2902-7455-43f8-9689-d1f8a5d01d4b tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:01:39.614758 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-958e2902-7455-43f8-9689-d1f8a5d01d4b tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1759 microversion: 2.1 time: 0.337784 Jul 26 08:01:39.616171 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1166/2379] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:01:39 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1759 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:02:02.242019 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=6 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:02:02.248150 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=12 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:02:02.248150 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-fff430af-e226-49b6-ab28-391030ad7493 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 08:02:02.250105 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-fff430af-e226-49b6-ab28-391030ad7493 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:02:02.258091 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fff430af-e226-49b6-ab28-391030ad7493 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:02.258649 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fff430af-e226-49b6-ab28-391030ad7493 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:02.259501 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fff430af-e226-49b6-ab28-391030ad7493 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:02.260008 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-fff430af-e226-49b6-ab28-391030ad7493 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:02.346166 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-fff430af-e226-49b6-ab28-391030ad7493 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "POST /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8/action" status: 202 len: 0 microversion: 2.1 time: 0.105767 Jul 26 08:02:02.350929 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1214/2380] 10.222.0.39 () {60 vars in 1278 bytes} [Tue Jul 26 08:02:02 2022] POST /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 08:02:02.356889 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-922a231d-5f7c-4be9-860d-8fe3f5cc88e8 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:02:02.357782 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-922a231d-5f7c-4be9-860d-8fe3f5cc88e8 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:02:02.361091 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=4 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:02:02.361724 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=8 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:02:02.366379 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-922a231d-5f7c-4be9-860d-8fe3f5cc88e8 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:02.366830 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-922a231d-5f7c-4be9-860d-8fe3f5cc88e8 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:02.367715 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-922a231d-5f7c-4be9-860d-8fe3f5cc88e8 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:02.368263 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-922a231d-5f7c-4be9-860d-8fe3f5cc88e8 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:02.577310 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-922a231d-5f7c-4be9-860d-8fe3f5cc88e8 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:02:02.588037 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-922a231d-5f7c-4be9-860d-8fe3f5cc88e8 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1751 microversion: 2.1 time: 0.235734 Jul 26 08:02:02.601815 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1167/2381] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:02:02 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1751 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:02:03.611177 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-ded79a0c-003d-4b7d-9c32-4b7814b0a973 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:02:03.611915 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-ded79a0c-003d-4b7d-9c32-4b7814b0a973 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:02:03.618673 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ded79a0c-003d-4b7d-9c32-4b7814b0a973 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:03.619134 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ded79a0c-003d-4b7d-9c32-4b7814b0a973 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:03.619888 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ded79a0c-003d-4b7d-9c32-4b7814b0a973 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:03.620314 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-ded79a0c-003d-4b7d-9c32-4b7814b0a973 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:03.764743 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-ded79a0c-003d-4b7d-9c32-4b7814b0a973 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:02:03.772905 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-ded79a0c-003d-4b7d-9c32-4b7814b0a973 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1756 microversion: 2.1 time: 0.165933 Jul 26 08:02:03.773468 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1215/2382] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:02:03 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:02:04.800941 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8acbd157-3071-4806-8a28-0fca3264db14 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:02:04.801798 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8acbd157-3071-4806-8a28-0fca3264db14 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:02:04.809137 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8acbd157-3071-4806-8a28-0fca3264db14 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:04.809580 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8acbd157-3071-4806-8a28-0fca3264db14 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:04.810347 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8acbd157-3071-4806-8a28-0fca3264db14 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:04.810772 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8acbd157-3071-4806-8a28-0fca3264db14 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:04.953657 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8acbd157-3071-4806-8a28-0fca3264db14 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:02:04.962422 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8acbd157-3071-4806-8a28-0fca3264db14 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1756 microversion: 2.1 time: 0.166217 Jul 26 08:02:04.963021 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1168/2383] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:02:04 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:02:05.988239 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-81907bbc-cb4b-4274-8792-c78d4422da55 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:02:05.989077 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-81907bbc-cb4b-4274-8792-c78d4422da55 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:02:05.997722 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-81907bbc-cb4b-4274-8792-c78d4422da55 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:05.998209 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-81907bbc-cb4b-4274-8792-c78d4422da55 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:05.998970 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-81907bbc-cb4b-4274-8792-c78d4422da55 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:05.999404 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-81907bbc-cb4b-4274-8792-c78d4422da55 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:06.150039 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-81907bbc-cb4b-4274-8792-c78d4422da55 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:02:06.158312 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-81907bbc-cb4b-4274-8792-c78d4422da55 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1756 microversion: 2.1 time: 0.176679 Jul 26 08:02:06.158919 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1216/2384] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:02:05 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:02:07.180151 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-92d8e040-b756-426e-9a19-7bb3e379c08a tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:02:07.181201 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-92d8e040-b756-426e-9a19-7bb3e379c08a tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:02:07.188890 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-92d8e040-b756-426e-9a19-7bb3e379c08a tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:07.189433 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-92d8e040-b756-426e-9a19-7bb3e379c08a tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:07.190221 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-92d8e040-b756-426e-9a19-7bb3e379c08a tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:07.190655 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-92d8e040-b756-426e-9a19-7bb3e379c08a tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:07.345308 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-92d8e040-b756-426e-9a19-7bb3e379c08a tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:02:07.354183 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-92d8e040-b756-426e-9a19-7bb3e379c08a tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1756 microversion: 2.1 time: 0.178329 Jul 26 08:02:07.355119 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1169/2385] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:02:07 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:02:08.376992 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-1888be6a-7a74-4830-a2c8-778b0ae7350d tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:02:08.377648 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-1888be6a-7a74-4830-a2c8-778b0ae7350d tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:02:08.385144 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1888be6a-7a74-4830-a2c8-778b0ae7350d tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:08.385687 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1888be6a-7a74-4830-a2c8-778b0ae7350d tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:08.386526 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1888be6a-7a74-4830-a2c8-778b0ae7350d tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:08.387049 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1888be6a-7a74-4830-a2c8-778b0ae7350d tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:08.552250 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-1888be6a-7a74-4830-a2c8-778b0ae7350d tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:02:08.561316 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-1888be6a-7a74-4830-a2c8-778b0ae7350d tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1756 microversion: 2.1 time: 0.188753 Jul 26 08:02:08.561939 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1217/2386] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:02:08 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:02:09.583879 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2b010cea-2470-4c49-90f0-fbd9f04c2ea2 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:02:09.584456 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2b010cea-2470-4c49-90f0-fbd9f04c2ea2 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:02:09.591997 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2b010cea-2470-4c49-90f0-fbd9f04c2ea2 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:09.592432 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2b010cea-2470-4c49-90f0-fbd9f04c2ea2 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:09.593199 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2b010cea-2470-4c49-90f0-fbd9f04c2ea2 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:09.593623 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2b010cea-2470-4c49-90f0-fbd9f04c2ea2 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:09.740903 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2b010cea-2470-4c49-90f0-fbd9f04c2ea2 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:02:09.750776 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2b010cea-2470-4c49-90f0-fbd9f04c2ea2 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1756 microversion: 2.1 time: 0.170967 Jul 26 08:02:09.751375 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1170/2387] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:02:09 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:02:10.776554 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-26938655-ccf7-42a7-9de4-80689468f9a2 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:02:10.777679 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-26938655-ccf7-42a7-9de4-80689468f9a2 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:02:10.788614 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-26938655-ccf7-42a7-9de4-80689468f9a2 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:10.789370 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-26938655-ccf7-42a7-9de4-80689468f9a2 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:10.790688 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-26938655-ccf7-42a7-9de4-80689468f9a2 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:10.791471 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-26938655-ccf7-42a7-9de4-80689468f9a2 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:10.947336 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-26938655-ccf7-42a7-9de4-80689468f9a2 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:02:10.955907 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-26938655-ccf7-42a7-9de4-80689468f9a2 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1756 microversion: 2.1 time: 0.185908 Jul 26 08:02:10.956467 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1218/2388] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:02:10 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:02:11.982150 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-50c1d059-4725-4557-a98b-f8082d52317f tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:02:11.983446 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-50c1d059-4725-4557-a98b-f8082d52317f tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:02:11.994971 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-50c1d059-4725-4557-a98b-f8082d52317f tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:11.995714 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-50c1d059-4725-4557-a98b-f8082d52317f tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:11.996778 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-50c1d059-4725-4557-a98b-f8082d52317f tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:11.997203 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-50c1d059-4725-4557-a98b-f8082d52317f tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:12.152534 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-50c1d059-4725-4557-a98b-f8082d52317f tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:02:12.161443 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-50c1d059-4725-4557-a98b-f8082d52317f tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1756 microversion: 2.1 time: 0.186742 Jul 26 08:02:12.162098 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1171/2389] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:02:11 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1756 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:02:13.185294 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-540ef085-af6d-4f44-b07e-07a6679e774e tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:02:13.186131 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-540ef085-af6d-4f44-b07e-07a6679e774e tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:02:13.196115 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-540ef085-af6d-4f44-b07e-07a6679e774e tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:13.197000 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-540ef085-af6d-4f44-b07e-07a6679e774e tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:13.198259 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-540ef085-af6d-4f44-b07e-07a6679e774e tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:13.198910 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-540ef085-af6d-4f44-b07e-07a6679e774e tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:13.350468 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-540ef085-af6d-4f44-b07e-07a6679e774e tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:02:13.361092 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-540ef085-af6d-4f44-b07e-07a6679e774e tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1756 microversion: 2.1 time: 0.180818 Jul 26 08:02:13.361827 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1219/2390] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:02:13 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:02:14.386942 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-2dacbf6b-ea29-4822-8829-554963c117a4 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:02:14.387969 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-2dacbf6b-ea29-4822-8829-554963c117a4 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:02:14.395836 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2dacbf6b-ea29-4822-8829-554963c117a4 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:14.396281 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2dacbf6b-ea29-4822-8829-554963c117a4 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:14.397043 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2dacbf6b-ea29-4822-8829-554963c117a4 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:14.397471 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-2dacbf6b-ea29-4822-8829-554963c117a4 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:14.555038 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-2dacbf6b-ea29-4822-8829-554963c117a4 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:02:14.564272 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-2dacbf6b-ea29-4822-8829-554963c117a4 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1756 microversion: 2.1 time: 0.184474 Jul 26 08:02:14.564839 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1172/2391] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:02:14 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:02:15.589327 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-2fce1509-5656-4062-9c3b-bf09b1f07b35 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:02:15.590015 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2fce1509-5656-4062-9c3b-bf09b1f07b35 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:02:15.597387 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2fce1509-5656-4062-9c3b-bf09b1f07b35 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:15.598013 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2fce1509-5656-4062-9c3b-bf09b1f07b35 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:15.598774 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2fce1509-5656-4062-9c3b-bf09b1f07b35 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:15.599206 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2fce1509-5656-4062-9c3b-bf09b1f07b35 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:15.746323 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2fce1509-5656-4062-9c3b-bf09b1f07b35 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:02:15.755277 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-2fce1509-5656-4062-9c3b-bf09b1f07b35 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1759 microversion: 2.1 time: 0.172179 Jul 26 08:02:15.755843 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1220/2392] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:02:15 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1759 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:02:27.290117 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 08:02:27.290863 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Tue Jul 26 08:02:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 08:02:48.419034 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-5d4ddfe1-b9f4-4c07-a62f-cd72b27004ac tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-711046332"}} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 08:02:48.420161 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-5d4ddfe1-b9f4-4c07-a62f-cd72b27004ac tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:02:48.423393 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=12 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:02:48.424461 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=36 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:02:48.434726 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5d4ddfe1-b9f4-4c07-a62f-cd72b27004ac tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:48.435142 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5d4ddfe1-b9f4-4c07-a62f-cd72b27004ac tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:48.435951 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5d4ddfe1-b9f4-4c07-a62f-cd72b27004ac tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:48.436379 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-5d4ddfe1-b9f4-4c07-a62f-cd72b27004ac tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:48.569812 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.network.security_group_api [None req-5d4ddfe1-b9f4-4c07-a62f-cd72b27004ac tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Removing security group 7716dc27-54f9-449e-b35f-fd92fadc289a from port d40ebc80-aa04-4830-84fa-40a87398a8cd Jul 26 08:02:48.937152 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-5d4ddfe1-b9f4-4c07-a62f-cd72b27004ac tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "POST /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8/action" status: 202 len: 0 microversion: 2.1 time: 0.524759 Jul 26 08:02:48.940922 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1173/2393] 10.222.0.39 () {60 vars in 1278 bytes} [Tue Jul 26 08:02:48 2022] POST /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 08:02:48.947958 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-3f0a955e-8263-4249-9f6b-7ac9f6328738 req-09b9d4c7-0136-4768-a0d8-66c1dc03b4a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89e691fe-7c7b-4ad8-8558-50ff1413e0f8", "tag": "d40ebc80-aa04-4830-84fa-40a87398a8cd"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 08:02:48.953440 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=14 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:02:48.957189 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:02:48.978453 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-3f0a955e-8263-4249-9f6b-7ac9f6328738 req-09b9d4c7-0136-4768-a0d8-66c1dc03b4a4 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:48.979036 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-3f0a955e-8263-4249-9f6b-7ac9f6328738 req-09b9d4c7-0136-4768-a0d8-66c1dc03b4a4 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:49.002323 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-3f0a955e-8263-4249-9f6b-7ac9f6328738 req-09b9d4c7-0136-4768-a0d8-66c1dc03b4a4 service nova] Creating event network-changed:d40ebc80-aa04-4830-84fa-40a87398a8cd for instance 89e691fe-7c7b-4ad8-8558-50ff1413e0f8 on hv-cinder-85083 Jul 26 08:02:49.011908 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-3f0a955e-8263-4249-9f6b-7ac9f6328738 req-09b9d4c7-0136-4768-a0d8-66c1dc03b4a4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067962 Jul 26 08:02:49.012515 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1221/2394] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 08:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 08:02:50.077114 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-faa4426a-d8d5-4d13-9f4d-488c42e16dbb tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:02:50.077623 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-faa4426a-d8d5-4d13-9f4d-488c42e16dbb tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:02:50.084188 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-faa4426a-d8d5-4d13-9f4d-488c42e16dbb tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:50.084633 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-faa4426a-d8d5-4d13-9f4d-488c42e16dbb tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:50.085385 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-faa4426a-d8d5-4d13-9f4d-488c42e16dbb tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:50.085844 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-faa4426a-d8d5-4d13-9f4d-488c42e16dbb tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:50.165948 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.objects.instance [None req-faa4426a-d8d5-4d13-9f4d-488c42e16dbb tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lazy-loading 'services' on Instance uuid 89e691fe-7c7b-4ad8-8558-50ff1413e0f8 {{(pid=117716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 08:02:50.239323 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-faa4426a-d8d5-4d13-9f4d-488c42e16dbb tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "DELETE /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8/os-volume_attachments/ecdcf491-e35d-4c64-9da2-37552084bdc2" status: 202 len: 0 microversion: 2.1 time: 0.166673 Jul 26 08:02:50.240245 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1174/2395] 10.222.0.39 () {58 vars in 1416 bytes} [Tue Jul 26 08:02:50 2022] DELETE /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8/os-volume_attachments/ecdcf491-e35d-4c64-9da2-37552084bdc2 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 08:02:50.249631 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8601ce15-2872-4892-bd0a-ef93c3c773b2 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:02:50.252141 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-8601ce15-2872-4892-bd0a-ef93c3c773b2 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:02:50.261564 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8601ce15-2872-4892-bd0a-ef93c3c773b2 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:50.262054 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8601ce15-2872-4892-bd0a-ef93c3c773b2 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:50.262848 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8601ce15-2872-4892-bd0a-ef93c3c773b2 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:50.263260 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-8601ce15-2872-4892-bd0a-ef93c3c773b2 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:50.294062 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8601ce15-2872-4892-bd0a-ef93c3c773b2 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049239 Jul 26 08:02:50.298848 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1222/2396] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 08:02:50 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 08:02:51.028619 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-519eae2e-fd08-4a7c-b6f0-fa95ed5edff3 req-6510e61e-0900-41d4-b12c-ebaca006e2ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89e691fe-7c7b-4ad8-8558-50ff1413e0f8", "tag": "d40ebc80-aa04-4830-84fa-40a87398a8cd"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 08:02:51.038737 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-519eae2e-fd08-4a7c-b6f0-fa95ed5edff3 req-6510e61e-0900-41d4-b12c-ebaca006e2ec service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:51.039213 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-519eae2e-fd08-4a7c-b6f0-fa95ed5edff3 req-6510e61e-0900-41d4-b12c-ebaca006e2ec service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:51.049926 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-519eae2e-fd08-4a7c-b6f0-fa95ed5edff3 req-6510e61e-0900-41d4-b12c-ebaca006e2ec service nova] Creating event network-changed:d40ebc80-aa04-4830-84fa-40a87398a8cd for instance 89e691fe-7c7b-4ad8-8558-50ff1413e0f8 on hv-cinder-85083 Jul 26 08:02:51.054731 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-519eae2e-fd08-4a7c-b6f0-fa95ed5edff3 req-6510e61e-0900-41d4-b12c-ebaca006e2ec service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030368 Jul 26 08:02:51.055284 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1175/2397] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 08:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 08:02:51.306228 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-b95b0cfc-1d69-4539-85de-b6887df46f89 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:02:51.308388 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-b95b0cfc-1d69-4539-85de-b6887df46f89 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:02:51.316719 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b95b0cfc-1d69-4539-85de-b6887df46f89 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:51.317159 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b95b0cfc-1d69-4539-85de-b6887df46f89 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:51.317953 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b95b0cfc-1d69-4539-85de-b6887df46f89 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:51.318382 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-b95b0cfc-1d69-4539-85de-b6887df46f89 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:51.348082 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-b95b0cfc-1d69-4539-85de-b6887df46f89 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045886 Jul 26 08:02:51.348859 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1223/2398] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Jul 26 08:02:51 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 08:02:51.360321 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-1216a74d-e4c0-4494-b502-87f7b19a5c12 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:02:51.360861 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-1216a74d-e4c0-4494-b502-87f7b19a5c12 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:02:51.367290 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1216a74d-e4c0-4494-b502-87f7b19a5c12 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:51.367734 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1216a74d-e4c0-4494-b502-87f7b19a5c12 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:51.368476 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1216a74d-e4c0-4494-b502-87f7b19a5c12 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:51.368898 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-1216a74d-e4c0-4494-b502-87f7b19a5c12 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:51.448315 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.wsgi [None req-1216a74d-e4c0-4494-b502-87f7b19a5c12 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] HTTP exception thrown: Instance 89e691fe-7c7b-4ad8-8558-50ff1413e0f8 is not attached to volume ecdcf491-e35d-4c64-9da2-37552084bdc2 Jul 26 08:02:51.450850 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-1216a74d-e4c0-4494-b502-87f7b19a5c12 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Request method failure captured: Jul 26 08:02:51.450850 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: request: DELETE /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8/os-volume_attachments/ecdcf491-e35d-4c64-9da2-37552084bdc2 HTTP/1.1 Jul 26 08:02:51.450850 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept: application/json Jul 26 08:02:51.450850 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept-Encoding: identity Jul 26 08:02:51.450850 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Connection: close Jul 26 08:02:51.450850 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Length: 0 Jul 26 08:02:51.450850 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Type: application/json Jul 26 08:02:51.450850 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Host: 10.222.0.39 Jul 26 08:02:51.450850 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Openstack-System-Scope: None Jul 26 08:02:51.450850 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: User-Agent: python-urllib3/1.26.10 Jul 26 08:02:51.450850 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Auth-Token: gAAAAABi358g7tnq_2F-5Cl4uOM-_RhPJbOqMI0gVSFLdLyLsSE6ObVFiJhRvoYWQRM1UY5KjKWvHtByNef2A8CmY7tF1c2-7UwWuce26VHHITQSQ_tQ_ynv2UIKfX3C4wjsSruhRqtCeTOhNk1c5-hijl5P3Df3kUgO441iUmAYsVgOyyMFWFQ Jul 26 08:02:51.450850 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Id: None Jul 26 08:02:51.450850 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Name: None Jul 26 08:02:51.450850 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Identity-Status: Confirmed Jul 26 08:02:51.450850 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Is-Admin-Project: True Jul 26 08:02:51.450850 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Id: default Jul 26 08:02:51.450850 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Name: Default Jul 26 08:02:51.450850 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Id: 8a46af50be774973800f747cdaf66896 Jul 26 08:02:51.450850 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Name: tempest-TestMinimumBasicScenario-458687075 Jul 26 08:02:51.450850 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Role: member,reader Jul 26 08:02:51.450850 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Roles: member,reader Jul 26 08:02:51.452358 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8a46af50be774973800f747cdaf66896"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8a46af50be774973800f747cdaf66896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8a46af50be774973800f747cdaf66896"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8a46af50be774973800f747cdaf66896"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 08:02:51.452358 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant: tempest-TestMinimumBasicScenario-458687075 Jul 26 08:02:51.452358 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Id: 8a46af50be774973800f747cdaf66896 Jul 26 08:02:51.452358 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Name: tempest-TestMinimumBasicScenario-458687075 Jul 26 08:02:51.452358 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User: tempest-TestMinimumBasicScenario-458687075-project Jul 26 08:02:51.452358 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Id: default Jul 26 08:02:51.452358 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Name: Default Jul 26 08:02:51.452358 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Id: dc6c885fee5440799beac8cfd3e42822 Jul 26 08:02:51.452358 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Name: tempest-TestMinimumBasicScenario-458687075-project Jul 26 08:02:51.452358 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: method: > Jul 26 08:02:51.452358 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: exception: Instance 89e691fe-7c7b-4ad8-8558-50ff1413e0f8 is not attached to volume ecdcf491-e35d-4c64-9da2-37552084bdc2 Jul 26 08:02:51.452996 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: action_args: {'server_id': '89e691fe-7c7b-4ad8-8558-50ff1413e0f8', 'id': 'ecdcf491-e35d-4c64-9da2-37552084bdc2'} Jul 26 08:02:51.452996 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 08:02:51.452996 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 08:02:51.452996 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 26 08:02:51.452996 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 26 08:02:51.452996 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 08:02:51.452996 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 08:02:51.452996 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 26 08:02:51.452996 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 26 08:02:51.452996 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ecdcf491-e35d-4c64-9da2-37552084bdc2. Jul 26 08:02:51.452996 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 08:02:51.452996 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 08:02:51.452996 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 08:02:51.452996 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 08:02:51.452996 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 08:02:51.452996 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 08:02:51.452996 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 08:02:51.452996 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 08:02:51.452996 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 08:02:51.454229 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 08:02:51.454229 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 26 08:02:51.454229 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 08:02:51.454229 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89e691fe-7c7b-4ad8-8558-50ff1413e0f8 is not attached to volume ecdcf491-e35d-4c64-9da2-37552084bdc2 Jul 26 08:02:51.454229 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 08:02:51.454229 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 08:02:51.454229 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 08:02:51.454229 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 08:02:51.454229 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 08:02:51.454229 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 08:02:51.454229 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 08:02:51.454229 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 08:02:51.454229 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89e691fe-7c7b-4ad8-8558-50ff1413e0f8 is not attached to volume ecdcf491-e35d-4c64-9da2-37552084bdc2 Jul 26 08:02:51.454229 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 08:02:51.454229 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-1216a74d-e4c0-4494-b502-87f7b19a5c12 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Returning 404 to user: Instance 89e691fe-7c7b-4ad8-8558-50ff1413e0f8 is not attached to volume ecdcf491-e35d-4c64-9da2-37552084bdc2 {{(pid=117716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 08:02:51.455149 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-1216a74d-e4c0-4494-b502-87f7b19a5c12 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "DELETE /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8/os-volume_attachments/ecdcf491-e35d-4c64-9da2-37552084bdc2" status: 404 len: 154 microversion: 2.1 time: 0.097052 Jul 26 08:02:51.456143 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1176/2399] 10.222.0.39 () {58 vars in 1416 bytes} [Tue Jul 26 08:02:51 2022] DELETE /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8/os-volume_attachments/ecdcf491-e35d-4c64-9da2-37552084bdc2 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 08:02:52.615271 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d0084cdb-78be-4b7b-b836-01189969179a tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:02:52.615755 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d0084cdb-78be-4b7b-b836-01189969179a tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:02:52.622506 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d0084cdb-78be-4b7b-b836-01189969179a tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:52.622957 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d0084cdb-78be-4b7b-b836-01189969179a tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:52.623720 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d0084cdb-78be-4b7b-b836-01189969179a tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:52.624153 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d0084cdb-78be-4b7b-b836-01189969179a tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:52.648412 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d0084cdb-78be-4b7b-b836-01189969179a tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Going to try to terminate instance {{(pid=117715) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 08:02:52.731016 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d0084cdb-78be-4b7b-b836-01189969179a tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "DELETE /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 204 len: 0 microversion: 2.1 time: 0.119174 Jul 26 08:02:52.731602 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1224/2400] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Jul 26 08:02:52 2022] DELETE /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 08:02:52.740339 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-f0d6906e-c233-4ef4-bd1d-e8c6968216cf tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:02:52.740969 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-f0d6906e-c233-4ef4-bd1d-e8c6968216cf tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:02:52.748250 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f0d6906e-c233-4ef4-bd1d-e8c6968216cf tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:52.748695 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f0d6906e-c233-4ef4-bd1d-e8c6968216cf tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:52.749451 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f0d6906e-c233-4ef4-bd1d-e8c6968216cf tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:52.749921 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-f0d6906e-c233-4ef4-bd1d-e8c6968216cf tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:52.877861 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-f0d6906e-c233-4ef4-bd1d-e8c6968216cf tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:02:52.888709 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-f0d6906e-c233-4ef4-bd1d-e8c6968216cf tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1555 microversion: 2.1 time: 0.152421 Jul 26 08:02:52.889375 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1177/2401] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:02:52 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 08:02:53.915008 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f4007194-0110-4888-90c1-44eb1aa7c56a tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:02:53.916154 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f4007194-0110-4888-90c1-44eb1aa7c56a tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:02:53.924664 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f4007194-0110-4888-90c1-44eb1aa7c56a tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:53.925143 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f4007194-0110-4888-90c1-44eb1aa7c56a tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:53.925944 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f4007194-0110-4888-90c1-44eb1aa7c56a tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:53.926377 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f4007194-0110-4888-90c1-44eb1aa7c56a tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:54.060026 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f4007194-0110-4888-90c1-44eb1aa7c56a tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:02:54.072285 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f4007194-0110-4888-90c1-44eb1aa7c56a tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1555 microversion: 2.1 time: 0.164259 Jul 26 08:02:54.072960 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1225/2402] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:02:53 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:02:55.070657 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-ba24679a-9ce7-46d2-b576-9cdd5a2e2442 req-55eb85ef-b0c5-4637-b7e9-9834c88f5fe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89e691fe-7c7b-4ad8-8558-50ff1413e0f8", "name": "network-vif-deleted", "tag": "d40ebc80-aa04-4830-84fa-40a87398a8cd"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 08:02:55.080179 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-ba24679a-9ce7-46d2-b576-9cdd5a2e2442 req-55eb85ef-b0c5-4637-b7e9-9834c88f5fe6 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:55.080618 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-ba24679a-9ce7-46d2-b576-9cdd5a2e2442 req-55eb85ef-b0c5-4637-b7e9-9834c88f5fe6 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:55.093070 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-ba24679a-9ce7-46d2-b576-9cdd5a2e2442 req-55eb85ef-b0c5-4637-b7e9-9834c88f5fe6 service nova] Creating event network-vif-deleted:d40ebc80-aa04-4830-84fa-40a87398a8cd for instance 89e691fe-7c7b-4ad8-8558-50ff1413e0f8 on hv-cinder-85083 Jul 26 08:02:55.094761 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-432ba50d-be5d-4d21-8e90-68cd6be11a3a tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:02:55.095375 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-432ba50d-be5d-4d21-8e90-68cd6be11a3a tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:02:55.097987 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-ba24679a-9ce7-46d2-b576-9cdd5a2e2442 req-55eb85ef-b0c5-4637-b7e9-9834c88f5fe6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208042 Jul 26 08:02:55.098863 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1178/2403] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 08:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 08:02:55.102384 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-432ba50d-be5d-4d21-8e90-68cd6be11a3a tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:55.102821 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-432ba50d-be5d-4d21-8e90-68cd6be11a3a tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:55.103573 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-432ba50d-be5d-4d21-8e90-68cd6be11a3a tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:55.104005 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-432ba50d-be5d-4d21-8e90-68cd6be11a3a tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:55.133882 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-432ba50d-be5d-4d21-8e90-68cd6be11a3a tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:55.134326 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-432ba50d-be5d-4d21-8e90-68cd6be11a3a tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:55.134763 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.objects.instance [None req-432ba50d-be5d-4d21-8e90-68cd6be11a3a tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lazy-loading 'fault' on Instance uuid 89e691fe-7c7b-4ad8-8558-50ff1413e0f8 {{(pid=117715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 08:02:55.175998 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-432ba50d-be5d-4d21-8e90-68cd6be11a3a tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc6c885fee5440799beac8cfd3e42822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a46af50be774973800f747cdaf66896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:02:55.184115 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-432ba50d-be5d-4d21-8e90-68cd6be11a3a tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 200 len: 1349 microversion: 2.1 time: 0.093470 Jul 26 08:02:55.184730 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1226/2404] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:02:55 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 1349 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:02:56.211792 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8127697b-41f7-4a98-8875-443ba2aa50f1 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:02:56.212904 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8127697b-41f7-4a98-8875-443ba2aa50f1 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] [instance: 89e691fe-7c7b-4ad8-8558-50ff1413e0f8] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:02:56.223377 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8127697b-41f7-4a98-8875-443ba2aa50f1 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:56.224120 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8127697b-41f7-4a98-8875-443ba2aa50f1 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:56.225365 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8127697b-41f7-4a98-8875-443ba2aa50f1 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:02:56.226155 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8127697b-41f7-4a98-8875-443ba2aa50f1 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:02:56.242437 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.wsgi [None req-8127697b-41f7-4a98-8875-443ba2aa50f1 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] HTTP exception thrown: Instance 89e691fe-7c7b-4ad8-8558-50ff1413e0f8 could not be found. Jul 26 08:02:56.244075 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8127697b-41f7-4a98-8875-443ba2aa50f1 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Request method failure captured: Jul 26 08:02:56.244075 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: request: GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 HTTP/1.1 Jul 26 08:02:56.244075 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept: application/json Jul 26 08:02:56.244075 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept-Encoding: identity Jul 26 08:02:56.244075 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Connection: close Jul 26 08:02:56.244075 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Length: 0 Jul 26 08:02:56.244075 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Type: application/json Jul 26 08:02:56.244075 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Host: 10.222.0.39 Jul 26 08:02:56.244075 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Openstack-System-Scope: None Jul 26 08:02:56.244075 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: User-Agent: python-urllib3/1.26.10 Jul 26 08:02:56.244075 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Auth-Token: gAAAAABi358g7tnq_2F-5Cl4uOM-_RhPJbOqMI0gVSFLdLyLsSE6ObVFiJhRvoYWQRM1UY5KjKWvHtByNef2A8CmY7tF1c2-7UwWuce26VHHITQSQ_tQ_ynv2UIKfX3C4wjsSruhRqtCeTOhNk1c5-hijl5P3Df3kUgO441iUmAYsVgOyyMFWFQ Jul 26 08:02:56.244075 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Id: None Jul 26 08:02:56.244075 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Name: None Jul 26 08:02:56.244075 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Identity-Status: Confirmed Jul 26 08:02:56.244075 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Is-Admin-Project: True Jul 26 08:02:56.244075 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Id: default Jul 26 08:02:56.244075 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Name: Default Jul 26 08:02:56.244075 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Id: 8a46af50be774973800f747cdaf66896 Jul 26 08:02:56.244075 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Name: tempest-TestMinimumBasicScenario-458687075 Jul 26 08:02:56.244075 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Role: member,reader Jul 26 08:02:56.244075 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Roles: member,reader Jul 26 08:02:56.245302 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8a46af50be774973800f747cdaf66896"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8a46af50be774973800f747cdaf66896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8a46af50be774973800f747cdaf66896"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8a46af50be774973800f747cdaf66896"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 08:02:56.245302 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant: tempest-TestMinimumBasicScenario-458687075 Jul 26 08:02:56.245302 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Id: 8a46af50be774973800f747cdaf66896 Jul 26 08:02:56.245302 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Name: tempest-TestMinimumBasicScenario-458687075 Jul 26 08:02:56.245302 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User: tempest-TestMinimumBasicScenario-458687075-project Jul 26 08:02:56.245302 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Id: default Jul 26 08:02:56.245302 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Name: Default Jul 26 08:02:56.245302 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Id: dc6c885fee5440799beac8cfd3e42822 Jul 26 08:02:56.245302 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Name: tempest-TestMinimumBasicScenario-458687075-project Jul 26 08:02:56.245302 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: method: > Jul 26 08:02:56.245302 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: exception: Instance 89e691fe-7c7b-4ad8-8558-50ff1413e0f8 could not be found. Jul 26 08:02:56.245302 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: action_args: {'id': '89e691fe-7c7b-4ad8-8558-50ff1413e0f8'} Jul 26 08:02:56.246054 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 08:02:56.246054 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 08:02:56.246054 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 08:02:56.246054 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 08:02:56.246054 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 08:02:56.246054 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 08:02:56.246054 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 08:02:56.246054 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 08:02:56.246054 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 08:02:56.246054 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 08:02:56.246054 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89e691fe-7c7b-4ad8-8558-50ff1413e0f8 could not be found. Jul 26 08:02:56.246054 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 08:02:56.246054 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 08:02:56.246054 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 08:02:56.246054 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 08:02:56.246054 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 08:02:56.246054 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 08:02:56.246054 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 08:02:56.246054 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 08:02:56.246054 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 08:02:56.247295 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 08:02:56.247295 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 08:02:56.247295 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 08:02:56.247295 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 08:02:56.247295 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 08:02:56.247295 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 08:02:56.247295 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 08:02:56.247295 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89e691fe-7c7b-4ad8-8558-50ff1413e0f8 could not be found. Jul 26 08:02:56.247295 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 08:02:56.247295 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 08:02:56.247295 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 08:02:56.247295 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 08:02:56.247295 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 08:02:56.247295 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 08:02:56.247295 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 08:02:56.247295 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 08:02:56.247295 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89e691fe-7c7b-4ad8-8558-50ff1413e0f8 could not be found. Jul 26 08:02:56.247295 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 08:02:56.248339 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8127697b-41f7-4a98-8875-443ba2aa50f1 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Returning 404 to user: Instance 89e691fe-7c7b-4ad8-8558-50ff1413e0f8 could not be found. {{(pid=117716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 08:02:56.248339 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8127697b-41f7-4a98-8875-443ba2aa50f1 tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8" status: 404 len: 111 microversion: 2.1 time: 0.041483 Jul 26 08:02:56.249189 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1179/2405] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:02:56 2022] GET /compute/v2.1/servers/89e691fe-7c7b-4ad8-8558-50ff1413e0f8 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 08:02:56.254224 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6443a3d6-dec5-4855-bd79-f7fe6156b92e tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] Calling method '.version_select at 0x7f7f0260f9d0>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:02:56.276695 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6443a3d6-dec5-4855-bd79-f7fe6156b92e tempest-TestMinimumBasicScenario-458687075 tempest-TestMinimumBasicScenario-458687075-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1252635699" status: 202 len: 0 microversion: 2.1 time: 0.026344 Jul 26 08:02:56.277266 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1227/2406] 10.222.0.39 () {58 vars in 1272 bytes} [Tue Jul 26 08:02:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1252635699 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 08:03:13.931326 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=14 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:03:13.932154 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:03:14.126556 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-ea4999a5-26d5-4562-9a3c-f7dcd5c7ef8f tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Action: 'create', calling method: .version_select at 0x7f7f06f70af0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-241314831", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLu8E98Qc28YpT65s25h/9wNXvL+TocMOf4V927Kn392+YSXMB5VP99xVwiE47bW4fq5lSyjIdAZ8mvDhUdNrbqqBkW7i53P/4/DJRb5KEVRKCRG7CEHLBp7q+aQfMGokg=="}} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 08:03:14.144848 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.quota [None req-ea4999a5-26d5-4562-9a3c-f7dcd5c7ef8f tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Getting quotas for project 491378f17ebd4fddbf00a3b55a2d5b85. Resources: {'key_pairs'} {{(pid=117716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 08:03:14.149439 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.quota [None req-ea4999a5-26d5-4562-9a3c-f7dcd5c7ef8f tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Getting quotas for user 7881b5c6627d41eca68a27fc38559b2f and project 491378f17ebd4fddbf00a3b55a2d5b85. Resources: {'key_pairs'} {{(pid=117716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 08:03:14.176059 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-ea4999a5-26d5-4562-9a3c-f7dcd5c7ef8f tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.249722 Jul 26 08:03:14.177006 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1180/2407] 10.222.0.39 () {60 vars in 1159 bytes} [Tue Jul 26 08:03:13 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 08:03:30.514041 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:03:30.514795 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:03:30.518727 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-590674b1-f0f0-4aa8-a962-4e3e695a3295 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1945717408", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-241314831", "security_groups": [{"name": "tempest-secgroup-smoke-1386520737"}], "block_device_mapping_v2": [{"uuid": "5d720590-68aa-43bc-aa68-d1bdd3a0f7a5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "491ee5ad-5a2f-4f94-a50c-1bf651b747a4"}]}} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 08:03:30.632978 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.network.neutron [None req-590674b1-f0f0-4aa8-a962-4e3e695a3295 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] validate_networks() for [('491ee5ad-5a2f-4f94-a50c-1bf651b747a4', None, None, None, None, None)] {{(pid=117715) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 08:03:31.115233 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-590674b1-f0f0-4aa8-a962-4e3e695a3295 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Flavor limits 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 08:03:31.115657 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-590674b1-f0f0-4aa8-a962-4e3e695a3295 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Image limits 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 08:03:31.116131 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-590674b1-f0f0-4aa8-a962-4e3e695a3295 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Flavor pref 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 08:03:31.116535 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-590674b1-f0f0-4aa8-a962-4e3e695a3295 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Image pref 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 08:03:31.116941 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-590674b1-f0f0-4aa8-a962-4e3e695a3295 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 08:03:31.126926 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-590674b1-f0f0-4aa8-a962-4e3e695a3295 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:03:31.127368 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-590674b1-f0f0-4aa8-a962-4e3e695a3295 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:03:31.128151 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-590674b1-f0f0-4aa8-a962-4e3e695a3295 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:03:31.128587 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-590674b1-f0f0-4aa8-a962-4e3e695a3295 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:03:31.145367 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.quota [None req-590674b1-f0f0-4aa8-a962-4e3e695a3295 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Getting quotas for project 491378f17ebd4fddbf00a3b55a2d5b85. Resources: {'instances', 'cores', 'ram'} {{(pid=117715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 08:03:31.149492 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.quota [None req-590674b1-f0f0-4aa8-a962-4e3e695a3295 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Getting quotas for user 7881b5c6627d41eca68a27fc38559b2f and project 491378f17ebd4fddbf00a3b55a2d5b85. Resources: {'instances', 'cores', 'ram'} {{(pid=117715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 08:03:31.207412 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-590674b1-f0f0-4aa8-a962-4e3e695a3295 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Going to run 1 instances... {{(pid=117715) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 08:03:31.209534 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-590674b1-f0f0-4aa8-a962-4e3e695a3295 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: bb22026b-91d8-4ad6-9926-5f8bfecf5ba6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5d720590-68aa-43bc-aa68-d1bdd3a0f7a5',volume_size=None,volume_type=None)] {{(pid=117715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 08:03:31.352776 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-590674b1-f0f0-4aa8-a962-4e3e695a3295 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.840307 Jul 26 08:03:31.353418 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1228/2408] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Jul 26 08:03:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 08:03:31.365775 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c2e99e60-3f1e-4577-b964-ec56faec729f tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:03:31.366677 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c2e99e60-3f1e-4577-b964-ec56faec729f tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: bb22026b-91d8-4ad6-9926-5f8bfecf5ba6] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:03:31.370760 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell0:SELECT=4 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:03:31.371463 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:03:31.430316 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-c2e99e60-3f1e-4577-b964-ec56faec729f tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:03:31.437075 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c2e99e60-3f1e-4577-b964-ec56faec729f tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6" status: 200 len: 1094 microversion: 2.1 time: 0.076614 Jul 26 08:03:31.437673 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1181/2409] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:03:31 2022] GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:03:32.458752 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-1b72624c-6d85-428a-ab60-aaf5c83d927b tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:03:32.459646 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-1b72624c-6d85-428a-ab60-aaf5c83d927b tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: bb22026b-91d8-4ad6-9926-5f8bfecf5ba6] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:03:32.467095 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1b72624c-6d85-428a-ab60-aaf5c83d927b tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:03:32.467535 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1b72624c-6d85-428a-ab60-aaf5c83d927b tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:03:32.468371 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1b72624c-6d85-428a-ab60-aaf5c83d927b tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:03:32.468814 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-1b72624c-6d85-428a-ab60-aaf5c83d927b tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:03:32.545591 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-1b72624c-6d85-428a-ab60-aaf5c83d927b tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:03:32.554531 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-1b72624c-6d85-428a-ab60-aaf5c83d927b tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6" status: 200 len: 1200 microversion: 2.1 time: 0.100235 Jul 26 08:03:32.555100 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1229/2410] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:03:32 2022] GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 => generated 1200 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:03:33.576391 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-eec03fd0-ab62-4113-9deb-170a0809f972 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:03:33.576916 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-eec03fd0-ab62-4113-9deb-170a0809f972 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: bb22026b-91d8-4ad6-9926-5f8bfecf5ba6] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:03:33.584012 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-eec03fd0-ab62-4113-9deb-170a0809f972 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:03:33.584440 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-eec03fd0-ab62-4113-9deb-170a0809f972 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:03:33.585203 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-eec03fd0-ab62-4113-9deb-170a0809f972 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:03:33.585630 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-eec03fd0-ab62-4113-9deb-170a0809f972 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:03:33.719574 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-eec03fd0-ab62-4113-9deb-170a0809f972 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:03:33.727216 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-eec03fd0-ab62-4113-9deb-170a0809f972 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6" status: 200 len: 1266 microversion: 2.1 time: 0.154791 Jul 26 08:03:33.727886 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1182/2411] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:03:33 2022] GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:03:33.995188 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-34f1fcff-de5f-4254-82e1-2d6a4933af6e req-450bd623-0daf-4eb1-83bd-5fc0865f3ce3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb22026b-91d8-4ad6-9926-5f8bfecf5ba6", "tag": "21d8a0d4-07b2-4e6f-93b0-15aa57334684"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 08:03:34.007886 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-34f1fcff-de5f-4254-82e1-2d6a4933af6e req-450bd623-0daf-4eb1-83bd-5fc0865f3ce3 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:03:34.008560 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-34f1fcff-de5f-4254-82e1-2d6a4933af6e req-450bd623-0daf-4eb1-83bd-5fc0865f3ce3 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:03:34.020838 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-34f1fcff-de5f-4254-82e1-2d6a4933af6e req-450bd623-0daf-4eb1-83bd-5fc0865f3ce3 service nova] Creating event network-changed:21d8a0d4-07b2-4e6f-93b0-15aa57334684 for instance bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 on hv-cinder-85083 Jul 26 08:03:34.026846 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-34f1fcff-de5f-4254-82e1-2d6a4933af6e req-450bd623-0daf-4eb1-83bd-5fc0865f3ce3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035404 Jul 26 08:03:34.027371 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1230/2412] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 08:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 08:03:34.749603 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-7457fc20-70e7-4b89-909b-fc0a3054651c tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:03:34.750192 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-7457fc20-70e7-4b89-909b-fc0a3054651c tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: bb22026b-91d8-4ad6-9926-5f8bfecf5ba6] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:03:34.757174 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7457fc20-70e7-4b89-909b-fc0a3054651c tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:03:34.757619 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7457fc20-70e7-4b89-909b-fc0a3054651c tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:03:34.758431 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7457fc20-70e7-4b89-909b-fc0a3054651c tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:03:34.758863 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-7457fc20-70e7-4b89-909b-fc0a3054651c tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:03:34.886876 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-7457fc20-70e7-4b89-909b-fc0a3054651c tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:03:34.894535 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-7457fc20-70e7-4b89-909b-fc0a3054651c tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6" status: 200 len: 1266 microversion: 2.1 time: 0.148920 Jul 26 08:03:34.895094 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1183/2413] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:03:34 2022] GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:03:35.921283 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e1c5106b-65ca-461f-8c01-ebe800969686 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:03:35.922469 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e1c5106b-65ca-461f-8c01-ebe800969686 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: bb22026b-91d8-4ad6-9926-5f8bfecf5ba6] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:03:35.931142 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e1c5106b-65ca-461f-8c01-ebe800969686 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:03:35.931585 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e1c5106b-65ca-461f-8c01-ebe800969686 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:03:35.932339 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e1c5106b-65ca-461f-8c01-ebe800969686 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:03:35.932768 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e1c5106b-65ca-461f-8c01-ebe800969686 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:03:36.075888 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-e1c5106b-65ca-461f-8c01-ebe800969686 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:03:36.083423 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e1c5106b-65ca-461f-8c01-ebe800969686 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6" status: 200 len: 1266 microversion: 2.1 time: 0.170132 Jul 26 08:03:36.084047 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1231/2414] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:03:35 2022] GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:03:37.110488 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-64d2bc14-08b0-4f32-a6e7-b84cbbd2e0c3 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:03:37.111076 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-64d2bc14-08b0-4f32-a6e7-b84cbbd2e0c3 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: bb22026b-91d8-4ad6-9926-5f8bfecf5ba6] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:03:37.117932 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-64d2bc14-08b0-4f32-a6e7-b84cbbd2e0c3 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:03:37.118383 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-64d2bc14-08b0-4f32-a6e7-b84cbbd2e0c3 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:03:37.119135 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-64d2bc14-08b0-4f32-a6e7-b84cbbd2e0c3 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:03:37.119566 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-64d2bc14-08b0-4f32-a6e7-b84cbbd2e0c3 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:03:37.263002 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-64d2bc14-08b0-4f32-a6e7-b84cbbd2e0c3 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:03:37.273895 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-64d2bc14-08b0-4f32-a6e7-b84cbbd2e0c3 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6" status: 200 len: 1266 microversion: 2.1 time: 0.167357 Jul 26 08:03:37.274454 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1184/2415] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:03:37 2022] GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:03:38.299192 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-5a0c730d-8e81-4d82-a585-14ef28266c4a tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:03:38.301051 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-5a0c730d-8e81-4d82-a585-14ef28266c4a tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: bb22026b-91d8-4ad6-9926-5f8bfecf5ba6] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:03:38.308636 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5a0c730d-8e81-4d82-a585-14ef28266c4a tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:03:38.309089 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5a0c730d-8e81-4d82-a585-14ef28266c4a tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:03:38.309890 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5a0c730d-8e81-4d82-a585-14ef28266c4a tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:03:38.310324 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-5a0c730d-8e81-4d82-a585-14ef28266c4a tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:03:38.450352 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-5a0c730d-8e81-4d82-a585-14ef28266c4a tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:03:38.457980 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-5a0c730d-8e81-4d82-a585-14ef28266c4a tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6" status: 200 len: 1266 microversion: 2.1 time: 0.165579 Jul 26 08:03:38.458545 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1232/2416] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:03:38 2022] GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:03:39.481630 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b721b097-1445-4477-82ec-b916301211ec tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:03:39.482561 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-b721b097-1445-4477-82ec-b916301211ec tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: bb22026b-91d8-4ad6-9926-5f8bfecf5ba6] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:03:39.491592 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b721b097-1445-4477-82ec-b916301211ec tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:03:39.492036 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b721b097-1445-4477-82ec-b916301211ec tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:03:39.492786 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b721b097-1445-4477-82ec-b916301211ec tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:03:39.493217 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b721b097-1445-4477-82ec-b916301211ec tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:03:39.633908 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-b721b097-1445-4477-82ec-b916301211ec tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:03:39.641944 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b721b097-1445-4477-82ec-b916301211ec tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6" status: 200 len: 1266 microversion: 2.1 time: 0.165809 Jul 26 08:03:39.642494 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1185/2417] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:03:39 2022] GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:03:40.663538 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-86a6db15-8779-4c97-b40d-442a0d20567c tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:03:40.664135 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-86a6db15-8779-4c97-b40d-442a0d20567c tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: bb22026b-91d8-4ad6-9926-5f8bfecf5ba6] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:03:40.671130 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-86a6db15-8779-4c97-b40d-442a0d20567c tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:03:40.671575 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-86a6db15-8779-4c97-b40d-442a0d20567c tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:03:40.672328 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-86a6db15-8779-4c97-b40d-442a0d20567c tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:03:40.672742 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-86a6db15-8779-4c97-b40d-442a0d20567c tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:03:40.808151 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-86a6db15-8779-4c97-b40d-442a0d20567c tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:03:40.816018 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-86a6db15-8779-4c97-b40d-442a0d20567c tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6" status: 200 len: 1266 microversion: 2.1 time: 0.156579 Jul 26 08:03:40.816591 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1233/2418] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:03:40 2022] GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:03:41.838452 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6495518d-9e01-40d3-8681-3fb2825fcb35 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:03:41.839088 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6495518d-9e01-40d3-8681-3fb2825fcb35 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: bb22026b-91d8-4ad6-9926-5f8bfecf5ba6] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:03:41.841562 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell0:SELECT=2 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:03:41.847350 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6495518d-9e01-40d3-8681-3fb2825fcb35 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:03:41.847817 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6495518d-9e01-40d3-8681-3fb2825fcb35 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:03:41.848607 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6495518d-9e01-40d3-8681-3fb2825fcb35 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:03:41.849059 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6495518d-9e01-40d3-8681-3fb2825fcb35 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:03:41.988079 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6495518d-9e01-40d3-8681-3fb2825fcb35 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:03:41.996240 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6495518d-9e01-40d3-8681-3fb2825fcb35 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6" status: 200 len: 1266 microversion: 2.1 time: 0.161905 Jul 26 08:03:41.996818 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1186/2419] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:03:41 2022] GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:03:43.016744 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-955eb1c1-1dbb-4ce5-a378-2f711f41aa60 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:03:43.017304 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-955eb1c1-1dbb-4ce5-a378-2f711f41aa60 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: bb22026b-91d8-4ad6-9926-5f8bfecf5ba6] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:03:43.019338 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell0:SELECT=2 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:03:43.020390 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell0:SELECT=6 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:03:43.027089 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-955eb1c1-1dbb-4ce5-a378-2f711f41aa60 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:03:43.027496 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-955eb1c1-1dbb-4ce5-a378-2f711f41aa60 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:03:43.028246 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-955eb1c1-1dbb-4ce5-a378-2f711f41aa60 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:03:43.028665 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-955eb1c1-1dbb-4ce5-a378-2f711f41aa60 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:03:43.161137 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-955eb1c1-1dbb-4ce5-a378-2f711f41aa60 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:03:43.168725 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-955eb1c1-1dbb-4ce5-a378-2f711f41aa60 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6" status: 200 len: 1266 microversion: 2.1 time: 0.155903 Jul 26 08:03:43.169266 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1234/2420] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:03:43 2022] GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:03:44.193447 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-212bbb2a-874b-4793-84ea-6f6f4c8863c8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:03:44.194735 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-212bbb2a-874b-4793-84ea-6f6f4c8863c8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: bb22026b-91d8-4ad6-9926-5f8bfecf5ba6] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:03:44.205990 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-212bbb2a-874b-4793-84ea-6f6f4c8863c8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:03:44.206763 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-212bbb2a-874b-4793-84ea-6f6f4c8863c8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:03:44.207998 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-212bbb2a-874b-4793-84ea-6f6f4c8863c8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:03:44.208708 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-212bbb2a-874b-4793-84ea-6f6f4c8863c8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:03:44.343244 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-212bbb2a-874b-4793-84ea-6f6f4c8863c8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:03:44.350862 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-212bbb2a-874b-4793-84ea-6f6f4c8863c8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6" status: 200 len: 1266 microversion: 2.1 time: 0.163723 Jul 26 08:03:44.351424 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1187/2421] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:03:44 2022] GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:03:44.846060 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-bc1d09dd-ccd3-480b-bbc8-61322ec22300 req-6777b7a0-8909-4f8b-946d-50f6f5a1a298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb22026b-91d8-4ad6-9926-5f8bfecf5ba6", "name": "network-vif-plugged", "status": "completed", "tag": "21d8a0d4-07b2-4e6f-93b0-15aa57334684"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 08:03:44.856316 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-bc1d09dd-ccd3-480b-bbc8-61322ec22300 req-6777b7a0-8909-4f8b-946d-50f6f5a1a298 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:03:44.856763 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-bc1d09dd-ccd3-480b-bbc8-61322ec22300 req-6777b7a0-8909-4f8b-946d-50f6f5a1a298 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:03:44.868343 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-bc1d09dd-ccd3-480b-bbc8-61322ec22300 req-6777b7a0-8909-4f8b-946d-50f6f5a1a298 service nova] Creating event network-vif-plugged:21d8a0d4-07b2-4e6f-93b0-15aa57334684 for instance bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 on hv-cinder-85083 Jul 26 08:03:44.873303 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-bc1d09dd-ccd3-480b-bbc8-61322ec22300 req-6777b7a0-8909-4f8b-946d-50f6f5a1a298 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031019 Jul 26 08:03:44.873935 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1235/2422] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 08:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 08:03:45.372913 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-fc0aee5f-9eb9-4b53-9470-1966909ea865 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:03:45.373455 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-fc0aee5f-9eb9-4b53-9470-1966909ea865 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: bb22026b-91d8-4ad6-9926-5f8bfecf5ba6] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:03:45.380494 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fc0aee5f-9eb9-4b53-9470-1966909ea865 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:03:45.381048 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fc0aee5f-9eb9-4b53-9470-1966909ea865 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:03:45.381844 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fc0aee5f-9eb9-4b53-9470-1966909ea865 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:03:45.382283 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fc0aee5f-9eb9-4b53-9470-1966909ea865 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:03:45.514905 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-fc0aee5f-9eb9-4b53-9470-1966909ea865 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:03:45.525028 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-fc0aee5f-9eb9-4b53-9470-1966909ea865 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6" status: 200 len: 1266 microversion: 2.1 time: 0.156164 Jul 26 08:03:45.525594 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1188/2423] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:03:45 2022] GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:03:46.547028 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-31b2f664-9916-4f35-bb4d-5784a068f0d8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:03:46.547753 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-31b2f664-9916-4f35-bb4d-5784a068f0d8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: bb22026b-91d8-4ad6-9926-5f8bfecf5ba6] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:03:46.554636 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-31b2f664-9916-4f35-bb4d-5784a068f0d8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:03:46.555085 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-31b2f664-9916-4f35-bb4d-5784a068f0d8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:03:46.555838 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-31b2f664-9916-4f35-bb4d-5784a068f0d8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:03:46.556269 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-31b2f664-9916-4f35-bb4d-5784a068f0d8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:03:46.703452 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-31b2f664-9916-4f35-bb4d-5784a068f0d8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:03:46.713833 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-31b2f664-9916-4f35-bb4d-5784a068f0d8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6" status: 200 len: 1452 microversion: 2.1 time: 0.171582 Jul 26 08:03:46.714530 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1236/2424] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:03:46 2022] GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 => generated 1452 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:03:46.734124 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b0a175a2-7388-49de-b4bd-ea68db72b956 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:03:46.734688 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-b0a175a2-7388-49de-b4bd-ea68db72b956 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: bb22026b-91d8-4ad6-9926-5f8bfecf5ba6] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:03:46.741310 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b0a175a2-7388-49de-b4bd-ea68db72b956 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:03:46.741772 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b0a175a2-7388-49de-b4bd-ea68db72b956 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:03:46.742535 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b0a175a2-7388-49de-b4bd-ea68db72b956 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:03:46.742976 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b0a175a2-7388-49de-b4bd-ea68db72b956 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:03:46.884744 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-b0a175a2-7388-49de-b4bd-ea68db72b956 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:03:46.894346 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b0a175a2-7388-49de-b4bd-ea68db72b956 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6" status: 200 len: 1452 microversion: 2.1 time: 0.163859 Jul 26 08:03:46.895085 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1189/2425] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:03:46 2022] GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:03:48.562638 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-779dd9c8-d710-418f-a0b9-81c8ef2b03fe req-17feca02-18dc-4038-9876-23e25814cc5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb22026b-91d8-4ad6-9926-5f8bfecf5ba6", "tag": "21d8a0d4-07b2-4e6f-93b0-15aa57334684"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 08:03:48.572752 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-779dd9c8-d710-418f-a0b9-81c8ef2b03fe req-17feca02-18dc-4038-9876-23e25814cc5c service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:03:48.573187 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-779dd9c8-d710-418f-a0b9-81c8ef2b03fe req-17feca02-18dc-4038-9876-23e25814cc5c service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:03:48.584323 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-779dd9c8-d710-418f-a0b9-81c8ef2b03fe req-17feca02-18dc-4038-9876-23e25814cc5c service nova] Creating event network-changed:21d8a0d4-07b2-4e6f-93b0-15aa57334684 for instance bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 on hv-cinder-85083 Jul 26 08:03:48.589656 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-779dd9c8-d710-418f-a0b9-81c8ef2b03fe req-17feca02-18dc-4038-9876-23e25814cc5c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030827 Jul 26 08:03:48.590275 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1237/2426] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 08:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 08:05:30.379511 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 08:05:30.380327 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Tue Jul 26 08:05:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 08:05:37.732166 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 08:05:37.733199 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Tue Jul 26 08:05:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 08:05:38.045137 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 08:05:38.046010 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Tue Jul 26 08:05:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 08:05:41.256563 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9dc8bbe6-3d82-4f6a-b753-d62839cd5a52] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 08:05:41.258132 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=20 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:05:41.259569 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=48 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:05:41.265632 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-903ce964-afd2-4461-8bc6-1a7955292cfb tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:05:41.266560 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-903ce964-afd2-4461-8bc6-1a7955292cfb tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: bb22026b-91d8-4ad6-9926-5f8bfecf5ba6] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:05:41.275582 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-903ce964-afd2-4461-8bc6-1a7955292cfb tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:05:41.276029 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-903ce964-afd2-4461-8bc6-1a7955292cfb tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:05:41.276787 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-903ce964-afd2-4461-8bc6-1a7955292cfb tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:05:41.277220 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-903ce964-afd2-4461-8bc6-1a7955292cfb tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:05:41.302187 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-903ce964-afd2-4461-8bc6-1a7955292cfb tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: bb22026b-91d8-4ad6-9926-5f8bfecf5ba6] Going to try to terminate instance {{(pid=117716) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 08:05:41.361545 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR oslo.messaging._drivers.impl_rabbit [None req-903ce964-afd2-4461-8bc6-1a7955292cfb tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [715afd05-a23d-48ea-9c69-7b252d372532] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 08:05:42.269955 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO oslo.messaging._drivers.impl_rabbit [-] [9dc8bbe6-3d82-4f6a-b753-d62839cd5a52] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 60628. Jul 26 08:05:42.372185 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO oslo.messaging._drivers.impl_rabbit [None req-903ce964-afd2-4461-8bc6-1a7955292cfb tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [715afd05-a23d-48ea-9c69-7b252d372532] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 60630. Jul 26 08:05:42.398478 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-903ce964-afd2-4461-8bc6-1a7955292cfb tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "DELETE /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6" status: 204 len: 0 microversion: 2.1 time: 1.145663 Jul 26 08:05:42.399145 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1190/2427] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Jul 26 08:05:41 2022] DELETE /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 => generated 0 bytes in 1147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 08:05:42.405938 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:05:42.406699 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=44 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:05:42.411431 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-d60c7da5-ad71-4aca-88a5-27fe617d8ded tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:05:42.412242 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-d60c7da5-ad71-4aca-88a5-27fe617d8ded tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: bb22026b-91d8-4ad6-9926-5f8bfecf5ba6] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:05:42.420403 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d60c7da5-ad71-4aca-88a5-27fe617d8ded tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:05:42.420830 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d60c7da5-ad71-4aca-88a5-27fe617d8ded tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:05:42.421571 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d60c7da5-ad71-4aca-88a5-27fe617d8ded tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:05:42.422039 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-d60c7da5-ad71-4aca-88a5-27fe617d8ded tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:05:42.560659 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-d60c7da5-ad71-4aca-88a5-27fe617d8ded tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:05:42.572846 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-d60c7da5-ad71-4aca-88a5-27fe617d8ded tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6" status: 200 len: 1577 microversion: 2.1 time: 0.168884 Jul 26 08:05:42.573615 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1238/2428] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:05:42 2022] GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 08:05:43.598124 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-10b846ae-9947-4282-abf5-2020052c52e8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:05:43.598826 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-10b846ae-9947-4282-abf5-2020052c52e8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: bb22026b-91d8-4ad6-9926-5f8bfecf5ba6] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:05:43.608738 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-10b846ae-9947-4282-abf5-2020052c52e8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:05:43.609188 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-10b846ae-9947-4282-abf5-2020052c52e8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:05:43.610216 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-10b846ae-9947-4282-abf5-2020052c52e8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:05:43.610756 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-10b846ae-9947-4282-abf5-2020052c52e8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:05:43.743457 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-10b846ae-9947-4282-abf5-2020052c52e8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:05:43.750991 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-10b846ae-9947-4282-abf5-2020052c52e8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6" status: 200 len: 1577 microversion: 2.1 time: 0.159620 Jul 26 08:05:43.751544 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1191/2429] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:05:43 2022] GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:05:44.730137 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-161fa0fb-abe3-40dd-993d-1bae6bfb9560 req-aeebb532-d267-4076-881f-0e1357154310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb22026b-91d8-4ad6-9926-5f8bfecf5ba6", "name": "network-vif-deleted", "tag": "21d8a0d4-07b2-4e6f-93b0-15aa57334684"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 08:05:44.740278 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-161fa0fb-abe3-40dd-993d-1bae6bfb9560 req-aeebb532-d267-4076-881f-0e1357154310 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:05:44.740713 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-161fa0fb-abe3-40dd-993d-1bae6bfb9560 req-aeebb532-d267-4076-881f-0e1357154310 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:05:44.752431 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-161fa0fb-abe3-40dd-993d-1bae6bfb9560 req-aeebb532-d267-4076-881f-0e1357154310 service nova] Creating event network-vif-deleted:21d8a0d4-07b2-4e6f-93b0-15aa57334684 for instance bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 on hv-cinder-85083 Jul 26 08:05:44.758247 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-161fa0fb-abe3-40dd-993d-1bae6bfb9560 req-aeebb532-d267-4076-881f-0e1357154310 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031627 Jul 26 08:05:44.758867 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1239/2430] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 08:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 08:05:44.772282 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d9d88d09-5564-49fe-9cc6-a07ff5635424 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:05:44.773957 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d9d88d09-5564-49fe-9cc6-a07ff5635424 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: bb22026b-91d8-4ad6-9926-5f8bfecf5ba6] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:05:44.784538 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d9d88d09-5564-49fe-9cc6-a07ff5635424 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:05:44.785432 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d9d88d09-5564-49fe-9cc6-a07ff5635424 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:05:44.786516 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d9d88d09-5564-49fe-9cc6-a07ff5635424 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:05:44.787248 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d9d88d09-5564-49fe-9cc6-a07ff5635424 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:05:44.858567 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d9d88d09-5564-49fe-9cc6-a07ff5635424 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:05:44.866425 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d9d88d09-5564-49fe-9cc6-a07ff5635424 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6" status: 200 len: 1225 microversion: 2.1 time: 0.098490 Jul 26 08:05:44.867004 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1192/2431] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:05:44 2022] GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:05:45.893133 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-633efeea-9f35-4938-a00c-77687aa4ffda tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:05:45.894178 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-633efeea-9f35-4938-a00c-77687aa4ffda tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: bb22026b-91d8-4ad6-9926-5f8bfecf5ba6] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:05:45.902551 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-633efeea-9f35-4938-a00c-77687aa4ffda tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:05:45.902640 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-633efeea-9f35-4938-a00c-77687aa4ffda tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:05:45.903442 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-633efeea-9f35-4938-a00c-77687aa4ffda tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:05:45.903869 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-633efeea-9f35-4938-a00c-77687aa4ffda tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:05:45.917667 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.wsgi [None req-633efeea-9f35-4938-a00c-77687aa4ffda tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] HTTP exception thrown: Instance bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 could not be found. Jul 26 08:05:45.919315 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-633efeea-9f35-4938-a00c-77687aa4ffda tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Request method failure captured: Jul 26 08:05:45.919315 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: request: GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 HTTP/1.1 Jul 26 08:05:45.919315 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept: application/json Jul 26 08:05:45.919315 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept-Encoding: identity Jul 26 08:05:45.919315 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Connection: close Jul 26 08:05:45.919315 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Length: 0 Jul 26 08:05:45.919315 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Type: application/json Jul 26 08:05:45.919315 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Host: 10.222.0.39 Jul 26 08:05:45.919315 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Openstack-System-Scope: None Jul 26 08:05:45.919315 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: User-Agent: python-urllib3/1.26.10 Jul 26 08:05:45.919315 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Auth-Token: gAAAAABi35-8j0JWLkrKLHPn1kUDvNisSciWAEnvsJwzysecRTk3h8u2GZGNwtQneOQTYv1MoFaY_kinw0ggx2ZWxAsMd4DWG4z5p_n2rYTwTNUi1B_DBdImFU2fBjVNpIfwhJKvvNucakKZQIBz0XYXbekWHd9w4yacS8SoS8LoYRp6ju7oVWY Jul 26 08:05:45.919315 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Id: None Jul 26 08:05:45.919315 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Name: None Jul 26 08:05:45.919315 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Identity-Status: Confirmed Jul 26 08:05:45.919315 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Is-Admin-Project: True Jul 26 08:05:45.919315 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Id: default Jul 26 08:05:45.919315 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Name: Default Jul 26 08:05:45.919315 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Id: 491378f17ebd4fddbf00a3b55a2d5b85 Jul 26 08:05:45.919315 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Name: tempest-TestVolumeBootPattern-1693328640 Jul 26 08:05:45.919315 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Role: member,reader Jul 26 08:05:45.919315 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Roles: member,reader Jul 26 08:05:45.920653 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/491378f17ebd4fddbf00a3b55a2d5b85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_491378f17ebd4fddbf00a3b55a2d5b85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/491378f17ebd4fddbf00a3b55a2d5b85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/491378f17ebd4fddbf00a3b55a2d5b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 08:05:45.920653 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant: tempest-TestVolumeBootPattern-1693328640 Jul 26 08:05:45.920653 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Id: 491378f17ebd4fddbf00a3b55a2d5b85 Jul 26 08:05:45.920653 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Name: tempest-TestVolumeBootPattern-1693328640 Jul 26 08:05:45.920653 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User: tempest-TestVolumeBootPattern-1693328640-project Jul 26 08:05:45.920653 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Id: default Jul 26 08:05:45.920653 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Name: Default Jul 26 08:05:45.920653 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Id: 7881b5c6627d41eca68a27fc38559b2f Jul 26 08:05:45.920653 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Name: tempest-TestVolumeBootPattern-1693328640-project Jul 26 08:05:45.920653 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: method: > Jul 26 08:05:45.920653 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: exception: Instance bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 could not be found. Jul 26 08:05:45.920653 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: action_args: {'id': 'bb22026b-91d8-4ad6-9926-5f8bfecf5ba6'} Jul 26 08:05:45.921293 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 08:05:45.921293 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 08:05:45.921293 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 08:05:45.921293 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 08:05:45.921293 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 08:05:45.921293 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 08:05:45.921293 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 08:05:45.921293 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 08:05:45.921293 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 08:05:45.921293 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 08:05:45.921293 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 could not be found. Jul 26 08:05:45.921293 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 08:05:45.921293 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 08:05:45.921293 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 08:05:45.921293 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 08:05:45.921293 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 08:05:45.921293 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 08:05:45.921293 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 08:05:45.921293 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 08:05:45.921293 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 08:05:45.922547 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 08:05:45.922547 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 08:05:45.922547 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 08:05:45.922547 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 08:05:45.922547 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 08:05:45.922547 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 08:05:45.922547 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 08:05:45.922547 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 could not be found. Jul 26 08:05:45.922547 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 08:05:45.922547 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 08:05:45.922547 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 08:05:45.922547 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 08:05:45.922547 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 08:05:45.922547 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 08:05:45.922547 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 08:05:45.922547 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 08:05:45.922547 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 could not be found. Jul 26 08:05:45.922547 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 08:05:45.923743 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-633efeea-9f35-4938-a00c-77687aa4ffda tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Returning 404 to user: Instance bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 could not be found. {{(pid=117715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 08:05:45.923743 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-633efeea-9f35-4938-a00c-77687aa4ffda tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6" status: 404 len: 111 microversion: 2.1 time: 0.035537 Jul 26 08:05:45.923743 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1240/2432] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:05:45 2022] GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 08:05:45.984229 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6b9c178e-5416-43b0-a353-631afa728cec tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-829329713", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-241314831", "security_groups": [{"name": "tempest-secgroup-smoke-1386520737"}], "block_device_mapping_v2": [{"uuid": "5d720590-68aa-43bc-aa68-d1bdd3a0f7a5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "491ee5ad-5a2f-4f94-a50c-1bf651b747a4"}]}} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 08:05:46.110878 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.network.neutron [None req-6b9c178e-5416-43b0-a353-631afa728cec tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] validate_networks() for [('491ee5ad-5a2f-4f94-a50c-1bf651b747a4', None, None, None, None, None)] {{(pid=117716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 08:05:46.547627 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-6b9c178e-5416-43b0-a353-631afa728cec tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Flavor limits 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 08:05:46.548020 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-6b9c178e-5416-43b0-a353-631afa728cec tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Image limits 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 08:05:46.548493 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-6b9c178e-5416-43b0-a353-631afa728cec tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Flavor pref 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 08:05:46.548896 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-6b9c178e-5416-43b0-a353-631afa728cec tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Image pref 0:0:0 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 08:05:46.549304 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.virt.hardware [None req-6b9c178e-5416-43b0-a353-631afa728cec tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 08:05:46.558717 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6b9c178e-5416-43b0-a353-631afa728cec tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:05:46.559161 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6b9c178e-5416-43b0-a353-631afa728cec tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:05:46.559949 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6b9c178e-5416-43b0-a353-631afa728cec tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:05:46.560379 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6b9c178e-5416-43b0-a353-631afa728cec tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:05:46.578277 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.quota [None req-6b9c178e-5416-43b0-a353-631afa728cec tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Getting quotas for project 491378f17ebd4fddbf00a3b55a2d5b85. Resources: {'instances', 'cores', 'ram'} {{(pid=117716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 08:05:46.582899 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.quota [None req-6b9c178e-5416-43b0-a353-631afa728cec tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Getting quotas for user 7881b5c6627d41eca68a27fc38559b2f and project 491378f17ebd4fddbf00a3b55a2d5b85. Resources: {'instances', 'cores', 'ram'} {{(pid=117716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 08:05:46.644579 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6b9c178e-5416-43b0-a353-631afa728cec tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Going to run 1 instances... {{(pid=117716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 08:05:46.646827 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6b9c178e-5416-43b0-a353-631afa728cec tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: 1d113a2e-cf60-4d21-92e6-992d10f072da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5d720590-68aa-43bc-aa68-d1bdd3a0f7a5',volume_size=None,volume_type=None)] {{(pid=117716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 08:05:46.777184 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6b9c178e-5416-43b0-a353-631afa728cec tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [6e3e531a-81c0-47d5-a456-17e3b56e0a1e] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 08:05:47.788906 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO oslo.messaging._drivers.impl_rabbit [None req-6b9c178e-5416-43b0-a353-631afa728cec tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [6e3e531a-81c0-47d5-a456-17e3b56e0a1e] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 60670. Jul 26 08:05:47.793449 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6b9c178e-5416-43b0-a353-631afa728cec tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.815635 Jul 26 08:05:47.794331 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1193/2433] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Jul 26 08:05:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 1817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 08:05:47.805256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-1cec3f05-b06f-4fe3-b329-23fc1baa7177 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:05:47.805893 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-1cec3f05-b06f-4fe3-b329-23fc1baa7177 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: 1d113a2e-cf60-4d21-92e6-992d10f072da] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:05:47.864573 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-1cec3f05-b06f-4fe3-b329-23fc1baa7177 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:05:47.872451 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-1cec3f05-b06f-4fe3-b329-23fc1baa7177 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da" status: 200 len: 1093 microversion: 2.1 time: 0.071106 Jul 26 08:05:47.873042 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1241/2434] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:05:47 2022] GET /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:05:48.893916 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-4337a5ff-1411-43ef-8a15-685d6759f0c5 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:05:48.895275 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-4337a5ff-1411-43ef-8a15-685d6759f0c5 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: 1d113a2e-cf60-4d21-92e6-992d10f072da] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:05:48.901825 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4337a5ff-1411-43ef-8a15-685d6759f0c5 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:05:48.902349 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4337a5ff-1411-43ef-8a15-685d6759f0c5 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:05:48.903239 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4337a5ff-1411-43ef-8a15-685d6759f0c5 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:05:48.903753 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-4337a5ff-1411-43ef-8a15-685d6759f0c5 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:05:49.224932 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-4337a5ff-1411-43ef-8a15-685d6759f0c5 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:05:49.233654 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-4337a5ff-1411-43ef-8a15-685d6759f0c5 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da" status: 200 len: 1209 microversion: 2.1 time: 0.344791 Jul 26 08:05:49.234397 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1194/2435] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:05:48 2022] GET /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da => generated 1209 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:05:50.105307 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-c0890668-ff71-4aa1-8ca0-745ef4b37b47 req-6658404d-b8ba-42cd-93ad-8dabe1d1fdb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d113a2e-cf60-4d21-92e6-992d10f072da", "tag": "c20e3ee5-16d8-4888-a4ca-e2d740d927cd"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 08:05:50.115322 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-c0890668-ff71-4aa1-8ca0-745ef4b37b47 req-6658404d-b8ba-42cd-93ad-8dabe1d1fdb2 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:05:50.116241 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-c0890668-ff71-4aa1-8ca0-745ef4b37b47 req-6658404d-b8ba-42cd-93ad-8dabe1d1fdb2 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:05:50.127917 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-c0890668-ff71-4aa1-8ca0-745ef4b37b47 req-6658404d-b8ba-42cd-93ad-8dabe1d1fdb2 service nova] Creating event network-changed:c20e3ee5-16d8-4888-a4ca-e2d740d927cd for instance 1d113a2e-cf60-4d21-92e6-992d10f072da on hv-cinder-85083 Jul 26 08:05:50.133643 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-c0890668-ff71-4aa1-8ca0-745ef4b37b47 req-6658404d-b8ba-42cd-93ad-8dabe1d1fdb2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031881 Jul 26 08:05:50.134585 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1242/2436] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 08:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 08:05:50.255140 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-b421d1f6-301e-4ef4-bd63-0d0f51251589 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:05:50.255748 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-b421d1f6-301e-4ef4-bd63-0d0f51251589 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: 1d113a2e-cf60-4d21-92e6-992d10f072da] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:05:50.262944 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b421d1f6-301e-4ef4-bd63-0d0f51251589 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:05:50.263401 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b421d1f6-301e-4ef4-bd63-0d0f51251589 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:05:50.264238 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b421d1f6-301e-4ef4-bd63-0d0f51251589 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:05:50.264625 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-b421d1f6-301e-4ef4-bd63-0d0f51251589 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:05:50.419987 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-b421d1f6-301e-4ef4-bd63-0d0f51251589 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:05:50.428287 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-b421d1f6-301e-4ef4-bd63-0d0f51251589 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da" status: 200 len: 1265 microversion: 2.1 time: 0.177008 Jul 26 08:05:50.429185 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1195/2437] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:05:50 2022] GET /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:05:51.451585 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-f7ae5c19-cd0f-48c1-98b7-0697c633ee18 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:05:51.452284 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-f7ae5c19-cd0f-48c1-98b7-0697c633ee18 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: 1d113a2e-cf60-4d21-92e6-992d10f072da] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:05:51.458974 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f7ae5c19-cd0f-48c1-98b7-0697c633ee18 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:05:51.459414 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f7ae5c19-cd0f-48c1-98b7-0697c633ee18 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:05:51.460160 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f7ae5c19-cd0f-48c1-98b7-0697c633ee18 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:05:51.460585 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-f7ae5c19-cd0f-48c1-98b7-0697c633ee18 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:05:51.594493 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-f7ae5c19-cd0f-48c1-98b7-0697c633ee18 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:05:51.605587 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-f7ae5c19-cd0f-48c1-98b7-0697c633ee18 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da" status: 200 len: 1265 microversion: 2.1 time: 0.158475 Jul 26 08:05:51.606372 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1243/2438] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:05:51 2022] GET /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:05:52.634416 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-44ad271f-49ae-4add-b3a8-73c1b336f251 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:05:52.635475 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-44ad271f-49ae-4add-b3a8-73c1b336f251 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: 1d113a2e-cf60-4d21-92e6-992d10f072da] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:05:52.646584 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-44ad271f-49ae-4add-b3a8-73c1b336f251 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:05:52.647324 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-44ad271f-49ae-4add-b3a8-73c1b336f251 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:05:52.648270 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-44ad271f-49ae-4add-b3a8-73c1b336f251 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:05:52.648712 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-44ad271f-49ae-4add-b3a8-73c1b336f251 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:05:52.784563 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-44ad271f-49ae-4add-b3a8-73c1b336f251 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:05:52.794704 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-44ad271f-49ae-4add-b3a8-73c1b336f251 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da" status: 200 len: 1265 microversion: 2.1 time: 0.166771 Jul 26 08:05:52.795469 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1196/2439] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:05:52 2022] GET /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:05:53.818725 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c598492c-69b9-48c0-9be5-ce6be82bffb3 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:05:53.819712 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c598492c-69b9-48c0-9be5-ce6be82bffb3 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: 1d113a2e-cf60-4d21-92e6-992d10f072da] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:05:53.826673 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c598492c-69b9-48c0-9be5-ce6be82bffb3 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:05:53.827114 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c598492c-69b9-48c0-9be5-ce6be82bffb3 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:05:53.827853 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c598492c-69b9-48c0-9be5-ce6be82bffb3 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:05:53.828276 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c598492c-69b9-48c0-9be5-ce6be82bffb3 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:05:53.960020 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c598492c-69b9-48c0-9be5-ce6be82bffb3 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:05:53.968229 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c598492c-69b9-48c0-9be5-ce6be82bffb3 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da" status: 200 len: 1265 microversion: 2.1 time: 0.153358 Jul 26 08:05:53.968794 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1244/2440] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:05:53 2022] GET /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:05:54.992573 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8723502b-3235-44c8-9bba-687ca6462fea tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:05:54.993546 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8723502b-3235-44c8-9bba-687ca6462fea tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: 1d113a2e-cf60-4d21-92e6-992d10f072da] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:05:55.001413 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8723502b-3235-44c8-9bba-687ca6462fea tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:05:55.001958 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8723502b-3235-44c8-9bba-687ca6462fea tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:05:55.002792 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8723502b-3235-44c8-9bba-687ca6462fea tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:05:55.003266 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8723502b-3235-44c8-9bba-687ca6462fea tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:05:55.153913 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8723502b-3235-44c8-9bba-687ca6462fea tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:05:55.165331 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8723502b-3235-44c8-9bba-687ca6462fea tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da" status: 200 len: 1265 microversion: 2.1 time: 0.179004 Jul 26 08:05:55.166132 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1197/2441] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:05:54 2022] GET /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:05:56.196472 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-00845dbd-1971-4722-a414-d4de7361b7bc tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:05:56.197363 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-00845dbd-1971-4722-a414-d4de7361b7bc tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: 1d113a2e-cf60-4d21-92e6-992d10f072da] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:05:56.205082 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-00845dbd-1971-4722-a414-d4de7361b7bc tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:05:56.205528 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-00845dbd-1971-4722-a414-d4de7361b7bc tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:05:56.206314 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-00845dbd-1971-4722-a414-d4de7361b7bc tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:05:56.206743 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-00845dbd-1971-4722-a414-d4de7361b7bc tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:05:56.340424 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-00845dbd-1971-4722-a414-d4de7361b7bc tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:05:56.348100 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-00845dbd-1971-4722-a414-d4de7361b7bc tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da" status: 200 len: 1265 microversion: 2.1 time: 0.158606 Jul 26 08:05:56.348661 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1245/2442] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:05:56 2022] GET /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:05:57.372708 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-30c20f62-6ec0-4025-bfa5-3a3d7ef16399 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:05:57.373369 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-30c20f62-6ec0-4025-bfa5-3a3d7ef16399 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: 1d113a2e-cf60-4d21-92e6-992d10f072da] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:05:57.376238 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell0:SELECT=2 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:05:57.377063 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell0:SELECT=6 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:05:57.384130 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-30c20f62-6ec0-4025-bfa5-3a3d7ef16399 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:05:57.384681 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-30c20f62-6ec0-4025-bfa5-3a3d7ef16399 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:05:57.385625 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-30c20f62-6ec0-4025-bfa5-3a3d7ef16399 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:05:57.386194 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-30c20f62-6ec0-4025-bfa5-3a3d7ef16399 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:05:57.626047 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-30c20f62-6ec0-4025-bfa5-3a3d7ef16399 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:05:57.633829 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-30c20f62-6ec0-4025-bfa5-3a3d7ef16399 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da" status: 200 len: 1265 microversion: 2.1 time: 0.267405 Jul 26 08:05:57.634419 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1198/2443] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:05:57 2022] GET /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da => generated 1265 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:05:58.655770 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7af5ea38-9bbf-4259-ae09-f8ca1bd0a3e2 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:05:58.656384 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7af5ea38-9bbf-4259-ae09-f8ca1bd0a3e2 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: 1d113a2e-cf60-4d21-92e6-992d10f072da] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:05:58.658898 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell0:SELECT=2 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:05:58.664669 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7af5ea38-9bbf-4259-ae09-f8ca1bd0a3e2 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:05:58.665120 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7af5ea38-9bbf-4259-ae09-f8ca1bd0a3e2 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:05:58.665908 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7af5ea38-9bbf-4259-ae09-f8ca1bd0a3e2 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:05:58.666342 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7af5ea38-9bbf-4259-ae09-f8ca1bd0a3e2 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:05:58.866158 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7af5ea38-9bbf-4259-ae09-f8ca1bd0a3e2 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:05:58.878264 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7af5ea38-9bbf-4259-ae09-f8ca1bd0a3e2 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da" status: 200 len: 1265 microversion: 2.1 time: 0.226469 Jul 26 08:05:58.878845 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1246/2444] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:05:58 2022] GET /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:05:59.900711 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-465dfaa4-2dd3-498e-9d92-31172e54a3d9 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:05:59.901299 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-465dfaa4-2dd3-498e-9d92-31172e54a3d9 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: 1d113a2e-cf60-4d21-92e6-992d10f072da] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:05:59.907813 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-465dfaa4-2dd3-498e-9d92-31172e54a3d9 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:05:59.908253 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-465dfaa4-2dd3-498e-9d92-31172e54a3d9 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:05:59.908997 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-465dfaa4-2dd3-498e-9d92-31172e54a3d9 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:05:59.909425 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-465dfaa4-2dd3-498e-9d92-31172e54a3d9 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:06:00.046107 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-465dfaa4-2dd3-498e-9d92-31172e54a3d9 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:06:00.056733 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-465dfaa4-2dd3-498e-9d92-31172e54a3d9 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da" status: 200 len: 1265 microversion: 2.1 time: 0.159611 Jul 26 08:06:00.057475 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1199/2445] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:05:59 2022] GET /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:06:01.082053 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-57ab6691-b7ac-4572-b868-e59ff3e5ea28 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:06:01.082830 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-57ab6691-b7ac-4572-b868-e59ff3e5ea28 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: 1d113a2e-cf60-4d21-92e6-992d10f072da] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:06:01.091781 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-57ab6691-b7ac-4572-b868-e59ff3e5ea28 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:06:01.092374 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-57ab6691-b7ac-4572-b868-e59ff3e5ea28 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:06:01.093367 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-57ab6691-b7ac-4572-b868-e59ff3e5ea28 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:06:01.093967 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-57ab6691-b7ac-4572-b868-e59ff3e5ea28 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:06:01.245725 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-57ab6691-b7ac-4572-b868-e59ff3e5ea28 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:06:01.256836 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-57ab6691-b7ac-4572-b868-e59ff3e5ea28 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da" status: 200 len: 1265 microversion: 2.1 time: 0.180524 Jul 26 08:06:01.257596 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1247/2446] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:06:01 2022] GET /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:06:01.450561 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-6488ad67-ec31-4027-a3ed-80d8aed1edcc req-4a806ec9-1358-4a27-b09f-345b5cfc9736 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d113a2e-cf60-4d21-92e6-992d10f072da", "name": "network-vif-plugged", "status": "completed", "tag": "c20e3ee5-16d8-4888-a4ca-e2d740d927cd"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 08:06:01.460910 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-6488ad67-ec31-4027-a3ed-80d8aed1edcc req-4a806ec9-1358-4a27-b09f-345b5cfc9736 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:06:01.461354 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-6488ad67-ec31-4027-a3ed-80d8aed1edcc req-4a806ec9-1358-4a27-b09f-345b5cfc9736 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:06:01.473050 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-6488ad67-ec31-4027-a3ed-80d8aed1edcc req-4a806ec9-1358-4a27-b09f-345b5cfc9736 service nova] Creating event network-vif-plugged:c20e3ee5-16d8-4888-a4ca-e2d740d927cd for instance 1d113a2e-cf60-4d21-92e6-992d10f072da on hv-cinder-85083 Jul 26 08:06:01.478207 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-6488ad67-ec31-4027-a3ed-80d8aed1edcc req-4a806ec9-1358-4a27-b09f-345b5cfc9736 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031282 Jul 26 08:06:01.478845 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1200/2447] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 08:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 08:06:02.278820 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-0578acd8-723f-4746-8ff2-2d47b4a38a59 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:06:02.279441 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-0578acd8-723f-4746-8ff2-2d47b4a38a59 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: 1d113a2e-cf60-4d21-92e6-992d10f072da] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:06:02.286466 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0578acd8-723f-4746-8ff2-2d47b4a38a59 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:06:02.286912 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0578acd8-723f-4746-8ff2-2d47b4a38a59 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:06:02.287666 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0578acd8-723f-4746-8ff2-2d47b4a38a59 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:06:02.288097 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0578acd8-723f-4746-8ff2-2d47b4a38a59 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:06:02.435276 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-0578acd8-723f-4746-8ff2-2d47b4a38a59 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:06:02.443309 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-0578acd8-723f-4746-8ff2-2d47b4a38a59 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da" status: 200 len: 1265 microversion: 2.1 time: 0.168456 Jul 26 08:06:02.443884 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1248/2448] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:06:02 2022] GET /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:06:03.464976 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-8ec918dc-c168-419f-b368-5b3809a2545e tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:06:03.465647 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-8ec918dc-c168-419f-b368-5b3809a2545e tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: 1d113a2e-cf60-4d21-92e6-992d10f072da] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:06:03.472320 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8ec918dc-c168-419f-b368-5b3809a2545e tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:06:03.472757 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8ec918dc-c168-419f-b368-5b3809a2545e tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:06:03.473502 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8ec918dc-c168-419f-b368-5b3809a2545e tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:06:03.473979 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-8ec918dc-c168-419f-b368-5b3809a2545e tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:06:03.616366 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-8ec918dc-c168-419f-b368-5b3809a2545e tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:06:03.628016 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-8ec918dc-c168-419f-b368-5b3809a2545e tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da" status: 200 len: 1452 microversion: 2.1 time: 0.167516 Jul 26 08:06:03.628611 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1201/2449] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:06:03 2022] GET /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da => generated 1452 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:06:03.648182 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-9fe0d9bc-1420-4d86-938b-dd4e84bf8bd4 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:06:03.648799 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-9fe0d9bc-1420-4d86-938b-dd4e84bf8bd4 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: 1d113a2e-cf60-4d21-92e6-992d10f072da] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:06:03.655614 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9fe0d9bc-1420-4d86-938b-dd4e84bf8bd4 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:06:03.656062 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9fe0d9bc-1420-4d86-938b-dd4e84bf8bd4 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:06:03.656818 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9fe0d9bc-1420-4d86-938b-dd4e84bf8bd4 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:06:03.657256 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-9fe0d9bc-1420-4d86-938b-dd4e84bf8bd4 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:06:03.789827 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-9fe0d9bc-1420-4d86-938b-dd4e84bf8bd4 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:06:03.797838 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-9fe0d9bc-1420-4d86-938b-dd4e84bf8bd4 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da" status: 200 len: 1452 microversion: 2.1 time: 0.153482 Jul 26 08:06:03.798407 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1249/2450] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:06:03 2022] GET /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:06:05.418767 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-d69ecfb7-7584-4c76-b5b1-53330b96fff1 req-2c39f854-0c13-4f1c-ada9-b5af731d8dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d113a2e-cf60-4d21-92e6-992d10f072da", "tag": "c20e3ee5-16d8-4888-a4ca-e2d740d927cd"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 08:06:05.428644 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-d69ecfb7-7584-4c76-b5b1-53330b96fff1 req-2c39f854-0c13-4f1c-ada9-b5af731d8dd2 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:06:05.429183 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-d69ecfb7-7584-4c76-b5b1-53330b96fff1 req-2c39f854-0c13-4f1c-ada9-b5af731d8dd2 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:06:05.440715 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-d69ecfb7-7584-4c76-b5b1-53330b96fff1 req-2c39f854-0c13-4f1c-ada9-b5af731d8dd2 service nova] Creating event network-changed:c20e3ee5-16d8-4888-a4ca-e2d740d927cd for instance 1d113a2e-cf60-4d21-92e6-992d10f072da on hv-cinder-85083 Jul 26 08:06:05.446511 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-d69ecfb7-7584-4c76-b5b1-53330b96fff1 req-2c39f854-0c13-4f1c-ada9-b5af731d8dd2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031537 Jul 26 08:06:05.447147 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1202/2451] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 08:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 08:07:40.538600 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=26 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:07:40.539350 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=54 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:07:40.543349 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-2b7f4a07-ccbd-4bcd-8723-0848f74bf6aa tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-226356603", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-241314831", "security_groups": [{"name": "tempest-secgroup-smoke-1386520737"}], "block_device_mapping_v2": [{"uuid": "7f7fa46e-34ac-4045-a728-b240ded7b773", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "491ee5ad-5a2f-4f94-a50c-1bf651b747a4"}]}} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 08:07:40.661687 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.network.neutron [None req-2b7f4a07-ccbd-4bcd-8723-0848f74bf6aa tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] validate_networks() for [('491ee5ad-5a2f-4f94-a50c-1bf651b747a4', None, None, None, None, None)] {{(pid=117715) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 08:07:41.338774 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-2b7f4a07-ccbd-4bcd-8723-0848f74bf6aa tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Flavor limits 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 08:07:41.339191 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-2b7f4a07-ccbd-4bcd-8723-0848f74bf6aa tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Image limits 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 08:07:41.339657 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-2b7f4a07-ccbd-4bcd-8723-0848f74bf6aa tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Flavor pref 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 08:07:41.340057 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-2b7f4a07-ccbd-4bcd-8723-0848f74bf6aa tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Image pref 0:0:0 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 08:07:41.340458 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.virt.hardware [None req-2b7f4a07-ccbd-4bcd-8723-0848f74bf6aa tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 08:07:41.352711 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2b7f4a07-ccbd-4bcd-8723-0848f74bf6aa tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:07:41.353151 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2b7f4a07-ccbd-4bcd-8723-0848f74bf6aa tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:07:41.353968 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2b7f4a07-ccbd-4bcd-8723-0848f74bf6aa tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:07:41.354397 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2b7f4a07-ccbd-4bcd-8723-0848f74bf6aa tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:07:41.371067 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.quota [None req-2b7f4a07-ccbd-4bcd-8723-0848f74bf6aa tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Getting quotas for project 491378f17ebd4fddbf00a3b55a2d5b85. Resources: {'instances', 'cores', 'ram'} {{(pid=117715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 08:07:41.375420 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.quota [None req-2b7f4a07-ccbd-4bcd-8723-0848f74bf6aa tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Getting quotas for user 7881b5c6627d41eca68a27fc38559b2f and project 491378f17ebd4fddbf00a3b55a2d5b85. Resources: {'instances', 'cores', 'ram'} {{(pid=117715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 08:07:41.433552 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2b7f4a07-ccbd-4bcd-8723-0848f74bf6aa tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Going to run 1 instances... {{(pid=117715) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 08:07:41.435735 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2b7f4a07-ccbd-4bcd-8723-0848f74bf6aa tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: a5d714f2-600b-4d10-be88-c1186d2c5d59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7f7fa46e-34ac-4045-a728-b240ded7b773',volume_size=None,volume_type=None)] {{(pid=117715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 08:07:41.589260 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-2b7f4a07-ccbd-4bcd-8723-0848f74bf6aa tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.052406 Jul 26 08:07:41.590008 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1250/2452] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Jul 26 08:07:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 1054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 08:07:41.601074 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:07:41.602034 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:07:41.606343 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-a71621ac-ecee-4718-9db1-b200e5ee74a6 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:07:41.607025 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-a71621ac-ecee-4718-9db1-b200e5ee74a6 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: a5d714f2-600b-4d10-be88-c1186d2c5d59] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:07:41.666491 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-a71621ac-ecee-4718-9db1-b200e5ee74a6 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:07:41.673226 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-a71621ac-ecee-4718-9db1-b200e5ee74a6 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/a5d714f2-600b-4d10-be88-c1186d2c5d59" status: 200 len: 1093 microversion: 2.1 time: 0.075515 Jul 26 08:07:41.673934 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1203/2453] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:07:41 2022] GET /compute/v2.1/servers/a5d714f2-600b-4d10-be88-c1186d2c5d59 => generated 1093 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:07:42.695000 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-7eaab074-e1fb-4baf-bc00-aced565a9236 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:07:42.695612 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-7eaab074-e1fb-4baf-bc00-aced565a9236 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: a5d714f2-600b-4d10-be88-c1186d2c5d59] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:07:42.702561 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7eaab074-e1fb-4baf-bc00-aced565a9236 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:07:42.702934 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7eaab074-e1fb-4baf-bc00-aced565a9236 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:07:42.703736 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7eaab074-e1fb-4baf-bc00-aced565a9236 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:07:42.704250 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-7eaab074-e1fb-4baf-bc00-aced565a9236 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:07:42.777566 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-7eaab074-e1fb-4baf-bc00-aced565a9236 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:07:42.785676 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-7eaab074-e1fb-4baf-bc00-aced565a9236 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/a5d714f2-600b-4d10-be88-c1186d2c5d59" status: 200 len: 1209 microversion: 2.1 time: 0.095495 Jul 26 08:07:42.786407 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1251/2454] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:07:42 2022] GET /compute/v2.1/servers/a5d714f2-600b-4d10-be88-c1186d2c5d59 => generated 1209 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:07:43.807317 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-d5b69d33-78f5-42d1-94c0-7b85d6c81379 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:07:43.807908 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-d5b69d33-78f5-42d1-94c0-7b85d6c81379 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: a5d714f2-600b-4d10-be88-c1186d2c5d59] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:07:43.816246 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d5b69d33-78f5-42d1-94c0-7b85d6c81379 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:07:43.816717 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d5b69d33-78f5-42d1-94c0-7b85d6c81379 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:07:43.817503 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d5b69d33-78f5-42d1-94c0-7b85d6c81379 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:07:43.818000 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-d5b69d33-78f5-42d1-94c0-7b85d6c81379 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:07:43.970275 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-d5b69d33-78f5-42d1-94c0-7b85d6c81379 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:07:43.978572 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-d5b69d33-78f5-42d1-94c0-7b85d6c81379 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/a5d714f2-600b-4d10-be88-c1186d2c5d59" status: 200 len: 1265 microversion: 2.1 time: 0.175044 Jul 26 08:07:43.979725 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1204/2455] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:07:43 2022] GET /compute/v2.1/servers/a5d714f2-600b-4d10-be88-c1186d2c5d59 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:07:43.996220 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [req-c6c457f6-e1ef-4b51-9d4e-524f16c058d8 req-8083fd11-d9e8-4ca7-9376-e5ff796268a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5d714f2-600b-4d10-be88-c1186d2c5d59", "tag": "08927f47-da9c-4f52-95c2-bf44197d6755"}]} {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 08:07:44.009704 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-c6c457f6-e1ef-4b51-9d4e-524f16c058d8 req-8083fd11-d9e8-4ca7-9376-e5ff796268a7 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:07:44.010075 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [req-c6c457f6-e1ef-4b51-9d4e-524f16c058d8 req-8083fd11-d9e8-4ca7-9376-e5ff796268a7 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:07:44.023668 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.compute.server_external_events [req-c6c457f6-e1ef-4b51-9d4e-524f16c058d8 req-8083fd11-d9e8-4ca7-9376-e5ff796268a7 service nova] Creating event network-changed:08927f47-da9c-4f52-95c2-bf44197d6755 for instance a5d714f2-600b-4d10-be88-c1186d2c5d59 on hv-cinder-85083 Jul 26 08:07:44.029114 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [req-c6c457f6-e1ef-4b51-9d4e-524f16c058d8 req-8083fd11-d9e8-4ca7-9376-e5ff796268a7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038094 Jul 26 08:07:44.029726 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1252/2456] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 08:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 08:07:45.007196 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-64a40d46-6b63-4e96-8597-933919c4f74e tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:07:45.007857 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-64a40d46-6b63-4e96-8597-933919c4f74e tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: a5d714f2-600b-4d10-be88-c1186d2c5d59] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:07:45.014737 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-64a40d46-6b63-4e96-8597-933919c4f74e tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:07:45.015193 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-64a40d46-6b63-4e96-8597-933919c4f74e tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:07:45.015927 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-64a40d46-6b63-4e96-8597-933919c4f74e tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:07:45.016387 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-64a40d46-6b63-4e96-8597-933919c4f74e tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:07:45.147446 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-64a40d46-6b63-4e96-8597-933919c4f74e tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:07:45.155018 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-64a40d46-6b63-4e96-8597-933919c4f74e tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/a5d714f2-600b-4d10-be88-c1186d2c5d59" status: 200 len: 1265 microversion: 2.1 time: 0.151844 Jul 26 08:07:45.155637 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1205/2457] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:07:45 2022] GET /compute/v2.1/servers/a5d714f2-600b-4d10-be88-c1186d2c5d59 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:07:46.178274 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-2993669d-0ebc-4289-b64b-89646188f6f8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:07:46.179184 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2993669d-0ebc-4289-b64b-89646188f6f8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: a5d714f2-600b-4d10-be88-c1186d2c5d59] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:07:46.187816 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2993669d-0ebc-4289-b64b-89646188f6f8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:07:46.188410 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2993669d-0ebc-4289-b64b-89646188f6f8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:07:46.189402 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2993669d-0ebc-4289-b64b-89646188f6f8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:07:46.190027 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2993669d-0ebc-4289-b64b-89646188f6f8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:07:46.326632 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2993669d-0ebc-4289-b64b-89646188f6f8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:07:46.334244 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-2993669d-0ebc-4289-b64b-89646188f6f8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/a5d714f2-600b-4d10-be88-c1186d2c5d59" status: 200 len: 1265 microversion: 2.1 time: 0.161901 Jul 26 08:07:46.334776 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1253/2458] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:07:46 2022] GET /compute/v2.1/servers/a5d714f2-600b-4d10-be88-c1186d2c5d59 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:07:47.359582 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-6f924156-60ac-48d8-9272-b47993b3953f tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:07:47.360468 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-6f924156-60ac-48d8-9272-b47993b3953f tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: a5d714f2-600b-4d10-be88-c1186d2c5d59] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:07:47.371563 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6f924156-60ac-48d8-9272-b47993b3953f tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:07:47.372275 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6f924156-60ac-48d8-9272-b47993b3953f tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:07:47.373546 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6f924156-60ac-48d8-9272-b47993b3953f tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:07:47.374311 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-6f924156-60ac-48d8-9272-b47993b3953f tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:07:47.505920 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-6f924156-60ac-48d8-9272-b47993b3953f tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:07:47.513489 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-6f924156-60ac-48d8-9272-b47993b3953f tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/a5d714f2-600b-4d10-be88-c1186d2c5d59" status: 200 len: 1265 microversion: 2.1 time: 0.160643 Jul 26 08:07:47.514081 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1206/2459] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:07:47 2022] GET /compute/v2.1/servers/a5d714f2-600b-4d10-be88-c1186d2c5d59 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:07:48.539456 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-6a43c095-a167-4a67-aa22-c5cf63c1b6b8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:07:48.540547 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-6a43c095-a167-4a67-aa22-c5cf63c1b6b8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: a5d714f2-600b-4d10-be88-c1186d2c5d59] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:07:48.551492 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6a43c095-a167-4a67-aa22-c5cf63c1b6b8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:07:48.552322 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6a43c095-a167-4a67-aa22-c5cf63c1b6b8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:07:48.553067 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6a43c095-a167-4a67-aa22-c5cf63c1b6b8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:07:48.553492 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-6a43c095-a167-4a67-aa22-c5cf63c1b6b8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:07:48.702506 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-6a43c095-a167-4a67-aa22-c5cf63c1b6b8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:07:48.714781 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-6a43c095-a167-4a67-aa22-c5cf63c1b6b8 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/a5d714f2-600b-4d10-be88-c1186d2c5d59" status: 200 len: 1265 microversion: 2.1 time: 0.182122 Jul 26 08:07:48.715647 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1254/2460] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:07:48 2022] GET /compute/v2.1/servers/a5d714f2-600b-4d10-be88-c1186d2c5d59 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:07:49.740211 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-c517acda-bf55-42ae-baf6-6f5f15d4d9b3 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:07:49.741070 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-c517acda-bf55-42ae-baf6-6f5f15d4d9b3 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: a5d714f2-600b-4d10-be88-c1186d2c5d59] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:07:49.747978 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c517acda-bf55-42ae-baf6-6f5f15d4d9b3 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:07:49.748424 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c517acda-bf55-42ae-baf6-6f5f15d4d9b3 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:07:49.749184 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c517acda-bf55-42ae-baf6-6f5f15d4d9b3 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:07:49.749612 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-c517acda-bf55-42ae-baf6-6f5f15d4d9b3 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:07:50.057711 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-c517acda-bf55-42ae-baf6-6f5f15d4d9b3 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:07:50.065947 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-c517acda-bf55-42ae-baf6-6f5f15d4d9b3 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/a5d714f2-600b-4d10-be88-c1186d2c5d59" status: 200 len: 1265 microversion: 2.1 time: 0.332287 Jul 26 08:07:50.066513 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1207/2461] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:07:49 2022] GET /compute/v2.1/servers/a5d714f2-600b-4d10-be88-c1186d2c5d59 => generated 1265 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:07:51.091476 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-43e689a5-9f6b-4515-8793-42aebd2dc817 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:07:51.092359 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-43e689a5-9f6b-4515-8793-42aebd2dc817 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: a5d714f2-600b-4d10-be88-c1186d2c5d59] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:07:51.102257 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-43e689a5-9f6b-4515-8793-42aebd2dc817 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:07:51.102795 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-43e689a5-9f6b-4515-8793-42aebd2dc817 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:07:51.103549 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-43e689a5-9f6b-4515-8793-42aebd2dc817 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:07:51.103970 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-43e689a5-9f6b-4515-8793-42aebd2dc817 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:07:51.238102 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-43e689a5-9f6b-4515-8793-42aebd2dc817 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:07:51.246006 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-43e689a5-9f6b-4515-8793-42aebd2dc817 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/a5d714f2-600b-4d10-be88-c1186d2c5d59" status: 200 len: 1265 microversion: 2.1 time: 0.161140 Jul 26 08:07:51.246568 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1255/2462] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:07:51 2022] GET /compute/v2.1/servers/a5d714f2-600b-4d10-be88-c1186d2c5d59 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:07:52.270453 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-31c60da9-b3f6-480a-a8af-a8f9de2929fb tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:07:52.271455 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-31c60da9-b3f6-480a-a8af-a8f9de2929fb tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: a5d714f2-600b-4d10-be88-c1186d2c5d59] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:07:52.275184 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell0:SELECT=2 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:07:52.279165 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-31c60da9-b3f6-480a-a8af-a8f9de2929fb tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:07:52.279615 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-31c60da9-b3f6-480a-a8af-a8f9de2929fb tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:07:52.280375 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-31c60da9-b3f6-480a-a8af-a8f9de2929fb tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:07:52.280806 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-31c60da9-b3f6-480a-a8af-a8f9de2929fb tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:07:52.414943 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-31c60da9-b3f6-480a-a8af-a8f9de2929fb tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:07:52.422824 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-31c60da9-b3f6-480a-a8af-a8f9de2929fb tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/a5d714f2-600b-4d10-be88-c1186d2c5d59" status: 200 len: 1265 microversion: 2.1 time: 0.158850 Jul 26 08:07:52.423619 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1208/2463] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:07:52 2022] GET /compute/v2.1/servers/a5d714f2-600b-4d10-be88-c1186d2c5d59 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:07:53.448328 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-4078648b-a5bd-43f8-aa5e-aafea3a1ec3d tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:07:53.449342 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-4078648b-a5bd-43f8-aa5e-aafea3a1ec3d tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: a5d714f2-600b-4d10-be88-c1186d2c5d59] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:07:53.452463 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell0:SELECT=2 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:07:53.453557 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell0:SELECT=6 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:07:53.462653 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4078648b-a5bd-43f8-aa5e-aafea3a1ec3d tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:07:53.463107 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4078648b-a5bd-43f8-aa5e-aafea3a1ec3d tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:07:53.463873 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4078648b-a5bd-43f8-aa5e-aafea3a1ec3d tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:07:53.464309 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-4078648b-a5bd-43f8-aa5e-aafea3a1ec3d tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:07:53.620581 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-4078648b-a5bd-43f8-aa5e-aafea3a1ec3d tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:07:53.632401 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-4078648b-a5bd-43f8-aa5e-aafea3a1ec3d tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/a5d714f2-600b-4d10-be88-c1186d2c5d59" status: 200 len: 1265 microversion: 2.1 time: 0.190869 Jul 26 08:07:53.633087 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1256/2464] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:07:53 2022] GET /compute/v2.1/servers/a5d714f2-600b-4d10-be88-c1186d2c5d59 => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:07:54.084617 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-5abfb3e8-2498-47eb-9bbc-43710401b50e req-1b0fdb6e-62ac-4b4f-aa83-92f56bc664c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5d714f2-600b-4d10-be88-c1186d2c5d59", "name": "network-vif-plugged", "status": "completed", "tag": "08927f47-da9c-4f52-95c2-bf44197d6755"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 08:07:54.095132 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-5abfb3e8-2498-47eb-9bbc-43710401b50e req-1b0fdb6e-62ac-4b4f-aa83-92f56bc664c3 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:07:54.095502 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-5abfb3e8-2498-47eb-9bbc-43710401b50e req-1b0fdb6e-62ac-4b4f-aa83-92f56bc664c3 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:07:54.107010 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-5abfb3e8-2498-47eb-9bbc-43710401b50e req-1b0fdb6e-62ac-4b4f-aa83-92f56bc664c3 service nova] Creating event network-vif-plugged:08927f47-da9c-4f52-95c2-bf44197d6755 for instance a5d714f2-600b-4d10-be88-c1186d2c5d59 on hv-cinder-85083 Jul 26 08:07:54.112056 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-5abfb3e8-2498-47eb-9bbc-43710401b50e req-1b0fdb6e-62ac-4b4f-aa83-92f56bc664c3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109053 Jul 26 08:07:54.112637 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1209/2465] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 08:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 08:07:54.663351 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-c43053d6-8366-4930-98a5-2eba0b38c963 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:07:54.664157 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-c43053d6-8366-4930-98a5-2eba0b38c963 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: a5d714f2-600b-4d10-be88-c1186d2c5d59] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:07:54.672206 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c43053d6-8366-4930-98a5-2eba0b38c963 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:07:54.672666 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c43053d6-8366-4930-98a5-2eba0b38c963 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:07:54.673455 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c43053d6-8366-4930-98a5-2eba0b38c963 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:07:54.673938 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-c43053d6-8366-4930-98a5-2eba0b38c963 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:07:54.822036 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-c43053d6-8366-4930-98a5-2eba0b38c963 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:07:54.829500 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-c43053d6-8366-4930-98a5-2eba0b38c963 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/a5d714f2-600b-4d10-be88-c1186d2c5d59" status: 200 len: 1265 microversion: 2.1 time: 0.172844 Jul 26 08:07:54.830099 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1257/2466] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:07:54 2022] GET /compute/v2.1/servers/a5d714f2-600b-4d10-be88-c1186d2c5d59 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:07:55.859260 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-fd1f142d-06f8-4b9e-92dc-02d13d8cb63f tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:07:55.859956 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-fd1f142d-06f8-4b9e-92dc-02d13d8cb63f tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: a5d714f2-600b-4d10-be88-c1186d2c5d59] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:07:55.866895 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fd1f142d-06f8-4b9e-92dc-02d13d8cb63f tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:07:55.867320 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fd1f142d-06f8-4b9e-92dc-02d13d8cb63f tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:07:55.868077 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fd1f142d-06f8-4b9e-92dc-02d13d8cb63f tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:07:55.868515 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-fd1f142d-06f8-4b9e-92dc-02d13d8cb63f tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:07:56.016627 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-fd1f142d-06f8-4b9e-92dc-02d13d8cb63f tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:07:56.024380 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-fd1f142d-06f8-4b9e-92dc-02d13d8cb63f tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/a5d714f2-600b-4d10-be88-c1186d2c5d59" status: 200 len: 1451 microversion: 2.1 time: 0.169899 Jul 26 08:07:56.024937 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1210/2467] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:07:55 2022] GET /compute/v2.1/servers/a5d714f2-600b-4d10-be88-c1186d2c5d59 => generated 1451 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:07:56.044511 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-71336599-e83e-4612-9353-813fdbb0ce30 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:07:56.045119 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-71336599-e83e-4612-9353-813fdbb0ce30 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: a5d714f2-600b-4d10-be88-c1186d2c5d59] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:07:56.051851 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-71336599-e83e-4612-9353-813fdbb0ce30 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:07:56.052300 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-71336599-e83e-4612-9353-813fdbb0ce30 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:07:56.053052 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-71336599-e83e-4612-9353-813fdbb0ce30 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:07:56.053485 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-71336599-e83e-4612-9353-813fdbb0ce30 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:07:56.196430 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-71336599-e83e-4612-9353-813fdbb0ce30 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:07:56.204526 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-71336599-e83e-4612-9353-813fdbb0ce30 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/a5d714f2-600b-4d10-be88-c1186d2c5d59" status: 200 len: 1451 microversion: 2.1 time: 0.164009 Jul 26 08:07:56.205096 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1258/2468] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:07:56 2022] GET /compute/v2.1/servers/a5d714f2-600b-4d10-be88-c1186d2c5d59 => generated 1451 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:07:57.897611 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-359332f1-a338-40a4-a710-801a1bb7a2eb req-a06c55ad-ddea-4277-b9d6-0b42f3926fc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5d714f2-600b-4d10-be88-c1186d2c5d59", "tag": "08927f47-da9c-4f52-95c2-bf44197d6755"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 08:07:57.907087 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-359332f1-a338-40a4-a710-801a1bb7a2eb req-a06c55ad-ddea-4277-b9d6-0b42f3926fc3 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:07:57.907522 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-359332f1-a338-40a4-a710-801a1bb7a2eb req-a06c55ad-ddea-4277-b9d6-0b42f3926fc3 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:07:57.918875 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-359332f1-a338-40a4-a710-801a1bb7a2eb req-a06c55ad-ddea-4277-b9d6-0b42f3926fc3 service nova] Creating event network-changed:08927f47-da9c-4f52-95c2-bf44197d6755 for instance a5d714f2-600b-4d10-be88-c1186d2c5d59 on hv-cinder-85083 Jul 26 08:07:57.924214 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-359332f1-a338-40a4-a710-801a1bb7a2eb req-a06c55ad-ddea-4277-b9d6-0b42f3926fc3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091969 Jul 26 08:07:57.924774 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1211/2469] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 08:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 08:08:50.392043 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 08:08:50.392888 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Tue Jul 26 08:08:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 08:08:57.745817 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 08:08:57.746692 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Tue Jul 26 08:08:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 08:09:26.064494 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:09:26.065296 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG dbcounter [-] [117715] Writing DB stats nova_cell1:SELECT=46 {{(pid=117715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:09:26.067851 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_api:SELECT=20 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:09:26.069270 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG dbcounter [-] [117716] Writing DB stats nova_cell1:SELECT=40 {{(pid=117716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:09:26.070483 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-0c4b75f5-a8b2-4cc5-b9e1-bf6ca5baa547 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:09:26.070988 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-0c4b75f5-a8b2-4cc5-b9e1-bf6ca5baa547 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: a5d714f2-600b-4d10-be88-c1186d2c5d59] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:09:26.074443 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-e29401a5-0b82-4ac8-9ad7-b357347dcd8c req-f461d7b5-b803-47d2-862e-98e45fef3712 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5d714f2-600b-4d10-be88-c1186d2c5d59", "tag": "08927f47-da9c-4f52-95c2-bf44197d6755"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 08:09:26.078276 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0c4b75f5-a8b2-4cc5-b9e1-bf6ca5baa547 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:09:26.078712 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0c4b75f5-a8b2-4cc5-b9e1-bf6ca5baa547 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:09:26.079643 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0c4b75f5-a8b2-4cc5-b9e1-bf6ca5baa547 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:09:26.080072 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-0c4b75f5-a8b2-4cc5-b9e1-bf6ca5baa547 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:09:26.086025 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-e29401a5-0b82-4ac8-9ad7-b357347dcd8c req-f461d7b5-b803-47d2-862e-98e45fef3712 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:09:26.086539 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-e29401a5-0b82-4ac8-9ad7-b357347dcd8c req-f461d7b5-b803-47d2-862e-98e45fef3712 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:09:26.098324 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-e29401a5-0b82-4ac8-9ad7-b357347dcd8c req-f461d7b5-b803-47d2-862e-98e45fef3712 service nova] Creating event network-changed:08927f47-da9c-4f52-95c2-bf44197d6755 for instance a5d714f2-600b-4d10-be88-c1186d2c5d59 on hv-cinder-85083 Jul 26 08:09:26.104010 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-e29401a5-0b82-4ac8-9ad7-b357347dcd8c req-f461d7b5-b803-47d2-862e-98e45fef3712 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038186 Jul 26 08:09:26.105045 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1212/2470] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 08:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 08:09:26.106249 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-0c4b75f5-a8b2-4cc5-b9e1-bf6ca5baa547 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: a5d714f2-600b-4d10-be88-c1186d2c5d59] Going to try to terminate instance {{(pid=117715) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 08:09:26.189776 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-0c4b75f5-a8b2-4cc5-b9e1-bf6ca5baa547 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a5d714f2-600b-4d10-be88-c1186d2c5d59" status: 204 len: 0 microversion: 2.1 time: 0.126606 Jul 26 08:09:26.193819 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1259/2471] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Jul 26 08:09:26 2022] DELETE /compute/v2.1/servers/a5d714f2-600b-4d10-be88-c1186d2c5d59 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 08:09:26.201289 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-92d09b00-38c9-4494-be04-e4af1d5f9e4d tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:09:26.202266 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-92d09b00-38c9-4494-be04-e4af1d5f9e4d tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: a5d714f2-600b-4d10-be88-c1186d2c5d59] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:09:26.209527 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-92d09b00-38c9-4494-be04-e4af1d5f9e4d tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:09:26.210216 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-92d09b00-38c9-4494-be04-e4af1d5f9e4d tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:09:26.210980 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-92d09b00-38c9-4494-be04-e4af1d5f9e4d tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:09:26.211465 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-92d09b00-38c9-4494-be04-e4af1d5f9e4d tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:09:26.345561 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-92d09b00-38c9-4494-be04-e4af1d5f9e4d tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:09:26.353248 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-92d09b00-38c9-4494-be04-e4af1d5f9e4d tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/a5d714f2-600b-4d10-be88-c1186d2c5d59" status: 200 len: 1576 microversion: 2.1 time: 0.157648 Jul 26 08:09:26.353799 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1213/2472] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:09:26 2022] GET /compute/v2.1/servers/a5d714f2-600b-4d10-be88-c1186d2c5d59 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 08:09:27.377495 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-61e945f4-ed9a-4bbe-b632-554ba2cf2fb5 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:09:27.378381 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-61e945f4-ed9a-4bbe-b632-554ba2cf2fb5 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: a5d714f2-600b-4d10-be88-c1186d2c5d59] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:09:27.388381 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-61e945f4-ed9a-4bbe-b632-554ba2cf2fb5 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:09:27.388823 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-61e945f4-ed9a-4bbe-b632-554ba2cf2fb5 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:09:27.389568 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-61e945f4-ed9a-4bbe-b632-554ba2cf2fb5 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:09:27.390020 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-61e945f4-ed9a-4bbe-b632-554ba2cf2fb5 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:09:27.600283 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-61e945f4-ed9a-4bbe-b632-554ba2cf2fb5 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:09:27.608036 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-61e945f4-ed9a-4bbe-b632-554ba2cf2fb5 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/a5d714f2-600b-4d10-be88-c1186d2c5d59" status: 200 len: 1576 microversion: 2.1 time: 0.235998 Jul 26 08:09:27.608619 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1260/2473] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:09:27 2022] GET /compute/v2.1/servers/a5d714f2-600b-4d10-be88-c1186d2c5d59 => generated 1576 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:09:28.254122 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-5fdc7e67-c0e0-4046-a0e4-e1a6af9b937b req-c70fdc24-f185-4884-833d-13c6623ad3c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5d714f2-600b-4d10-be88-c1186d2c5d59", "name": "network-vif-deleted", "tag": "08927f47-da9c-4f52-95c2-bf44197d6755"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 08:09:28.264280 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-5fdc7e67-c0e0-4046-a0e4-e1a6af9b937b req-c70fdc24-f185-4884-833d-13c6623ad3c4 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:09:28.264724 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-5fdc7e67-c0e0-4046-a0e4-e1a6af9b937b req-c70fdc24-f185-4884-833d-13c6623ad3c4 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:09:28.275634 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-5fdc7e67-c0e0-4046-a0e4-e1a6af9b937b req-c70fdc24-f185-4884-833d-13c6623ad3c4 service nova] Creating event network-vif-deleted:08927f47-da9c-4f52-95c2-bf44197d6755 for instance a5d714f2-600b-4d10-be88-c1186d2c5d59 on hv-cinder-85083 Jul 26 08:09:28.280409 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-5fdc7e67-c0e0-4046-a0e4-e1a6af9b937b req-c70fdc24-f185-4884-833d-13c6623ad3c4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088459 Jul 26 08:09:28.281230 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1214/2474] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 08:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 08:09:28.629482 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-2b2fa049-f2df-4151-8e20-a00e01e3e680 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:09:28.630129 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2b2fa049-f2df-4151-8e20-a00e01e3e680 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: a5d714f2-600b-4d10-be88-c1186d2c5d59] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:09:28.636894 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2b2fa049-f2df-4151-8e20-a00e01e3e680 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:09:28.637348 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2b2fa049-f2df-4151-8e20-a00e01e3e680 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:09:28.638138 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2b2fa049-f2df-4151-8e20-a00e01e3e680 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:09:28.638568 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2b2fa049-f2df-4151-8e20-a00e01e3e680 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:09:28.675389 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2b2fa049-f2df-4151-8e20-a00e01e3e680 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:09:28.675820 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2b2fa049-f2df-4151-8e20-a00e01e3e680 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:09:28.676257 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.objects.instance [None req-2b2fa049-f2df-4151-8e20-a00e01e3e680 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lazy-loading 'fault' on Instance uuid a5d714f2-600b-4d10-be88-c1186d2c5d59 {{(pid=117715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 08:09:28.726859 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-2b2fa049-f2df-4151-8e20-a00e01e3e680 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:09:28.734706 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-2b2fa049-f2df-4151-8e20-a00e01e3e680 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/a5d714f2-600b-4d10-be88-c1186d2c5d59" status: 200 len: 1229 microversion: 2.1 time: 0.109339 Jul 26 08:09:28.735274 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1261/2475] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:09:28 2022] GET /compute/v2.1/servers/a5d714f2-600b-4d10-be88-c1186d2c5d59 => generated 1229 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:09:29.760963 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-28ed60c5-0d92-4201-b48a-5865f427cd37 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:09:29.762090 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-28ed60c5-0d92-4201-b48a-5865f427cd37 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: a5d714f2-600b-4d10-be88-c1186d2c5d59] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:09:29.770233 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-28ed60c5-0d92-4201-b48a-5865f427cd37 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:09:29.770753 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-28ed60c5-0d92-4201-b48a-5865f427cd37 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:09:29.771635 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-28ed60c5-0d92-4201-b48a-5865f427cd37 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:09:29.772138 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-28ed60c5-0d92-4201-b48a-5865f427cd37 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:09:29.791609 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.wsgi [None req-28ed60c5-0d92-4201-b48a-5865f427cd37 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] HTTP exception thrown: Instance a5d714f2-600b-4d10-be88-c1186d2c5d59 could not be found. Jul 26 08:09:29.793721 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-28ed60c5-0d92-4201-b48a-5865f427cd37 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Request method failure captured: Jul 26 08:09:29.793721 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: request: GET /compute/v2.1/servers/a5d714f2-600b-4d10-be88-c1186d2c5d59 HTTP/1.1 Jul 26 08:09:29.793721 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept: application/json Jul 26 08:09:29.793721 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept-Encoding: identity Jul 26 08:09:29.793721 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Connection: close Jul 26 08:09:29.793721 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Length: 0 Jul 26 08:09:29.793721 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Type: application/json Jul 26 08:09:29.793721 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Host: 10.222.0.39 Jul 26 08:09:29.793721 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Openstack-System-Scope: None Jul 26 08:09:29.793721 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: User-Agent: python-urllib3/1.26.10 Jul 26 08:09:29.793721 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Auth-Token: gAAAAABi35-8j0JWLkrKLHPn1kUDvNisSciWAEnvsJwzysecRTk3h8u2GZGNwtQneOQTYv1MoFaY_kinw0ggx2ZWxAsMd4DWG4z5p_n2rYTwTNUi1B_DBdImFU2fBjVNpIfwhJKvvNucakKZQIBz0XYXbekWHd9w4yacS8SoS8LoYRp6ju7oVWY Jul 26 08:09:29.793721 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Id: None Jul 26 08:09:29.793721 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Name: None Jul 26 08:09:29.793721 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Identity-Status: Confirmed Jul 26 08:09:29.793721 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Is-Admin-Project: True Jul 26 08:09:29.793721 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Id: default Jul 26 08:09:29.793721 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Name: Default Jul 26 08:09:29.793721 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Id: 491378f17ebd4fddbf00a3b55a2d5b85 Jul 26 08:09:29.793721 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Name: tempest-TestVolumeBootPattern-1693328640 Jul 26 08:09:29.793721 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Role: member,reader Jul 26 08:09:29.793721 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Roles: member,reader Jul 26 08:09:29.795328 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/491378f17ebd4fddbf00a3b55a2d5b85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_491378f17ebd4fddbf00a3b55a2d5b85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/491378f17ebd4fddbf00a3b55a2d5b85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/491378f17ebd4fddbf00a3b55a2d5b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 08:09:29.795328 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant: tempest-TestVolumeBootPattern-1693328640 Jul 26 08:09:29.795328 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Id: 491378f17ebd4fddbf00a3b55a2d5b85 Jul 26 08:09:29.795328 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Name: tempest-TestVolumeBootPattern-1693328640 Jul 26 08:09:29.795328 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User: tempest-TestVolumeBootPattern-1693328640-project Jul 26 08:09:29.795328 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Id: default Jul 26 08:09:29.795328 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Name: Default Jul 26 08:09:29.795328 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Id: 7881b5c6627d41eca68a27fc38559b2f Jul 26 08:09:29.795328 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Name: tempest-TestVolumeBootPattern-1693328640-project Jul 26 08:09:29.795328 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: method: > Jul 26 08:09:29.795328 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: exception: Instance a5d714f2-600b-4d10-be88-c1186d2c5d59 could not be found. Jul 26 08:09:29.795328 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: action_args: {'id': 'a5d714f2-600b-4d10-be88-c1186d2c5d59'} Jul 26 08:09:29.796106 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 08:09:29.796106 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 08:09:29.796106 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 08:09:29.796106 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 08:09:29.796106 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 08:09:29.796106 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 08:09:29.796106 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 08:09:29.796106 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 08:09:29.796106 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 08:09:29.796106 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 08:09:29.796106 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5d714f2-600b-4d10-be88-c1186d2c5d59 could not be found. Jul 26 08:09:29.796106 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 08:09:29.796106 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 08:09:29.796106 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 08:09:29.796106 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 08:09:29.796106 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 08:09:29.796106 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 08:09:29.796106 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 08:09:29.796106 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 08:09:29.796106 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 08:09:29.797325 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 08:09:29.797325 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 08:09:29.797325 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 08:09:29.797325 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 08:09:29.797325 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 08:09:29.797325 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 08:09:29.797325 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 08:09:29.797325 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5d714f2-600b-4d10-be88-c1186d2c5d59 could not be found. Jul 26 08:09:29.797325 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 08:09:29.797325 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 08:09:29.797325 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 08:09:29.797325 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 08:09:29.797325 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 08:09:29.797325 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 08:09:29.797325 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 08:09:29.797325 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 08:09:29.797325 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5d714f2-600b-4d10-be88-c1186d2c5d59 could not be found. Jul 26 08:09:29.797325 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 08:09:29.798501 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-28ed60c5-0d92-4201-b48a-5865f427cd37 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Returning 404 to user: Instance a5d714f2-600b-4d10-be88-c1186d2c5d59 could not be found. {{(pid=117716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 08:09:29.798501 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-28ed60c5-0d92-4201-b48a-5865f427cd37 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/a5d714f2-600b-4d10-be88-c1186d2c5d59" status: 404 len: 111 microversion: 2.1 time: 0.041207 Jul 26 08:09:29.798501 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1215/2476] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:09:29 2022] GET /compute/v2.1/servers/a5d714f2-600b-4d10-be88-c1186d2c5d59 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 08:09:32.877375 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-2fb48068-e2cf-4612-ab94-c4140eb4f47a tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:09:32.877899 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2fb48068-e2cf-4612-ab94-c4140eb4f47a tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: 1d113a2e-cf60-4d21-92e6-992d10f072da] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:09:32.879796 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-51dadec4-763c-4d07-b197-cfd023bb6f48 req-ce332d9f-c621-4c20-8b02-5f633856176b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d113a2e-cf60-4d21-92e6-992d10f072da", "tag": "c20e3ee5-16d8-4888-a4ca-e2d740d927cd"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 08:09:32.885122 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2fb48068-e2cf-4612-ab94-c4140eb4f47a tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:09:32.885567 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2fb48068-e2cf-4612-ab94-c4140eb4f47a tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:09:32.886466 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2fb48068-e2cf-4612-ab94-c4140eb4f47a tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:09:32.887055 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-2fb48068-e2cf-4612-ab94-c4140eb4f47a tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:09:32.891270 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-51dadec4-763c-4d07-b197-cfd023bb6f48 req-ce332d9f-c621-4c20-8b02-5f633856176b service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:09:32.891714 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-51dadec4-763c-4d07-b197-cfd023bb6f48 req-ce332d9f-c621-4c20-8b02-5f633856176b service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:09:32.906383 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-51dadec4-763c-4d07-b197-cfd023bb6f48 req-ce332d9f-c621-4c20-8b02-5f633856176b service nova] Creating event network-changed:c20e3ee5-16d8-4888-a4ca-e2d740d927cd for instance 1d113a2e-cf60-4d21-92e6-992d10f072da on hv-cinder-85083 Jul 26 08:09:32.911623 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-51dadec4-763c-4d07-b197-cfd023bb6f48 req-ce332d9f-c621-4c20-8b02-5f633856176b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035904 Jul 26 08:09:32.912274 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1216/2477] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 08:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 08:09:32.916557 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-2fb48068-e2cf-4612-ab94-c4140eb4f47a tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: 1d113a2e-cf60-4d21-92e6-992d10f072da] Going to try to terminate instance {{(pid=117715) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 08:09:33.000368 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-2fb48068-e2cf-4612-ab94-c4140eb4f47a tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da" status: 204 len: 0 microversion: 2.1 time: 0.126171 Jul 26 08:09:33.001173 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1262/2478] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Jul 26 08:09:32 2022] DELETE /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 08:09:33.010716 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-719f4a8f-4631-4e39-94dc-b8658405b0bd tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:09:33.011763 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-719f4a8f-4631-4e39-94dc-b8658405b0bd tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: 1d113a2e-cf60-4d21-92e6-992d10f072da] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:09:33.020725 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-719f4a8f-4631-4e39-94dc-b8658405b0bd tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:09:33.021176 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-719f4a8f-4631-4e39-94dc-b8658405b0bd tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:09:33.022233 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-719f4a8f-4631-4e39-94dc-b8658405b0bd tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:09:33.022450 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-719f4a8f-4631-4e39-94dc-b8658405b0bd tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:09:33.175396 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.policy [None req-719f4a8f-4631-4e39-94dc-b8658405b0bd tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117716) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:09:33.183487 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-719f4a8f-4631-4e39-94dc-b8658405b0bd tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da" status: 200 len: 1577 microversion: 2.1 time: 0.177343 Jul 26 08:09:33.184074 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1217/2479] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:09:33 2022] GET /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da => generated 1577 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:09:34.207558 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-e7ad7ecd-361f-469b-a233-d3ac7a1376d2 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:09:34.208370 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-e7ad7ecd-361f-469b-a233-d3ac7a1376d2 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: 1d113a2e-cf60-4d21-92e6-992d10f072da] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:09:34.217354 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e7ad7ecd-361f-469b-a233-d3ac7a1376d2 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:09:34.218027 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e7ad7ecd-361f-469b-a233-d3ac7a1376d2 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:09:34.219083 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e7ad7ecd-361f-469b-a233-d3ac7a1376d2 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:09:34.219671 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-e7ad7ecd-361f-469b-a233-d3ac7a1376d2 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:09:34.357674 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-e7ad7ecd-361f-469b-a233-d3ac7a1376d2 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:09:34.365301 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-e7ad7ecd-361f-469b-a233-d3ac7a1376d2 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da" status: 200 len: 1577 microversion: 2.1 time: 0.163491 Jul 26 08:09:34.365854 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1263/2480] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:09:34 2022] GET /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:09:34.948039 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [req-d93d2bf4-6236-4ca0-a1ee-04515dfb16e1 req-121356fe-eb2f-4376-a908-e737f161c6d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d113a2e-cf60-4d21-92e6-992d10f072da", "name": "network-vif-deleted", "tag": "c20e3ee5-16d8-4888-a4ca-e2d740d927cd"}]} {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 08:09:34.958578 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-d93d2bf4-6236-4ca0-a1ee-04515dfb16e1 req-121356fe-eb2f-4376-a908-e737f161c6d7 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:09:34.959015 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [req-d93d2bf4-6236-4ca0-a1ee-04515dfb16e1 req-121356fe-eb2f-4376-a908-e737f161c6d7 service nova] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:09:34.970789 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.compute.server_external_events [req-d93d2bf4-6236-4ca0-a1ee-04515dfb16e1 req-121356fe-eb2f-4376-a908-e737f161c6d7 service nova] Creating event network-vif-deleted:c20e3ee5-16d8-4888-a4ca-e2d740d927cd for instance 1d113a2e-cf60-4d21-92e6-992d10f072da on hv-cinder-85083 Jul 26 08:09:34.976170 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [req-d93d2bf4-6236-4ca0-a1ee-04515dfb16e1 req-121356fe-eb2f-4376-a908-e737f161c6d7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031911 Jul 26 08:09:34.976764 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1218/2481] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Jul 26 08:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 08:09:35.386257 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-184f02bb-0376-4e26-b4cd-eeeeba18d317 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:09:35.386857 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-184f02bb-0376-4e26-b4cd-eeeeba18d317 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: 1d113a2e-cf60-4d21-92e6-992d10f072da] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:09:35.393883 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-184f02bb-0376-4e26-b4cd-eeeeba18d317 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:09:35.394338 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-184f02bb-0376-4e26-b4cd-eeeeba18d317 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:09:35.395098 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-184f02bb-0376-4e26-b4cd-eeeeba18d317 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:09:35.395533 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-184f02bb-0376-4e26-b4cd-eeeeba18d317 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:09:35.426824 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-184f02bb-0376-4e26-b4cd-eeeeba18d317 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:09:35.427201 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-184f02bb-0376-4e26-b4cd-eeeeba18d317 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:09:35.427648 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.objects.instance [None req-184f02bb-0376-4e26-b4cd-eeeeba18d317 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lazy-loading 'fault' on Instance uuid 1d113a2e-cf60-4d21-92e6-992d10f072da {{(pid=117715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 08:09:35.471154 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.policy [None req-184f02bb-0376-4e26-b4cd-eeeeba18d317 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7881b5c6627d41eca68a27fc38559b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491378f17ebd4fddbf00a3b55a2d5b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117715) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 08:09:35.479664 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-184f02bb-0376-4e26-b4cd-eeeeba18d317 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da" status: 200 len: 1229 microversion: 2.1 time: 0.097313 Jul 26 08:09:35.480755 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1264/2482] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:09:35 2022] GET /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da => generated 1229 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 08:09:36.507573 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-eae260fd-71c6-44f3-8dfe-0cebeccb70ca tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:09:36.508762 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-eae260fd-71c6-44f3-8dfe-0cebeccb70ca tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: 1d113a2e-cf60-4d21-92e6-992d10f072da] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:09:36.516340 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-eae260fd-71c6-44f3-8dfe-0cebeccb70ca tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:09:36.516784 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-eae260fd-71c6-44f3-8dfe-0cebeccb70ca tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:09:36.517524 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-eae260fd-71c6-44f3-8dfe-0cebeccb70ca tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:09:36.517996 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-eae260fd-71c6-44f3-8dfe-0cebeccb70ca tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:09:36.531352 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.wsgi [None req-eae260fd-71c6-44f3-8dfe-0cebeccb70ca tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] HTTP exception thrown: Instance 1d113a2e-cf60-4d21-92e6-992d10f072da could not be found. Jul 26 08:09:36.532957 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-eae260fd-71c6-44f3-8dfe-0cebeccb70ca tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Request method failure captured: Jul 26 08:09:36.532957 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: request: GET /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da HTTP/1.1 Jul 26 08:09:36.532957 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept: application/json Jul 26 08:09:36.532957 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept-Encoding: identity Jul 26 08:09:36.532957 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Connection: close Jul 26 08:09:36.532957 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Length: 0 Jul 26 08:09:36.532957 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Type: application/json Jul 26 08:09:36.532957 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Host: 10.222.0.39 Jul 26 08:09:36.532957 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Openstack-System-Scope: None Jul 26 08:09:36.532957 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: User-Agent: python-urllib3/1.26.10 Jul 26 08:09:36.532957 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Auth-Token: gAAAAABi35-8j0JWLkrKLHPn1kUDvNisSciWAEnvsJwzysecRTk3h8u2GZGNwtQneOQTYv1MoFaY_kinw0ggx2ZWxAsMd4DWG4z5p_n2rYTwTNUi1B_DBdImFU2fBjVNpIfwhJKvvNucakKZQIBz0XYXbekWHd9w4yacS8SoS8LoYRp6ju7oVWY Jul 26 08:09:36.532957 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Id: None Jul 26 08:09:36.532957 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Name: None Jul 26 08:09:36.532957 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Identity-Status: Confirmed Jul 26 08:09:36.532957 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Is-Admin-Project: True Jul 26 08:09:36.532957 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Id: default Jul 26 08:09:36.532957 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Name: Default Jul 26 08:09:36.532957 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Id: 491378f17ebd4fddbf00a3b55a2d5b85 Jul 26 08:09:36.532957 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Name: tempest-TestVolumeBootPattern-1693328640 Jul 26 08:09:36.532957 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Role: member,reader Jul 26 08:09:36.532957 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Roles: member,reader Jul 26 08:09:36.534329 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/491378f17ebd4fddbf00a3b55a2d5b85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_491378f17ebd4fddbf00a3b55a2d5b85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/491378f17ebd4fddbf00a3b55a2d5b85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/491378f17ebd4fddbf00a3b55a2d5b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 08:09:36.534329 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant: tempest-TestVolumeBootPattern-1693328640 Jul 26 08:09:36.534329 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Id: 491378f17ebd4fddbf00a3b55a2d5b85 Jul 26 08:09:36.534329 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Name: tempest-TestVolumeBootPattern-1693328640 Jul 26 08:09:36.534329 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User: tempest-TestVolumeBootPattern-1693328640-project Jul 26 08:09:36.534329 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Id: default Jul 26 08:09:36.534329 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Name: Default Jul 26 08:09:36.534329 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Id: 7881b5c6627d41eca68a27fc38559b2f Jul 26 08:09:36.534329 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Name: tempest-TestVolumeBootPattern-1693328640-project Jul 26 08:09:36.534329 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: method: > Jul 26 08:09:36.534329 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: exception: Instance 1d113a2e-cf60-4d21-92e6-992d10f072da could not be found. Jul 26 08:09:36.534329 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: action_args: {'id': '1d113a2e-cf60-4d21-92e6-992d10f072da'} Jul 26 08:09:36.535109 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 08:09:36.535109 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 08:09:36.535109 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 08:09:36.535109 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 08:09:36.535109 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 08:09:36.535109 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 08:09:36.535109 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 08:09:36.535109 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 08:09:36.535109 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 08:09:36.535109 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 08:09:36.535109 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d113a2e-cf60-4d21-92e6-992d10f072da could not be found. Jul 26 08:09:36.535109 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 08:09:36.535109 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 08:09:36.535109 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 08:09:36.535109 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 08:09:36.535109 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 08:09:36.535109 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 08:09:36.535109 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 08:09:36.535109 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 08:09:36.535109 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 08:09:36.536355 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 08:09:36.536355 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 08:09:36.536355 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 08:09:36.536355 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 08:09:36.536355 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 08:09:36.536355 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 08:09:36.536355 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 08:09:36.536355 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d113a2e-cf60-4d21-92e6-992d10f072da could not be found. Jul 26 08:09:36.536355 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 08:09:36.536355 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 08:09:36.536355 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 08:09:36.536355 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 08:09:36.536355 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 08:09:36.536355 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 08:09:36.536355 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 08:09:36.536355 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 08:09:36.536355 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d113a2e-cf60-4d21-92e6-992d10f072da could not be found. Jul 26 08:09:36.536355 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 08:09:36.537496 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-eae260fd-71c6-44f3-8dfe-0cebeccb70ca tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Returning 404 to user: Instance 1d113a2e-cf60-4d21-92e6-992d10f072da could not be found. {{(pid=117716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 08:09:36.537496 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-eae260fd-71c6-44f3-8dfe-0cebeccb70ca tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da" status: 404 len: 111 microversion: 2.1 time: 0.034770 Jul 26 08:09:36.537496 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1219/2483] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:09:36 2022] GET /compute/v2.1/servers/1d113a2e-cf60-4d21-92e6-992d10f072da => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 08:09:37.262729 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-76062742-dbfd-40b5-b4b1-b25207442c76 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:09:37.263255 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.compute.api [None req-76062742-dbfd-40b5-b4b1-b25207442c76 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: bb22026b-91d8-4ad6-9926-5f8bfecf5ba6] Fetching instance by UUID {{(pid=117715) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:09:37.270040 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-76062742-dbfd-40b5-b4b1-b25207442c76 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:09:37.270479 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-76062742-dbfd-40b5-b4b1-b25207442c76 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:09:37.271244 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-76062742-dbfd-40b5-b4b1-b25207442c76 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:09:37.271639 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG oslo_concurrency.lockutils [None req-76062742-dbfd-40b5-b4b1-b25207442c76 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:09:37.284729 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.wsgi [None req-76062742-dbfd-40b5-b4b1-b25207442c76 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] HTTP exception thrown: Instance bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 could not be found. Jul 26 08:09:37.286390 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-76062742-dbfd-40b5-b4b1-b25207442c76 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Request method failure captured: Jul 26 08:09:37.286390 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: request: DELETE /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 HTTP/1.1 Jul 26 08:09:37.286390 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept: application/json Jul 26 08:09:37.286390 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Accept-Encoding: identity Jul 26 08:09:37.286390 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Connection: close Jul 26 08:09:37.286390 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Length: 0 Jul 26 08:09:37.286390 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Content-Type: application/json Jul 26 08:09:37.286390 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Host: 10.222.0.39 Jul 26 08:09:37.286390 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Openstack-System-Scope: None Jul 26 08:09:37.286390 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: User-Agent: python-urllib3/1.26.10 Jul 26 08:09:37.286390 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Auth-Token: gAAAAABi35-8j0JWLkrKLHPn1kUDvNisSciWAEnvsJwzysecRTk3h8u2GZGNwtQneOQTYv1MoFaY_kinw0ggx2ZWxAsMd4DWG4z5p_n2rYTwTNUi1B_DBdImFU2fBjVNpIfwhJKvvNucakKZQIBz0XYXbekWHd9w4yacS8SoS8LoYRp6ju7oVWY Jul 26 08:09:37.286390 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Id: None Jul 26 08:09:37.286390 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Domain-Name: None Jul 26 08:09:37.286390 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Identity-Status: Confirmed Jul 26 08:09:37.286390 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Is-Admin-Project: True Jul 26 08:09:37.286390 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Id: default Jul 26 08:09:37.286390 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Domain-Name: Default Jul 26 08:09:37.286390 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Id: 491378f17ebd4fddbf00a3b55a2d5b85 Jul 26 08:09:37.286390 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Project-Name: tempest-TestVolumeBootPattern-1693328640 Jul 26 08:09:37.286390 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Role: member,reader Jul 26 08:09:37.286390 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Roles: member,reader Jul 26 08:09:37.287638 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/491378f17ebd4fddbf00a3b55a2d5b85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_491378f17ebd4fddbf00a3b55a2d5b85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/491378f17ebd4fddbf00a3b55a2d5b85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/491378f17ebd4fddbf00a3b55a2d5b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 08:09:37.287638 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant: tempest-TestVolumeBootPattern-1693328640 Jul 26 08:09:37.287638 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Id: 491378f17ebd4fddbf00a3b55a2d5b85 Jul 26 08:09:37.287638 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-Tenant-Name: tempest-TestVolumeBootPattern-1693328640 Jul 26 08:09:37.287638 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User: tempest-TestVolumeBootPattern-1693328640-project Jul 26 08:09:37.287638 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Id: default Jul 26 08:09:37.287638 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Domain-Name: Default Jul 26 08:09:37.287638 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Id: 7881b5c6627d41eca68a27fc38559b2f Jul 26 08:09:37.287638 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: X-User-Name: tempest-TestVolumeBootPattern-1693328640-project Jul 26 08:09:37.287638 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: method: > Jul 26 08:09:37.287638 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: exception: Instance bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 could not be found. Jul 26 08:09:37.287638 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: action_args: {'id': 'bb22026b-91d8-4ad6-9926-5f8bfecf5ba6'} Jul 26 08:09:37.288385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 08:09:37.288385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 08:09:37.288385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 08:09:37.288385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 08:09:37.288385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 08:09:37.288385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 08:09:37.288385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 08:09:37.288385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 08:09:37.288385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 08:09:37.288385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 08:09:37.288385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 could not be found. Jul 26 08:09:37.288385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 08:09:37.288385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 08:09:37.288385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 08:09:37.288385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 08:09:37.288385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 08:09:37.288385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 08:09:37.288385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 08:09:37.288385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 08:09:37.288385 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 08:09:37.289569 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 08:09:37.289569 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 08:09:37.289569 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 08:09:37.289569 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 08:09:37.289569 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 08:09:37.289569 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 08:09:37.289569 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 08:09:37.289569 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 08:09:37.289569 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 08:09:37.289569 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 could not be found. Jul 26 08:09:37.289569 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 08:09:37.289569 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 08:09:37.289569 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 08:09:37.289569 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 08:09:37.289569 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 08:09:37.289569 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 08:09:37.289569 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 08:09:37.289569 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 08:09:37.289569 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 could not be found. Jul 26 08:09:37.289569 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: ERROR nova.api.openstack.wsgi Jul 26 08:09:37.290861 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-76062742-dbfd-40b5-b4b1-b25207442c76 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Returning 404 to user: Instance bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 could not be found. {{(pid=117715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 08:09:37.290861 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-76062742-dbfd-40b5-b4b1-b25207442c76 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "DELETE /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6" status: 404 len: 111 microversion: 2.1 time: 0.029037 Jul 26 08:09:37.290861 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1265/2484] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Jul 26 08:09:37 2022] DELETE /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 08:09:37.296916 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-29dbadb3-e28a-4064-89c2-6f25fc185205 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '>' {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:09:37.297548 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.compute.api [None req-29dbadb3-e28a-4064-89c2-6f25fc185205 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] [instance: bb22026b-91d8-4ad6-9926-5f8bfecf5ba6] Fetching instance by UUID {{(pid=117716) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 08:09:37.303768 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-29dbadb3-e28a-4064-89c2-6f25fc185205 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:09:37.304210 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-29dbadb3-e28a-4064-89c2-6f25fc185205 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:09:37.304955 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-29dbadb3-e28a-4064-89c2-6f25fc185205 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 08:09:37.305380 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG oslo_concurrency.lockutils [None req-29dbadb3-e28a-4064-89c2-6f25fc185205 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Lock "0c0ac969-2f99-49ee-92fc-c2c2e5e059a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 08:09:37.319147 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.wsgi [None req-29dbadb3-e28a-4064-89c2-6f25fc185205 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] HTTP exception thrown: Instance bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 could not be found. Jul 26 08:09:37.320652 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-29dbadb3-e28a-4064-89c2-6f25fc185205 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Request method failure captured: Jul 26 08:09:37.320652 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: request: GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 HTTP/1.1 Jul 26 08:09:37.320652 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept: application/json Jul 26 08:09:37.320652 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Accept-Encoding: identity Jul 26 08:09:37.320652 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Connection: close Jul 26 08:09:37.320652 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Length: 0 Jul 26 08:09:37.320652 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Content-Type: application/json Jul 26 08:09:37.320652 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Host: 10.222.0.39 Jul 26 08:09:37.320652 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Openstack-System-Scope: None Jul 26 08:09:37.320652 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: User-Agent: python-urllib3/1.26.10 Jul 26 08:09:37.320652 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Auth-Token: gAAAAABi35-8j0JWLkrKLHPn1kUDvNisSciWAEnvsJwzysecRTk3h8u2GZGNwtQneOQTYv1MoFaY_kinw0ggx2ZWxAsMd4DWG4z5p_n2rYTwTNUi1B_DBdImFU2fBjVNpIfwhJKvvNucakKZQIBz0XYXbekWHd9w4yacS8SoS8LoYRp6ju7oVWY Jul 26 08:09:37.320652 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Id: None Jul 26 08:09:37.320652 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Domain-Name: None Jul 26 08:09:37.320652 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Identity-Status: Confirmed Jul 26 08:09:37.320652 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Is-Admin-Project: True Jul 26 08:09:37.320652 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Id: default Jul 26 08:09:37.320652 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Domain-Name: Default Jul 26 08:09:37.320652 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Id: 491378f17ebd4fddbf00a3b55a2d5b85 Jul 26 08:09:37.320652 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Project-Name: tempest-TestVolumeBootPattern-1693328640 Jul 26 08:09:37.320652 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Role: member,reader Jul 26 08:09:37.320652 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Roles: member,reader Jul 26 08:09:37.322067 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/491378f17ebd4fddbf00a3b55a2d5b85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_491378f17ebd4fddbf00a3b55a2d5b85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/491378f17ebd4fddbf00a3b55a2d5b85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/491378f17ebd4fddbf00a3b55a2d5b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jul 26 08:09:37.322067 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant: tempest-TestVolumeBootPattern-1693328640 Jul 26 08:09:37.322067 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Id: 491378f17ebd4fddbf00a3b55a2d5b85 Jul 26 08:09:37.322067 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-Tenant-Name: tempest-TestVolumeBootPattern-1693328640 Jul 26 08:09:37.322067 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User: tempest-TestVolumeBootPattern-1693328640-project Jul 26 08:09:37.322067 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Id: default Jul 26 08:09:37.322067 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Domain-Name: Default Jul 26 08:09:37.322067 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Id: 7881b5c6627d41eca68a27fc38559b2f Jul 26 08:09:37.322067 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: X-User-Name: tempest-TestVolumeBootPattern-1693328640-project Jul 26 08:09:37.322067 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: method: > Jul 26 08:09:37.322067 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: exception: Instance bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 could not be found. Jul 26 08:09:37.322067 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: action_args: {'id': 'bb22026b-91d8-4ad6-9926-5f8bfecf5ba6'} Jul 26 08:09:37.322813 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: {{(pid=117716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 08:09:37.322813 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 08:09:37.322813 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 08:09:37.322813 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 08:09:37.322813 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 08:09:37.322813 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 08:09:37.322813 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 08:09:37.322813 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 08:09:37.322813 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 08:09:37.322813 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 08:09:37.322813 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 could not be found. Jul 26 08:09:37.322813 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 08:09:37.322813 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 08:09:37.322813 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 08:09:37.322813 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 08:09:37.322813 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 08:09:37.322813 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 08:09:37.322813 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 08:09:37.322813 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 08:09:37.322813 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 08:09:37.324100 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 08:09:37.324100 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 08:09:37.324100 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 08:09:37.324100 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 08:09:37.324100 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 08:09:37.324100 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 08:09:37.324100 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 08:09:37.324100 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 could not be found. Jul 26 08:09:37.324100 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 08:09:37.324100 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 08:09:37.324100 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 08:09:37.324100 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 08:09:37.324100 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 08:09:37.324100 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 08:09:37.324100 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 08:09:37.324100 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 08:09:37.324100 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 could not be found. Jul 26 08:09:37.324100 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: ERROR nova.api.openstack.wsgi Jul 26 08:09:37.325307 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: DEBUG nova.api.openstack.wsgi [None req-29dbadb3-e28a-4064-89c2-6f25fc185205 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Returning 404 to user: Instance bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 could not be found. {{(pid=117716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 08:09:37.325307 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO nova.api.openstack.requestlog [None req-29dbadb3-e28a-4064-89c2-6f25fc185205 tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6" status: 404 len: 111 microversion: 2.1 time: 0.028987 Jul 26 08:09:37.325307 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: [pid: 117716|app: 0|req: 1220/2485] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Jul 26 08:09:37 2022] GET /compute/v2.1/servers/bb22026b-91d8-4ad6-9926-5f8bfecf5ba6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 08:09:38.626558 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: DEBUG nova.api.openstack.wsgi [None req-8f59606f-99e4-4010-b5ec-223f175d346f tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] Calling method '.version_select at 0x7f7f0260f0d0>' {{(pid=117715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 08:09:38.649223 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO nova.api.openstack.requestlog [None req-8f59606f-99e4-4010-b5ec-223f175d346f tempest-TestVolumeBootPattern-1693328640 tempest-TestVolumeBootPattern-1693328640-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-241314831" status: 202 len: 0 microversion: 2.1 time: 0.026419 Jul 26 08:09:38.650005 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: [pid: 117715|app: 0|req: 1266/2486] 10.222.0.39 () {58 vars in 1260 bytes} [Tue Jul 26 08:09:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-241314831 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 08:10:38.060615 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 08:10:38.061629 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Tue Jul 26 08:10:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 08:10:47.801195 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 08:10:47.802087 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Tue Jul 26 08:10:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 08:12:10.403331 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 08:12:10.404220 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Tue Jul 26 08:12:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 08:12:17.759065 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 08:12:17.759661 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Tue Jul 26 08:12:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 08:12:36.739525 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 08:12:36.740412 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Tue Jul 26 08:12:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 08:12:46.213076 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 08:12:46.213887 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Tue Jul 26 08:12:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 08:13:58.071638 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 08:13:58.072132 dv-cinder-850836-1-iscsi devstack@n-api.service[117715]: Tue Jul 26 08:13:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 08:14:07.814872 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 08:14:07.815806 dv-cinder-850836-1-iscsi devstack@n-api.service[117716]: Tue Jul 26 08:14:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!